-- Logs begin at Fri 2022-06-24 10:11:27 UTC, end at Fri 2022-06-24 11:21:02 UTC. -- Jun 24 10:38:55.677759 dv-cinder-836996-38-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 24 10:38:55.686641 dv-cinder-836996-38-iscsi devstack@keystone.service[80162]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 24 10:38:55.688727 dv-cinder-836996-38-iscsi devstack@keystone.service[80162]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 10:38:55 2022] *** Jun 24 10:38:55.688727 dv-cinder-836996-38-iscsi devstack@keystone.service[80162]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 10:38:55.688727 dv-cinder-836996-38-iscsi devstack@keystone.service[80162]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 10:38:55.688727 dv-cinder-836996-38-iscsi devstack@keystone.service[80162]: nodename: dv-cinder-836996-38-iscsi Jun 24 10:38:55.688727 dv-cinder-836996-38-iscsi devstack@keystone.service[80162]: machine: x86_64 Jun 24 10:38:55.688727 dv-cinder-836996-38-iscsi devstack@keystone.service[80162]: clock source: unix Jun 24 10:38:55.688727 dv-cinder-836996-38-iscsi devstack@keystone.service[80162]: pcre jit disabled Jun 24 10:38:55.688727 dv-cinder-836996-38-iscsi devstack@keystone.service[80162]: detected number of CPU cores: 4 Jun 24 10:38:55.688727 dv-cinder-836996-38-iscsi devstack@keystone.service[80162]: current working directory: / Jun 24 10:38:55.688727 dv-cinder-836996-38-iscsi devstack@keystone.service[80162]: detected binary path: /usr/bin/uwsgi-core Jun 24 10:38:55.689296 dv-cinder-836996-38-iscsi devstack@keystone.service[80162]: your processes number limit is 47680 Jun 24 10:38:55.689296 dv-cinder-836996-38-iscsi devstack@keystone.service[80162]: your memory page size is 4096 bytes Jun 24 10:38:55.689296 dv-cinder-836996-38-iscsi devstack@keystone.service[80162]: detected max file descriptor number: 2048 Jun 24 10:38:55.689296 dv-cinder-836996-38-iscsi devstack@keystone.service[80162]: lock engine: pthread robust mutexes Jun 24 10:38:55.689296 dv-cinder-836996-38-iscsi devstack@keystone.service[80162]: thunder lock: enabled Jun 24 10:38:55.689296 dv-cinder-836996-38-iscsi devstack@keystone.service[80162]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 24 10:38:55.689296 dv-cinder-836996-38-iscsi devstack@keystone.service[80162]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 10:38:55.732620 dv-cinder-836996-38-iscsi devstack@keystone.service[80162]: Python main interpreter initialized at 0x5596d771b9c0 Jun 24 10:38:55.732620 dv-cinder-836996-38-iscsi devstack@keystone.service[80162]: python threads support enabled Jun 24 10:38:55.732620 dv-cinder-836996-38-iscsi devstack@keystone.service[80162]: your server socket listen backlog is limited to 100 connections Jun 24 10:38:55.732620 dv-cinder-836996-38-iscsi devstack@keystone.service[80162]: your mercy for graceful operations on workers is 90 seconds Jun 24 10:38:55.733023 dv-cinder-836996-38-iscsi devstack@keystone.service[80162]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 10:38:55.733023 dv-cinder-836996-38-iscsi devstack@keystone.service[80162]: *** Operational MODE: preforking *** Jun 24 10:38:55.733332 dv-cinder-836996-38-iscsi devstack@keystone.service[80162]: *** uWSGI is running in multiple interpreter mode *** Jun 24 10:38:55.733332 dv-cinder-836996-38-iscsi devstack@keystone.service[80162]: spawned uWSGI master process (pid: 80162) Jun 24 10:38:55.734195 dv-cinder-836996-38-iscsi devstack@keystone.service[80162]: spawned uWSGI worker 1 (pid: 80173, cores: 1) Jun 24 10:38:55.734258 dv-cinder-836996-38-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 24 10:38:55.734970 dv-cinder-836996-38-iscsi devstack@keystone.service[80162]: spawned uWSGI worker 2 (pid: 80174, cores: 1) Jun 24 10:38:55.734970 dv-cinder-836996-38-iscsi devstack@keystone.service[80162]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 10:39:01.144951 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 10:39:01.144951 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: from cryptography.utils import int_from_bytes Jun 24 10:39:01.145777 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 10:39:01.145777 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: from cryptography.utils import int_from_bytes Jun 24 10:39:01.146183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 10:39:01.146183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: from cryptography.utils import int_from_bytes Jun 24 10:39:01.146288 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 10:39:01.146288 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: from cryptography.utils import int_from_bytes Jun 24 10:39:01.194137 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 10:39:01.194475 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 10:39:01.194571 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 10:39:01.194650 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 10:39:01.194729 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] command line args: [] {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 10:39:01.194804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] command line args: [] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 10:39:01.194881 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 10:39:01.194941 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 10:39:01.195007 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ================================================================================ {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 10:39:01.195065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ================================================================================ {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 10:39:01.195123 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] admin_token = **** {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.195228 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] admin_token = **** {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.195372 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] config_dir = [] {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.195457 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] config_dir = [] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.195587 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.195722 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.195813 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] config_source = [] {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.195896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] config_source = [] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.196078 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] debug = True {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.196149 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] debug = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.196208 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.196418 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.196514 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.196580 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.196766 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.196852 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.196922 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.197036 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.197157 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.197259 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.197423 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] list_limit = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.197539 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] list_limit = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.197618 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] log_config_append = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.197681 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] log_config_append = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.197746 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.197811 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.197953 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] log_dir = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.198036 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] log_dir = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.198106 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] log_file = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.198167 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] log_file = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.198309 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.198399 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.198555 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.198654 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.198773 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.198854 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.199047 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.199208 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.199208 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.199357 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.199357 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.199481 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.199632 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.199719 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.199834 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.199917 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.200116 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.200299 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.200426 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.200526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.200595 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.200665 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.200726 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.200788 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.200937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.201019 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.201174 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.201306 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.201471 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.201604 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.201956 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.202090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.202241 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] publish_errors = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.202329 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] publish_errors = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.202403 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.202532 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.202667 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.202745 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.202818 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.202902 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.202976 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.203068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.203172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.203261 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.203373 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] standard_threads = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.203517 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] standard_threads = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.203593 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.203663 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.203817 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.203912 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.203986 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.204068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.204141 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] use_journal = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.204212 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] use_journal = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.204282 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] use_json = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.204396 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] use_json = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.204472 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] use_stderr = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.204555 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] use_stderr = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.204628 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] use_syslog = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.204706 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] use_syslog = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.204858 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.204982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:39:01.205116 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.205209 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.205293 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.205373 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.205565 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.205660 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.205740 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.205823 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.206009 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.206143 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.206231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.206306 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.206470 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.206607 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.206689 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.206771 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.206929 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.207064 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.207175 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.207269 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.207435 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.207559 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.207638 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.207722 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.207867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.207967 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.208094 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.208184 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.208333 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.208416 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.208570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.208735 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.208811 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.208884 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.209038 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.209173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.209280 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.209373 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.209529 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.209610 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.209754 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.209839 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.210001 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.210096 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.210253 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.210336 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.210498 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.210581 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.210738 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.210829 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.210963 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.211052 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.211209 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.211294 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.211432 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.211533 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.211735 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.211825 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.211995 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.212077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.212245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.212327 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.212475 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.212561 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.212704 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.212785 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.212974 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.213064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.213182 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.213267 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.213415 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.213493 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.213659 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.213744 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.213889 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.213968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.214201 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.214301 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.214633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.214749 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.214826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.214905 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.214983 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.215054 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.215131 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.215257 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.215330 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.215399 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.215468 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.215537 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.215698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.215819 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.215897 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.215968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.216139 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.216291 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.216410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.216516 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.216618 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.216713 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.216812 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.216911 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.217014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.217114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.217226 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.217342 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.217418 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.217568 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.217693 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.217769 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.217881 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.217956 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.218066 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.218146 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.218307 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.218431 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.218519 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.218594 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.218720 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.218807 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.218971 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.219186 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.219273 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.219365 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.219440 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.219570 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.219692 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.219775 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.219854 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.219926 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.220074 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.220196 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.220281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.220362 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.220551 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.220691 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.220773 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.220901 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.220984 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.221067 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.221249 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.221419 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.221501 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.221574 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.221681 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.221780 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.221934 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.222056 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.222134 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.222216 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.222344 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.222431 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.222608 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.222730 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.222808 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.222890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.223061 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.223236 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.223319 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.223392 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.223538 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.223662 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.223740 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.223829 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.223983 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.224106 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.224184 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.224256 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.224433 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.224530 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.224736 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.224869 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.224946 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.225017 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.225087 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.225239 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.225317 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.225388 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.225554 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.225635 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.225780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.225870 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.226009 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.226102 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.226233 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.226314 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.226453 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.226534 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.226674 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.226763 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.226900 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.227025 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.227100 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.227206 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.227400 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.227618 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.227965 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.228038 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.228117 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.228196 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.228196 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.228336 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.228407 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.228477 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.228620 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.228701 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.229057 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.229139 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.229211 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] auth.external = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.229289 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] auth.external = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.229360 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.229430 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.229541 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.229651 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.229765 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.229848 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.229998 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] auth.password = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.230080 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] auth.password = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.230221 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] auth.token = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.230309 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] auth.token = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.230451 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.230534 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.230654 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.230730 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.230912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.230996 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.231130 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.231290 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.231392 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.231475 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.231639 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.231722 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.231864 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.231947 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.232094 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] credential.caching = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.232217 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] credential.caching = True {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.232324 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.232406 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.232578 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.232661 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.232818 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.232900 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.233047 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.233130 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.233253 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.233330 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.233506 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.233588 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.233766 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.233846 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.234012 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.234103 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.234244 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.234326 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.234488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.234570 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.234763 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.234846 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.235002 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.235083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.235282 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.235364 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.235508 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.235593 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.235760 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.235838 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.235993 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] federation.caching = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.236070 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] federation.caching = True {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.236222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.236301 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.236462 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.236539 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.236702 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.236779 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.236926 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.237004 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.237167 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.237285 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.237396 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.237475 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.237643 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.237722 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.237875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.237953 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.238122 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.238209 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.238353 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.238431 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.238590 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.238668 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.238818 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] identity.caching = True {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.238974 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] identity.caching = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.239049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.239120 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.239313 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.239393 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.239546 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.239636 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.239773 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.239851 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.240037 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.240116 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.240237 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.240322 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.240469 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.240547 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.240711 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.240795 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.240955 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.241041 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.241180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.241258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.241403 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.241481 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.241625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.241714 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.241862 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.241940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.242104 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.242188 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.242342 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.242427 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.242590 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.242675 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.242888 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.243519 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.243611 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.243700 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.243774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.243847 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.243917 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.243988 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.244058 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.244136 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.244215 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.244289 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.244411 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.244514 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.244641 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.244751 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.244875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.244991 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.245110 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.245230 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.245351 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.245479 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.245558 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.245708 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.245807 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.245955 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.246044 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.246201 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.246280 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.246435 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.246513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.246681 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.246761 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.246927 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.247006 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.247171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.247251 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.247402 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.247479 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.247630 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.247710 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.247857 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.247935 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.248091 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.248169 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.248323 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.248403 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.248552 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.248630 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.248785 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.248862 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.249024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.249104 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.249248 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.249327 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.249471 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.249550 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.249707 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.249791 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.249945 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.250023 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.250173 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.250259 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.250402 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.250479 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.250628 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.250706 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.250853 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.user = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.250939 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.251082 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.251177 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.251345 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.251424 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.251568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.251656 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.251806 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.251891 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.252046 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.252125 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.252284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.252370 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.252511 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.252589 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.252732 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.252810 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.252961 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.253046 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.253196 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.253275 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.253421 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.253498 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.253640 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.253726 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.253868 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.253945 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.254104 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.254255 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.254332 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.254402 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.254566 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.254645 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.254805 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.254883 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.255033 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.255119 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.255287 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.255366 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.255517 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.255595 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.255746 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.255840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.255974 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.256052 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.256201 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.256279 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.256432 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.256517 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.256668 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.256748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.256898 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.256976 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.257135 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.257220 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.257358 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.257472 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.257590 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.257669 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.257817 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.257904 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.258042 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.258121 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.258270 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.258355 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.258529 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.259100 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.259209 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.259285 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.259356 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.259428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.259499 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.259584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.259660 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.259738 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] resource.caching = True {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.259812 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] resource.caching = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.259883 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.260047 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.260134 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.260283 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.260362 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.260515 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.260593 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.260758 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.260843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.260987 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.261066 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.261224 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.261311 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.261453 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.261611 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.261691 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.261763 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.261902 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] role.caching = True {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.261981 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.262136 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] role.caching = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.262221 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] role.driver = sql {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.262355 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.262434 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] role.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.262596 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.262673 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.262836 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.262925 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.263077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.263174 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.263349 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.263428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.263588 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.263669 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.263826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.263905 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.264065 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.264143 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.264304 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.264384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.264528 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.264606 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.265089 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.265179 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.265179 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.265323 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.265394 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.265465 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.265537 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.265608 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.265686 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.265828 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.266056 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.266133 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.266299 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.266377 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.266540 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.266620 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.266781 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.266859 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.267023 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.267185 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.267321 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.267449 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.267572 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.267696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.267818 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.267949 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.268074 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.268197 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.268319 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.268442 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.268571 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.268702 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.268838 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.268962 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.269083 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.269219 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.269366 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.269512 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.269641 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.269766 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.269890 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.270013 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.270136 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.270267 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.270390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.270512 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.270650 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] token.caching = True {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.270773 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.270897 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.271027 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] token.caching = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.271197 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.271320 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.271440 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.271559 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.271677 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.271806 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.271928 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.272046 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.272166 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.272295 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.272414 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.272541 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.272660 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.272779 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.272899 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.273018 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.273137 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.273263 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.273382 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.273501 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.273620 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.273738 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.273857 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.273993 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.274256 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.274741 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.274873 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.275004 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.275125 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.275335 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.275463 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.275587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.275716 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] database.connection = **** {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.275842 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.275973 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.275973 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.276222 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.connection = **** {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.276364 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.276499 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.276623 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.276747 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.276871 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.276993 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.277116 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.277247 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.277371 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.277493 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.277616 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.277740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.277862 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.277992 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.278125 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.278209 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.278271 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.278330 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.278526 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.278657 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.278780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.278903 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.279025 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.281687 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.281804 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.282031 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.282309 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.282525 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.282611 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.282761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.282841 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.282960 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.283080 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 10:39:01.283215 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.283215 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:39:01.283215 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 10:39:01.309882 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.310095 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.310241 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.310325 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.310390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.310513 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.319284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.319512 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.346989 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.347185 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.348054 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.348290 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.492212 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.492406 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.540760 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.540969 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.541092 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.541318 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.604480 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.604668 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.604908 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.605058 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.605147 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.605224 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.605286 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.605429 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.605513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.605698 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.605867 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.606111 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.630453 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.630668 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.630774 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.630855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.630988 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.631067 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.631238 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.631344 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.631462 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.631551 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.631669 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.631745 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.631887 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.632105 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.642825 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.643564 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.655664 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.655840 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.655982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.656063 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.656217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.656301 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.656443 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.656532 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.657124 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.657193 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.657256 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.657317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.657317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.657317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:39:01.674366 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.674526 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 10:39:01.674884 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.675032 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.675121 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 10:39:01.675234 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 10:39:01.675337 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.675590 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.675717 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.675826 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 10:39:01.675907 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.676053 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.676186 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.676263 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.676553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.676804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.687072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.687424 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.687558 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.687635 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.687863 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.688110 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.688207 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.688440 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.696563 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.697232 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.699837 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.700108 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.700385 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.700619 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.700764 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.700851 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.700927 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.701155 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.701279 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.701380 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.701459 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.701654 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.701780 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.701893 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.701984 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.702184 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.702308 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.702416 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.702504 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.702708 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.702975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.703250 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.729037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.729759 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.730633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.730906 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.731396 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.731676 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.736135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.736523 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.736796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.736939 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.737310 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.737594 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.744276 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.744494 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.744970 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.745253 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.748927 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.749185 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.749484 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.749743 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.749869 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.750017 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.750141 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.750280 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.750363 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.750534 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.750659 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.750779 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.750864 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.751065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.751359 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.751611 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.769902 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.770182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.770306 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.770611 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.774840 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.775249 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.778442 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.778826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.778968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.779284 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.783803 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.784271 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.787404 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.787857 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.791402 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.791628 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.791755 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.791925 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.792052 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.792180 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.792271 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.792485 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.792610 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.792730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.792835 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.793026 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.813210 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.813341 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.813478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.813661 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.813786 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.813898 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.813987 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.814196 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.822329 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.822457 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.824044 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.824190 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.824338 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.824422 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.827559 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.827686 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.827818 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.827903 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.828131 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.828276 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.828415 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.828497 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.828707 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.828834 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.841913 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.842041 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.842231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.842320 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.842468 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.842608 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.842747 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.842869 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.844458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.844599 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.844766 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.844861 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.844971 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.845062 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.862741 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.863122 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.866006 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.866431 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.869445 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.869924 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.871141 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.871684 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.872798 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.873072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.873307 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.873434 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.873590 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.873856 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.880564 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.881149 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.882148 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.882790 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.885393 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.885682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.886063 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.886187 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.886344 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.886430 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.886846 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.887122 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.895354 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.895637 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.895907 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.896220 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.896508 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.896794 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.903974 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.904243 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.904510 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.908322 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.909596 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:39:01.909700 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.909837 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.909837 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.910029 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.910115 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.910235 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.910315 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.910441 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.910441 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.910630 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.910718 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.910876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.910960 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.911024 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.911142 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.911243 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.911333 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.911410 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.911473 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.911578 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.911578 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.911578 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.911578 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:39:01.945467 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5596d771b9c0 pid: 80173 (default app) Jun 24 10:39:01.947074 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5596d771b9c0 pid: 80174 (default app) Jun 24 10:39:01.949113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480081d-f897-4698-a0a9-04917dd6b3d4 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:01.949445 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480081d-f897-4698-a0a9-04917dd6b3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:01.949681 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480081d-f897-4698-a0a9-04917dd6b3d4 None None] PATH_INFO: `/v3` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:01.953899 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Fri Jun 24 10:39:01 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:09.835954 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940ef5c-e860-4c16-ac3f-392fd9d1a513 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:09.836563 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940ef5c-e860-4c16-ac3f-392fd9d1a513 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:09.836563 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940ef5c-e860-4c16-ac3f-392fd9d1a513 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:09.840921 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:09.846885 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07698e6-423e-44b0-9ea1-e10526a5db45 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:09.847338 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07698e6-423e-44b0-9ea1-e10526a5db45 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:09.847461 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07698e6-423e-44b0-9ea1-e10526a5db45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:09.916653 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: INFO dbcounter [None req-a07698e6-423e-44b0-9ea1-e10526a5db45 None None] Registered counter for database keystone Jun 24 10:39:09.941291 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG oslo_db.sqlalchemy.engines [None req-a07698e6-423e-44b0-9ea1-e10526a5db45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:39:09.951855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writer thread running {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:39:10.133401 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG passlib.handlers.bcrypt [None req-a07698e6-423e-44b0-9ea1-e10526a5db45 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80173) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 24 10:39:10.133812 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG passlib.handlers.bcrypt [None req-a07698e6-423e-44b0-9ea1-e10526a5db45 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80173) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 24 10:39:10.189869 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-a07698e6-423e-44b0-9ea1-e10526a5db45 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:10.191458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-a07698e6-423e-44b0-9ea1-e10526a5db45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:10.330292 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 484 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 24 10:39:10.489544 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940ef5c-e860-4c16-ac3f-392fd9d1a513 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:10.561674 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: INFO dbcounter [None req-d940ef5c-e860-4c16-ac3f-392fd9d1a513 None None] Registered counter for database keystone Jun 24 10:39:10.583465 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG oslo_db.sqlalchemy.engines [None req-d940ef5c-e860-4c16-ac3f-392fd9d1a513 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80174) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:39:10.595466 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writer thread running {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:39:10.728679 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940ef5c-e860-4c16-ac3f-392fd9d1a513 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:10.735751 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b5caa-f86d-4278-a844-b2862c56f2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:10.736430 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b5caa-f86d-4278-a844-b2862c56f2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:10.736709 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b5caa-f86d-4278-a844-b2862c56f2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:10.736980 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b5caa-f86d-4278-a844-b2862c56f2d8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:10.746935 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b5caa-f86d-4278-a844-b2862c56f2d8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:10.799919 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: WARNING keystone.common.rbac_enforcer.enforcer [None req-906b5caa-f86d-4278-a844-b2862c56f2d8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 24 10:39:10.800268 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b5caa-f86d-4278-a844-b2862c56f2d8 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:10.812281 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jun 24 10:39:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 10:39:10.819126 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07698e6-423e-44b0-9ea1-e10526a5db45 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:10.834897 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07698e6-423e-44b0-9ea1-e10526a5db45 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:10.840909 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7e84e-ac9b-459b-a7be-4f27813ebf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:10.842058 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7e84e-ac9b-459b-a7be-4f27813ebf0f admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:10.842345 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7e84e-ac9b-459b-a7be-4f27813ebf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:10.842622 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7e84e-ac9b-459b-a7be-4f27813ebf0f admin admin] PATH_INFO: `/v3/projects/f0f99060cebb41e8ac55ca6f1eeb4b0d` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:10.849044 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed7e84e-ac9b-459b-a7be-4f27813ebf0f admin admin] RBAC: Authorizing `identity:get_project(project_id=f0f99060cebb41e8ac55ca6f1eeb4b0d)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:10.900920 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5ed7e84e-ac9b-459b-a7be-4f27813ebf0f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 24 10:39:10.901263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed7e84e-ac9b-459b-a7be-4f27813ebf0f admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:10.906177 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jun 24 10:39:10 2022] GET /identity/v3/projects/f0f99060cebb41e8ac55ca6f1eeb4b0d => generated 344 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:12.919306 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983b57e-446b-4543-8038-e521241dd5dc None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:12.920088 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983b57e-446b-4543-8038-e521241dd5dc None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:12.920088 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983b57e-446b-4543-8038-e521241dd5dc None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:12.926900 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:12 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:12.936126 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68691497-4355-482c-bdfa-f722e19b397c None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:12.936555 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68691497-4355-482c-bdfa-f722e19b397c None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:12.936765 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68691497-4355-482c-bdfa-f722e19b397c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:12.961299 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-68691497-4355-482c-bdfa-f722e19b397c None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:12.962801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-68691497-4355-482c-bdfa-f722e19b397c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:12.972265 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 24 10:39:12.995045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983b57e-446b-4543-8038-e521241dd5dc None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:13.010257 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983b57e-446b-4543-8038-e521241dd5dc None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:13.016354 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4adca6-a84b-45db-80dd-35eebf7cdd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:13.017006 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4adca6-a84b-45db-80dd-35eebf7cdd6e admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:13.017300 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4adca6-a84b-45db-80dd-35eebf7cdd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:13.017577 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4adca6-a84b-45db-80dd-35eebf7cdd6e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:13.026686 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4adca6-a84b-45db-80dd-35eebf7cdd6e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:13.028550 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4adca6-a84b-45db-80dd-35eebf7cdd6e admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:13.038358 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jun 24 10:39:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 10:39:13.045072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68691497-4355-482c-bdfa-f722e19b397c None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:13.060526 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68691497-4355-482c-bdfa-f722e19b397c None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:13.070095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1b669-7a54-436d-ade1-71fc67dfdc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:13.071488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1b669-7a54-436d-ade1-71fc67dfdc55 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:13.071848 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1b669-7a54-436d-ade1-71fc67dfdc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:13.072241 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1b669-7a54-436d-ade1-71fc67dfdc55 admin admin] PATH_INFO: `/v3/users/ae7384e027454770bea6d011e8d5d6c6` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:13.074566 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1b669-7a54-436d-ade1-71fc67dfdc55 admin admin] RBAC: Authorizing `identity:get_user(user_id=ae7384e027454770bea6d011e8d5d6c6)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:13.076443 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1b669-7a54-436d-ade1-71fc67dfdc55 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:13.078024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jun 24 10:39:13 2022] GET /identity/v3/users/ae7384e027454770bea6d011e8d5d6c6 => generated 247 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:15.153879 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b8735-65fe-4739-b75a-029199a0e636 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:15.154428 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b8735-65fe-4739-b75a-029199a0e636 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:15.154428 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b8735-65fe-4739-b75a-029199a0e636 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:15.155796 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:15.161300 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7f59d-a17e-48e6-9aaf-ec6d51e636d6 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:15.161744 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7f59d-a17e-48e6-9aaf-ec6d51e636d6 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:15.161856 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7f59d-a17e-48e6-9aaf-ec6d51e636d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:15.180250 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-4bd7f59d-a17e-48e6-9aaf-ec6d51e636d6 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:15.181538 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-4bd7f59d-a17e-48e6-9aaf-ec6d51e636d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:15.196732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cc02b-40d1-4cd7-a12e-8998fb905afa None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:15.197015 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cc02b-40d1-4cd7-a12e-8998fb905afa None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:15.197297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cc02b-40d1-4cd7-a12e-8998fb905afa None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:15.198946 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:39:15.204264 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33de2f4-2f7f-4142-8199-57639ec7a5a8 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:15.204561 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33de2f4-2f7f-4142-8199-57639ec7a5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:15.204877 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33de2f4-2f7f-4142-8199-57639ec7a5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:15.245404 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG passlib.handlers.bcrypt [None req-b33de2f4-2f7f-4142-8199-57639ec7a5a8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80174) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 24 10:39:15.246030 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG passlib.handlers.bcrypt [None req-b33de2f4-2f7f-4142-8199-57639ec7a5a8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80174) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 24 10:39:15.271678 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:15.290958 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-b33de2f4-2f7f-4142-8199-57639ec7a5a8 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:15.292760 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b33de2f4-2f7f-4142-8199-57639ec7a5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:15.295327 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7f59d-a17e-48e6-9aaf-ec6d51e636d6 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:15.321860 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:15.396975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:15.404121 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7f59d-a17e-48e6-9aaf-ec6d51e636d6 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:15.419091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33de2f4-2f7f-4142-8199-57639ec7a5a8 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:15.439850 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4936c3-09e0-475b-b05d-d97ec14605c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:15.440678 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4936c3-09e0-475b-b05d-d97ec14605c2 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:15.440972 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4936c3-09e0-475b-b05d-d97ec14605c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:15.441255 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4936c3-09e0-475b-b05d-d97ec14605c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:15.455067 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4936c3-09e0-475b-b05d-d97ec14605c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:39:15.467949 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-8e4936c3-09e0-475b-b05d-d97ec14605c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:39:15.467949 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:15.467949 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:15.467949 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:15.467949 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:15.467949 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:15.467949 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:15.467949 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:15.467949 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:15.467949 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:15.467949 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:15.467949 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:15.467949 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:39:15.467949 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:39:15.467949 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:39:15.467949 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:39:15.468961 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:39:15.468961 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:39:15.468961 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:39:15.468961 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:39:15.468961 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:15.468961 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:15.468961 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:15.468961 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:15.468961 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:15.468961 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:15.468961 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:15.468961 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:15.468961 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:15.468961 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:15.468961 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:15.468961 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:15.469796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:15.469796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:15.469796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:15.469796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:15.469796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:39:15.469796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:39:15.469796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:39:15.469796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:39:15.469796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:39:15.469796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:39:15.469796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:39:15.469796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:39:15.469796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:39:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:39:15.476993 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4936c3-09e0-475b-b05d-d97ec14605c2 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:15.529253 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33de2f4-2f7f-4142-8199-57639ec7a5a8 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:15.531612 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:15.564230 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:15.568292 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b10942-d15a-45cf-adeb-e2359e321746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:15.569244 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b10942-d15a-45cf-adeb-e2359e321746 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:15.569535 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b10942-d15a-45cf-adeb-e2359e321746 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:15.569820 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b10942-d15a-45cf-adeb-e2359e321746 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:15.585603 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4936c3-09e0-475b-b05d-d97ec14605c2 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:15.622817 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14bbb89-a8a6-403c-9b2d-adfbee9d9a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:15.623561 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bbb89-a8a6-403c-9b2d-adfbee9d9a75 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:15.623853 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bbb89-a8a6-403c-9b2d-adfbee9d9a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:15.624134 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bbb89-a8a6-403c-9b2d-adfbee9d9a75 None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:15.624891 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14bbb89-a8a6-403c-9b2d-adfbee9d9a75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:15.625204 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14bbb89-a8a6-403c-9b2d-adfbee9d9a75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:15.626629 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14bbb89-a8a6-403c-9b2d-adfbee9d9a75 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:15.640731 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:39:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:39:15.642071 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b10942-d15a-45cf-adeb-e2359e321746 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:15.643667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b10942-d15a-45cf-adeb-e2359e321746 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:15.646406 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14bbb89-a8a6-403c-9b2d-adfbee9d9a75 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:15.752629 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14bbb89-a8a6-403c-9b2d-adfbee9d9a75 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:15.753742 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 8/16] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:39:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 10:39:15.759542 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b10942-d15a-45cf-adeb-e2359e321746 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:15.763655 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:15.791843 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3fdf34-6f8b-45f0-a62c-f9e2776c09bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:15.792842 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fdf34-6f8b-45f0-a62c-f9e2776c09bc None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:15.793123 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fdf34-6f8b-45f0-a62c-f9e2776c09bc None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:15.793408 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fdf34-6f8b-45f0-a62c-f9e2776c09bc None admin] PATH_INFO: `/v3/users/ae7384e027454770bea6d011e8d5d6c6` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:15.794648 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3fdf34-6f8b-45f0-a62c-f9e2776c09bc None admin] RBAC: Authorizing `identity:get_user(user_id=ae7384e027454770bea6d011e8d5d6c6)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:15.796147 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3fdf34-6f8b-45f0-a62c-f9e2776c09bc None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:15.797839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:39:15 2022] GET /identity/v3/users/ae7384e027454770bea6d011e8d5d6c6 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:15.803121 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3fdf34-6f8b-45f0-a62c-f9e2776c09bc None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:15.818581 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:15.867715 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b10942-d15a-45cf-adeb-e2359e321746 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:15.911290 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3fdf34-6f8b-45f0-a62c-f9e2776c09bc None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:15.911546 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3bc42-6cf9-4c19-b9a9-89940bface80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:15.912324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3bc42-6cf9-4c19-b9a9-89940bface80 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:15.912679 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3bc42-6cf9-4c19-b9a9-89940bface80 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:15.912881 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3bc42-6cf9-4c19-b9a9-89940bface80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:15.934698 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3bc42-6cf9-4c19-b9a9-89940bface80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:15.936246 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3bc42-6cf9-4c19-b9a9-89940bface80 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:15.956335 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22cade3-2550-4f6c-8f54-9bddec1bbf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:15.957169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cade3-2550-4f6c-8f54-9bddec1bbf63 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:15.957456 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cade3-2550-4f6c-8f54-9bddec1bbf63 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:15.957734 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cade3-2550-4f6c-8f54-9bddec1bbf63 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:15.958065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-77d3bc42-6cf9-4c19-b9a9-89940bface80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:39:15.958065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:15.958065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:15.958065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:15.958065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:15.958065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:15.958065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:15.958065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:15.958065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:15.958065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:15.958065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:15.958065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:15.958065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:39:15.958065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:39:15.958065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:39:15.958825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:39:15.958825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:15.958825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:15.958825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:15.958825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:15.958825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:15.958825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:15.958825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:15.958825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:15.958825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:15.958825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:15.958825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:15.958825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:15.958825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:15.958825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:15.958825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:15.958825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:15.959660 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:39:15.959660 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:39:15.959660 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:39:15.959660 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:39:15.959893 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22cade3-2550-4f6c-8f54-9bddec1bbf63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:15.959956 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 9/18] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:39:15.960544 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22cade3-2550-4f6c-8f54-9bddec1bbf63 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:15.962268 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 10/19] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:39:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:39:15.966104 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3bc42-6cf9-4c19-b9a9-89940bface80 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:15.968647 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22cade3-2550-4f6c-8f54-9bddec1bbf63 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:16.038689 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:16.057545 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:16.079614 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22cade3-2550-4f6c-8f54-9bddec1bbf63 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:16.087171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3bc42-6cf9-4c19-b9a9-89940bface80 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:16.117188 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44e261-0073-4b5e-afd2-93c90c82893e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:16.117858 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44e261-0073-4b5e-afd2-93c90c82893e None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:16.118301 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44e261-0073-4b5e-afd2-93c90c82893e None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:16.118682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44e261-0073-4b5e-afd2-93c90c82893e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:16.119575 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df44e261-0073-4b5e-afd2-93c90c82893e None admin] RBAC: Adding query filter params (role.id=4867b69c45554ce18e23167c05a02175, scope.domain.id=default, user.id=ae7384e027454770bea6d011e8d5d6c6) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:16.119879 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df44e261-0073-4b5e-afd2-93c90c82893e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:16.121379 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df44e261-0073-4b5e-afd2-93c90c82893e None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:16.125710 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ea51b-3605-4e67-bf2e-67e434b99ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:16.126383 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ea51b-3605-4e67-bf2e-67e434b99ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:16.126673 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ea51b-3605-4e67-bf2e-67e434b99ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:16.126973 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ea51b-3605-4e67-bf2e-67e434b99ef5 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:16.127776 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ea51b-3605-4e67-bf2e-67e434b99ef5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:16.128092 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ea51b-3605-4e67-bf2e-67e434b99ef5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:16.128578 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 11/20] 10.222.0.16 () {56 vars in 1322 bytes} [Fri Jun 24 10:39:15 2022] GET /identity/v3/role_assignments?user.id=ae7384e027454770bea6d011e8d5d6c6&scope.domain.id=default&role.id=4867b69c45554ce18e23167c05a02175 => generated 233 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:16.129545 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ea51b-3605-4e67-bf2e-67e434b99ef5 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:16.150325 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 10/21] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:18.595391 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9507f3-1fb5-4e6f-a852-3887930da198 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:18.596469 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9507f3-1fb5-4e6f-a852-3887930da198 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:18.597049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9507f3-1fb5-4e6f-a852-3887930da198 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:18.598893 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 12/22] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:18.604771 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91418007-ee08-4bcc-b345-b28d3a8f803b None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:18.605836 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91418007-ee08-4bcc-b345-b28d3a8f803b None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:18.606302 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91418007-ee08-4bcc-b345-b28d3a8f803b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:18.628253 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-91418007-ee08-4bcc-b345-b28d3a8f803b None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:18.629491 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-91418007-ee08-4bcc-b345-b28d3a8f803b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:18.665247 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7234b6-d300-41d8-b193-372819841217 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:18.665573 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7234b6-d300-41d8-b193-372819841217 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:18.665827 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7234b6-d300-41d8-b193-372819841217 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:18.667790 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 13/23] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:18.680865 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3da924-94ee-4ca1-8c12-359b36eb6290 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:18.681147 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3da924-94ee-4ca1-8c12-359b36eb6290 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:18.681435 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3da924-94ee-4ca1-8c12-359b36eb6290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:18.700265 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-6e3da924-94ee-4ca1-8c12-359b36eb6290 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:18.701984 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-6e3da924-94ee-4ca1-8c12-359b36eb6290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:18.738920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 11/24] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:18.774498 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91418007-ee08-4bcc-b345-b28d3a8f803b None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:18.846132 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 14/25] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:39:18.863571 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:18.886094 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3da924-94ee-4ca1-8c12-359b36eb6290 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:18.957347 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91418007-ee08-4bcc-b345-b28d3a8f803b None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:18.984280 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:18.999052 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688383d6-b854-4e3f-bcae-b111cad66bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:19.000003 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688383d6-b854-4e3f-bcae-b111cad66bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:19.000296 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688383d6-b854-4e3f-bcae-b111cad66bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:19.000576 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688383d6-b854-4e3f-bcae-b111cad66bc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:19.014712 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3da924-94ee-4ca1-8c12-359b36eb6290 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:19.015021 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688383d6-b854-4e3f-bcae-b111cad66bc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:19.016809 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688383d6-b854-4e3f-bcae-b111cad66bc7 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:19.041602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-688383d6-b854-4e3f-bcae-b111cad66bc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:39:19.041602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:19.041602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:19.041602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:19.041602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:19.041602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:19.041602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:19.041602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:19.041602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:19.041602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:19.041602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:19.041602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:19.041602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:39:19.041602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:39:19.041602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:39:19.042539 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:39:19.042539 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:19.042539 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:19.042539 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:19.042539 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:19.042539 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:19.042539 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:19.042539 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:19.042539 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:19.042539 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:19.042539 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:19.042539 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:19.042539 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:19.042539 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:19.042539 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:19.042539 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:19.042539 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:19.048386 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:39:19.048386 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:39:19.048386 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:39:19.048386 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:39:19.048386 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 12/26] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:39:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:39:19.048386 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b243d2-b954-4d9f-9f53-dfad79137494 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:19.048386 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b243d2-b954-4d9f-9f53-dfad79137494 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:19.048386 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b243d2-b954-4d9f-9f53-dfad79137494 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:19.048386 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:19.048858 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad726e-975a-4096-9273-53d5ad6031df None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:19.048858 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad726e-975a-4096-9273-53d5ad6031df None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:19.048858 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad726e-975a-4096-9273-53d5ad6031df None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:19.051344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 14/28] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:19.051344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad726e-975a-4096-9273-53d5ad6031df None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:19.068752 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c6584-f27d-402c-8a78-0dab47ee1803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:19.069817 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c6584-f27d-402c-8a78-0dab47ee1803 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:19.070286 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c6584-f27d-402c-8a78-0dab47ee1803 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:19.070572 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c6584-f27d-402c-8a78-0dab47ee1803 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:19.082082 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c6584-f27d-402c-8a78-0dab47ee1803 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:39:19.090169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-b26c6584-f27d-402c-8a78-0dab47ee1803 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:39:19.090169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:19.090169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:19.090169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:19.090169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:19.090169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:19.090169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:19.090169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:19.090169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:19.090169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:19.090169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:19.090169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:19.090169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:39:19.090169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:39:19.090169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:39:19.090169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:39:19.091037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:39:19.091037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:39:19.091037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:39:19.091037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:39:19.091037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:19.091037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:19.091037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:19.091037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:19.091037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:19.091037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:19.091037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:19.091037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:19.091037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:19.091037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:19.091037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:19.091037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:19.091815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:19.091815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:19.091815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:19.091815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:19.091815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:39:19.091815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:39:19.091815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:39:19.091815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:39:19.091815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:39:19.091815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:39:19.091815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:39:19.091815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:39:19.096805 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 15/29] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:39:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:39:19.098441 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc20448-5807-4732-9bc7-7d3c2e2439c5 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:19.098746 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc20448-5807-4732-9bc7-7d3c2e2439c5 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:19.099030 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc20448-5807-4732-9bc7-7d3c2e2439c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:19.116918 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-dfc20448-5807-4732-9bc7-7d3c2e2439c5 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:19.118261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-dfc20448-5807-4732-9bc7-7d3c2e2439c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:19.172837 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:19.178606 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad726e-975a-4096-9273-53d5ad6031df None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:19.200208 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 16/30] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:19.201694 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e88ec-5ffe-496a-b1ba-1030c73b596f None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:19.202039 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e88ec-5ffe-496a-b1ba-1030c73b596f None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:19.202329 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e88ec-5ffe-496a-b1ba-1030c73b596f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:19.217930 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19ef13-31a6-4ae5-b258-9e629d4f499d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:19.218909 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19ef13-31a6-4ae5-b258-9e629d4f499d None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:19.219471 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19ef13-31a6-4ae5-b258-9e629d4f499d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:19.219959 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19ef13-31a6-4ae5-b258-9e629d4f499d None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:19.220901 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19ef13-31a6-4ae5-b258-9e629d4f499d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:19.221417 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19ef13-31a6-4ae5-b258-9e629d4f499d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:19.223025 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19ef13-31a6-4ae5-b258-9e629d4f499d None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:19.232339 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-1d4e88ec-5ffe-496a-b1ba-1030c73b596f None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:19.233742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-1d4e88ec-5ffe-496a-b1ba-1030c73b596f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:19.238953 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 15/31] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:19.240250 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19ef13-31a6-4ae5-b258-9e629d4f499d None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:19.315814 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:19.327172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 17/32] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:19.335895 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e88ec-5ffe-496a-b1ba-1030c73b596f None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:19.377791 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19ef13-31a6-4ae5-b258-9e629d4f499d None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:19.421000 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfa19b-f931-4e4f-9977-34a8b0b4f0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:19.421916 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfa19b-f931-4e4f-9977-34a8b0b4f0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:19.422362 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfa19b-f931-4e4f-9977-34a8b0b4f0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:19.422650 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfa19b-f931-4e4f-9977-34a8b0b4f0c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:19.423460 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cfa19b-f931-4e4f-9977-34a8b0b4f0c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:19.423774 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cfa19b-f931-4e4f-9977-34a8b0b4f0c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:19.425173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cfa19b-f931-4e4f-9977-34a8b0b4f0c5 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:19.440581 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 16/33] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:39:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:19.443406 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfa19b-f931-4e4f-9977-34a8b0b4f0c5 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:19.469719 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:19.475602 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e88ec-5ffe-496a-b1ba-1030c73b596f None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:19.515930 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3515b-f6dc-4dd1-9c93-05519419d40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:19.516658 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3515b-f6dc-4dd1-9c93-05519419d40e None admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:19.516940 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3515b-f6dc-4dd1-9c93-05519419d40e None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:19.517233 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3515b-f6dc-4dd1-9c93-05519419d40e None admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:19.517964 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da3515b-f6dc-4dd1-9c93-05519419d40e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:19.519529 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da3515b-f6dc-4dd1-9c93-05519419d40e None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:19.565453 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfa19b-f931-4e4f-9977-34a8b0b4f0c5 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:19.609006 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc9b56-60db-489f-b32b-750b20fc5184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:19.609801 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc9b56-60db-489f-b32b-750b20fc5184 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:19.610107 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc9b56-60db-489f-b32b-750b20fc5184 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:19.610393 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc9b56-60db-489f-b32b-750b20fc5184 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:19.611229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc9b56-60db-489f-b32b-750b20fc5184 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:19.612662 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc9b56-60db-489f-b32b-750b20fc5184 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:19.670997 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 18/34] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jun 24 10:39:19 2022] POST /identity/v3/projects => generated 301 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:39:19.672895 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3515b-f6dc-4dd1-9c93-05519419d40e None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:19.780624 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:19.782607 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 17/35] 10.222.0.16 () {60 vars in 1131 bytes} [Fri Jun 24 10:39:19 2022] POST /identity/v3/roles => generated 225 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:39:19.784207 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc9b56-60db-489f-b32b-750b20fc5184 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:19.880480 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3515b-f6dc-4dd1-9c93-05519419d40e None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:19.955417 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed14c12-57eb-42d7-bdba-c07869219410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:19.956511 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed14c12-57eb-42d7-bdba-c07869219410 None admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:19.957023 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed14c12-57eb-42d7-bdba-c07869219410 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:19.957839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed14c12-57eb-42d7-bdba-c07869219410 None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:19.958839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed14c12-57eb-42d7-bdba-c07869219410 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:19.962777 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed14c12-57eb-42d7-bdba-c07869219410 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:19.970472 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:19.997132 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 19/36] 10.222.0.16 () {60 vars in 1131 bytes} [Fri Jun 24 10:39:19 2022] POST /identity/v3/roles => generated 219 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:39:19.998645 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226a49c-3f9b-4ac1-a38d-036e30d845e5 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:19.998932 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226a49c-3f9b-4ac1-a38d-036e30d845e5 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:19.999232 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226a49c-3f9b-4ac1-a38d-036e30d845e5 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:20.000477 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 20/37] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:20.003656 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc9b56-60db-489f-b32b-750b20fc5184 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:20.006232 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320d973-f82a-4c57-bbe0-59cd539f7d18 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:20.006527 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320d973-f82a-4c57-bbe0-59cd539f7d18 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:20.006820 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320d973-f82a-4c57-bbe0-59cd539f7d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:20.044423 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-6320d973-f82a-4c57-bbe0-59cd539f7d18 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:20.046083 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-6320d973-f82a-4c57-bbe0-59cd539f7d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:20.055649 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13763a6-ac0a-47d7-96d1-b942df95d314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:20.056966 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13763a6-ac0a-47d7-96d1-b942df95d314 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:20.057727 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13763a6-ac0a-47d7-96d1-b942df95d314 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:20.058327 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13763a6-ac0a-47d7-96d1-b942df95d314 None admin] PATH_INFO: `/v3/users/ae7384e027454770bea6d011e8d5d6c6` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:20.061051 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13763a6-ac0a-47d7-96d1-b942df95d314 None admin] RBAC: Authorizing `identity:get_user(user_id=ae7384e027454770bea6d011e8d5d6c6)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:20.064065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13763a6-ac0a-47d7-96d1-b942df95d314 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:20.066391 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 18/38] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:39:19 2022] GET /identity/v3/users/ae7384e027454770bea6d011e8d5d6c6 => generated 247 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:20.074374 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13763a6-ac0a-47d7-96d1-b942df95d314 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:20.171677 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 21/39] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:39:20.197304 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320d973-f82a-4c57-bbe0-59cd539f7d18 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:20.236706 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13763a6-ac0a-47d7-96d1-b942df95d314 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:20.252974 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:20.283937 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aeaf72-4ef4-4373-8bf6-7ade87168b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:20.285289 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aeaf72-4ef4-4373-8bf6-7ade87168b12 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:20.285584 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aeaf72-4ef4-4373-8bf6-7ade87168b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:20.286029 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aeaf72-4ef4-4373-8bf6-7ade87168b12 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:20.289071 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aeaf72-4ef4-4373-8bf6-7ade87168b12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:20.290624 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aeaf72-4ef4-4373-8bf6-7ade87168b12 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:20.292879 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 19/40] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:39:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:20.298267 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aeaf72-4ef4-4373-8bf6-7ade87168b12 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:20.325278 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:20.349938 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320d973-f82a-4c57-bbe0-59cd539f7d18 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:20.388226 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4dd8f-2fda-4601-ae67-8542ae64d377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:20.388925 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4dd8f-2fda-4601-ae67-8542ae64d377 None admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:20.389214 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4dd8f-2fda-4601-ae67-8542ae64d377 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:20.389502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4dd8f-2fda-4601-ae67-8542ae64d377 None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:20.390322 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4dd8f-2fda-4601-ae67-8542ae64d377 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:20.391718 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4dd8f-2fda-4601-ae67-8542ae64d377 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:20.404953 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 22/41] 10.222.0.16 () {60 vars in 1131 bytes} [Fri Jun 24 10:39:20 2022] POST /identity/v3/roles => generated 223 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:39:20.406441 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafd40a-bc86-4d15-a472-c32d4223db99 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:20.406741 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafd40a-bc86-4d15-a472-c32d4223db99 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:20.407028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafd40a-bc86-4d15-a472-c32d4223db99 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:20.408324 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 23/42] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:20.414093 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77dcb8-aade-47a8-b0b5-153be8f40e1c None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:20.414385 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77dcb8-aade-47a8-b0b5-153be8f40e1c None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:20.414702 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77dcb8-aade-47a8-b0b5-153be8f40e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:20.431555 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aeaf72-4ef4-4373-8bf6-7ade87168b12 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:20.433657 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-dc77dcb8-aade-47a8-b0b5-153be8f40e1c None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:20.435762 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-dc77dcb8-aade-47a8-b0b5-153be8f40e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:20.472827 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4323b-b254-493c-840d-ee941f03aaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:20.474019 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4323b-b254-493c-840d-ee941f03aaeb None admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:20.474483 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4323b-b254-493c-840d-ee941f03aaeb None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:20.474913 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4323b-b254-493c-840d-ee941f03aaeb None admin] PATH_INFO: `/v3/domains/default/users/ae7384e027454770bea6d011e8d5d6c6/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:20.477228 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4323b-b254-493c-840d-ee941f03aaeb None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ae7384e027454770bea6d011e8d5d6c6, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:20.478695 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4323b-b254-493c-840d-ee941f03aaeb None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:20.496457 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 20/43] 10.222.0.16 () {58 vars in 1361 bytes} [Fri Jun 24 10:39:20 2022] PUT /identity/v3/domains/default/users/ae7384e027454770bea6d011e8d5d6c6/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:39:20.635440 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 24/44] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:39:20.661127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4323b-b254-493c-840d-ee941f03aaeb None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:20.743938 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:20.769026 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4323b-b254-493c-840d-ee941f03aaeb None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:20.803217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc8424-f529-4a28-94df-133c220f6b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:20.804053 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc8424-f529-4a28-94df-133c220f6b4a None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:20.804338 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc8424-f529-4a28-94df-133c220f6b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:20.804617 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc8424-f529-4a28-94df-133c220f6b4a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:20.805841 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc8424-f529-4a28-94df-133c220f6b4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:20.807527 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc8424-f529-4a28-94df-133c220f6b4a None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:20.809331 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 21/45] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:39:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:20.815291 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77dcb8-aade-47a8-b0b5-153be8f40e1c None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:20.845283 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:20.918678 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77dcb8-aade-47a8-b0b5-153be8f40e1c None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:20.953778 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818e90a-03af-4839-a9e6-c82e9fe588fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:20.954453 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818e90a-03af-4839-a9e6-c82e9fe588fa None admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:20.954738 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818e90a-03af-4839-a9e6-c82e9fe588fa None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:20.955015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818e90a-03af-4839-a9e6-c82e9fe588fa None admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:20.955765 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818e90a-03af-4839-a9e6-c82e9fe588fa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:20.957230 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818e90a-03af-4839-a9e6-c82e9fe588fa None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:20.986208 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 25/46] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jun 24 10:39:20 2022] POST /identity/v3/projects => generated 312 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:39:22.612121 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194aefdb-4c1e-4536-b5f7-cfaeb91aa746 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:22.612671 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194aefdb-4c1e-4536-b5f7-cfaeb91aa746 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:22.612671 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194aefdb-4c1e-4536-b5f7-cfaeb91aa746 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:22.614019 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 22/47] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:22.619598 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a587b12-d043-4b67-8b9c-7b2067134a84 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:22.620577 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a587b12-d043-4b67-8b9c-7b2067134a84 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:22.620577 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a587b12-d043-4b67-8b9c-7b2067134a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:22.638524 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-9a587b12-d043-4b67-8b9c-7b2067134a84 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:22.639739 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-9a587b12-d043-4b67-8b9c-7b2067134a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:22.714175 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 26/48] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:22.737389 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194aefdb-4c1e-4536-b5f7-cfaeb91aa746 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:22.847643 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194aefdb-4c1e-4536-b5f7-cfaeb91aa746 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:22.882843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217397c-c376-4d98-bb7a-ca030572c303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:22.883577 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217397c-c376-4d98-bb7a-ca030572c303 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:22.883856 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217397c-c376-4d98-bb7a-ca030572c303 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:22.884129 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217397c-c376-4d98-bb7a-ca030572c303 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:22.896415 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217397c-c376-4d98-bb7a-ca030572c303 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:39:22.905166 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-2217397c-c376-4d98-bb7a-ca030572c303 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:39:22.905166 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:22.905166 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:22.905166 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:22.905166 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:22.905166 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:22.905166 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:22.905166 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:22.905166 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:22.905166 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:22.905166 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:22.905166 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:22.905166 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:39:22.905166 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:39:22.905166 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:39:22.905166 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:39:22.906032 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:39:22.906032 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:39:22.906032 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:39:22.906032 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:39:22.906032 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:22.906032 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:22.906032 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:22.906032 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:22.906032 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:22.906032 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:22.906032 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:22.906032 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:22.906032 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:22.906032 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:22.906032 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:22.906032 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:22.906782 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:22.906782 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:22.906782 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:22.906782 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:22.906782 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:39:22.906782 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:39:22.906782 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:39:22.906782 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:39:22.906782 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:39:22.906782 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:39:22.906782 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:39:22.906782 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:39:22.906782 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 23/49] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:39:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:39:22.912433 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a587b12-d043-4b67-8b9c-7b2067134a84 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:22.923070 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:23.007771 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27ad80-7c0c-4b7f-9ce9-2c4df89a4102 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:23.008021 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27ad80-7c0c-4b7f-9ce9-2c4df89a4102 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:23.008300 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27ad80-7c0c-4b7f-9ce9-2c4df89a4102 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:23.009725 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 24/50] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:23.014933 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b2e6d-f018-4309-9e68-c33ae9e5a2e8 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:23.015223 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b2e6d-f018-4309-9e68-c33ae9e5a2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:23.015522 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b2e6d-f018-4309-9e68-c33ae9e5a2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:23.020464 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a587b12-d043-4b67-8b9c-7b2067134a84 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:23.021927 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:23.033648 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-ab7b2e6d-f018-4309-9e68-c33ae9e5a2e8 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:23.035173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-ab7b2e6d-f018-4309-9e68-c33ae9e5a2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:23.055457 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180371df-c4ef-4d53-a293-7324f38d516d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:23.056151 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180371df-c4ef-4d53-a293-7324f38d516d None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:23.056461 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180371df-c4ef-4d53-a293-7324f38d516d None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:23.056748 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180371df-c4ef-4d53-a293-7324f38d516d None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:23.057622 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180371df-c4ef-4d53-a293-7324f38d516d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:23.057936 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180371df-c4ef-4d53-a293-7324f38d516d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:23.059362 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180371df-c4ef-4d53-a293-7324f38d516d None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:23.068084 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 27/51] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:39:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:23.073680 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180371df-c4ef-4d53-a293-7324f38d516d None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:23.107035 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 25/52] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:23.131098 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b2e6d-f018-4309-9e68-c33ae9e5a2e8 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:23.145174 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:23.178373 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180371df-c4ef-4d53-a293-7324f38d516d None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:23.217612 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23eb94-ac73-4864-8eb2-2b47dafa8ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:23.218516 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23eb94-ac73-4864-8eb2-2b47dafa8ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:23.218813 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23eb94-ac73-4864-8eb2-2b47dafa8ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:23.219085 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23eb94-ac73-4864-8eb2-2b47dafa8ac6 None admin] PATH_INFO: `/v3/users/ae7384e027454770bea6d011e8d5d6c6` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:23.220344 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23eb94-ac73-4864-8eb2-2b47dafa8ac6 None admin] RBAC: Authorizing `identity:get_user(user_id=ae7384e027454770bea6d011e8d5d6c6)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:23.221816 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23eb94-ac73-4864-8eb2-2b47dafa8ac6 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:23.223504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 28/53] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:39:23 2022] GET /identity/v3/users/ae7384e027454770bea6d011e8d5d6c6 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:39:23.229097 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23eb94-ac73-4864-8eb2-2b47dafa8ac6 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:23.239578 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b2e6d-f018-4309-9e68-c33ae9e5a2e8 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:23.278219 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6ec30-268e-49bc-9d1c-09e1144eaedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:23.278981 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6ec30-268e-49bc-9d1c-09e1144eaedf None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:23.279517 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6ec30-268e-49bc-9d1c-09e1144eaedf None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:23.279621 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6ec30-268e-49bc-9d1c-09e1144eaedf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:23.280891 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6ec30-268e-49bc-9d1c-09e1144eaedf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:23.282414 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6ec30-268e-49bc-9d1c-09e1144eaedf None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:23.284061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 26/54] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:39:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:23.289789 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6ec30-268e-49bc-9d1c-09e1144eaedf None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:23.293829 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:23.334048 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23eb94-ac73-4864-8eb2-2b47dafa8ac6 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:23.371093 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1869b-0377-4518-bf24-3822cfca53d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:23.371957 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1869b-0377-4518-bf24-3822cfca53d0 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:23.372244 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1869b-0377-4518-bf24-3822cfca53d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:23.372525 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1869b-0377-4518-bf24-3822cfca53d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:23.373791 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1869b-0377-4518-bf24-3822cfca53d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:23.375351 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1869b-0377-4518-bf24-3822cfca53d0 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:23.377080 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 29/55] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:39:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:39:23.383250 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1869b-0377-4518-bf24-3822cfca53d0 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:23.394191 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:23.493376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1869b-0377-4518-bf24-3822cfca53d0 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:23.514497 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6ec30-268e-49bc-9d1c-09e1144eaedf None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:23.527755 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b8aa4-bbce-4b20-9c9e-aeb592a5b10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:23.528536 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b8aa4-bbce-4b20-9c9e-aeb592a5b10e None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:23.528730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b8aa4-bbce-4b20-9c9e-aeb592a5b10e None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:23.529044 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b8aa4-bbce-4b20-9c9e-aeb592a5b10e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:23.529854 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b8aa4-bbce-4b20-9c9e-aeb592a5b10e None admin] RBAC: Adding query filter params (role.id=4867b69c45554ce18e23167c05a02175, scope.domain.id=default, user.id=ae7384e027454770bea6d011e8d5d6c6) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:23.530174 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b8aa4-bbce-4b20-9c9e-aeb592a5b10e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:23.531664 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b8aa4-bbce-4b20-9c9e-aeb592a5b10e None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:23.537635 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 30/56] 10.222.0.16 () {56 vars in 1322 bytes} [Fri Jun 24 10:39:23 2022] GET /identity/v3/role_assignments?user.id=ae7384e027454770bea6d011e8d5d6c6&scope.domain.id=default&role.id=4867b69c45554ce18e23167c05a02175 => generated 530 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:39:23.550287 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a043f3-dc7a-495e-9068-0caecc311a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:23.550993 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a043f3-dc7a-495e-9068-0caecc311a68 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:23.551319 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a043f3-dc7a-495e-9068-0caecc311a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:23.551601 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a043f3-dc7a-495e-9068-0caecc311a68 None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:23.552352 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a043f3-dc7a-495e-9068-0caecc311a68 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:23.553874 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a043f3-dc7a-495e-9068-0caecc311a68 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:23.584816 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 27/57] 10.222.0.16 () {60 vars in 1140 bytes} [Fri Jun 24 10:39:23 2022] POST /identity/v3/projects => generated 298 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:39:25.647607 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec01e1-5a7e-4e36-b31c-6dcc1297344f None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:25.648435 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec01e1-5a7e-4e36-b31c-6dcc1297344f None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:25.648570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec01e1-5a7e-4e36-b31c-6dcc1297344f None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:25.650670 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 31/58] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:25.656670 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb310d-a3a2-4abe-be43-b1f5c4b95188 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:25.656670 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb310d-a3a2-4abe-be43-b1f5c4b95188 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:25.657066 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb310d-a3a2-4abe-be43-b1f5c4b95188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:25.674946 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-20fb310d-a3a2-4abe-be43-b1f5c4b95188 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:25.676191 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-20fb310d-a3a2-4abe-be43-b1f5c4b95188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:25.729077 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:25.747724 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 28/59] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:25.772633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec01e1-5a7e-4e36-b31c-6dcc1297344f None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:25.854567 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:25.901525 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec01e1-5a7e-4e36-b31c-6dcc1297344f None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:25.939518 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1dfb1f-97eb-47e6-8318-57e5e30b1ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:25.940327 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1dfb1f-97eb-47e6-8318-57e5e30b1ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:25.940611 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1dfb1f-97eb-47e6-8318-57e5e30b1ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:25.940892 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1dfb1f-97eb-47e6-8318-57e5e30b1ae2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:25.942551 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1dfb1f-97eb-47e6-8318-57e5e30b1ae2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:25.944042 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1dfb1f-97eb-47e6-8318-57e5e30b1ae2 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:25.945666 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 32/60] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:39:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:25.952413 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb310d-a3a2-4abe-be43-b1f5c4b95188 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:26.073942 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb310d-a3a2-4abe-be43-b1f5c4b95188 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:26.116415 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa260b9c-7e91-4267-8449-6a47fb089413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:26.117083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa260b9c-7e91-4267-8449-6a47fb089413 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:26.117376 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa260b9c-7e91-4267-8449-6a47fb089413 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:26.117651 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa260b9c-7e91-4267-8449-6a47fb089413 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:26.118375 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa260b9c-7e91-4267-8449-6a47fb089413 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:26.119986 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa260b9c-7e91-4267-8449-6a47fb089413 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:26.148377 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 29/61] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 10:39:25 2022] POST /identity/v3/users => generated 275 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:39:29.375185 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d679608-351b-47f7-a454-3c60d8136124 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:29.376070 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d679608-351b-47f7-a454-3c60d8136124 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:29.376502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d679608-351b-47f7-a454-3c60d8136124 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:29.378026 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 33/62] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:29.388836 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeddf19-874b-4728-9493-beab01cd6861 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:29.389692 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeddf19-874b-4728-9493-beab01cd6861 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:29.390112 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeddf19-874b-4728-9493-beab01cd6861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:29.411542 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-1eeddf19-874b-4728-9493-beab01cd6861 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:29.412964 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1eeddf19-874b-4728-9493-beab01cd6861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:29.438287 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607808a8-d949-4efd-92ed-efc7362a7450 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:29.438942 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607808a8-d949-4efd-92ed-efc7362a7450 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:29.439496 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607808a8-d949-4efd-92ed-efc7362a7450 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:29.441059 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 34/63] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:29.447330 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c3403-717b-4818-b074-deb0d30b76d3 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:29.447934 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c3403-717b-4818-b074-deb0d30b76d3 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:29.448410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c3403-717b-4818-b074-deb0d30b76d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:29.472298 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:29.473815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-c37c3403-717b-4818-b074-deb0d30b76d3 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:29.480989 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-c37c3403-717b-4818-b074-deb0d30b76d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:29.533518 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 30/64] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:39:29.535436 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4e60b-4589-43b3-ac07-b52d17184271 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:29.535969 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4e60b-4589-43b3-ac07-b52d17184271 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:29.536437 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4e60b-4589-43b3-ac07-b52d17184271 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:29.537925 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 31/65] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:29.543601 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12c834-bda6-417d-8a05-52b3b786fd1d None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:29.544161 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12c834-bda6-417d-8a05-52b3b786fd1d None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:29.544511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12c834-bda6-417d-8a05-52b3b786fd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:29.566879 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-8f12c834-bda6-417d-8a05-52b3b786fd1d None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:29.568141 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-8f12c834-bda6-417d-8a05-52b3b786fd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:29.580307 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 35/66] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:39:29.581470 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c3403-717b-4818-b074-deb0d30b76d3 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:29.660061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 32/67] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:39:29.660913 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12c834-bda6-417d-8a05-52b3b786fd1d None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:29.675560 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:29.723692 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c3403-717b-4818-b074-deb0d30b76d3 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:29.770264 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060322e8-d33a-4f5b-947e-a56a30342d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:29.771087 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060322e8-d33a-4f5b-947e-a56a30342d00 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:29.771403 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060322e8-d33a-4f5b-947e-a56a30342d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:29.771680 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060322e8-d33a-4f5b-947e-a56a30342d00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:29.792981 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060322e8-d33a-4f5b-947e-a56a30342d00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:39:29.801363 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:29.804426 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-060322e8-d33a-4f5b-947e-a56a30342d00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:39:29.804426 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:29.804426 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:29.804426 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:29.804426 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:29.804426 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:29.804426 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:29.804426 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:29.804426 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:29.804426 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:29.804426 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:29.804426 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:29.804426 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:39:29.804426 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:39:29.804426 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:39:29.804426 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:39:29.805261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:39:29.805261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:39:29.805261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:39:29.805261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:39:29.805261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:29.805261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:29.805261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:29.805261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:29.805261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:29.805261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:29.805261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:29.805261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:29.805261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:29.805261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:29.805261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:29.805261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:29.811743 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:29.811743 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:29.811743 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:29.811743 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:29.811743 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:39:29.811743 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:39:29.811743 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:39:29.811743 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:39:29.811743 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:39:29.811743 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:39:29.811743 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:39:29.811743 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:39:29.811743 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 36/68] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:39:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:39:29.811743 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060322e8-d33a-4f5b-947e-a56a30342d00 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:29.812449 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12c834-bda6-417d-8a05-52b3b786fd1d None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:29.857846 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92477a51-4a91-4216-ba1e-7cd84df4c7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:29.859068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92477a51-4a91-4216-ba1e-7cd84df4c7c6 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:29.859600 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92477a51-4a91-4216-ba1e-7cd84df4c7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:29.860076 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92477a51-4a91-4216-ba1e-7cd84df4c7c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:29.873748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92477a51-4a91-4216-ba1e-7cd84df4c7c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:39:29.882807 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-92477a51-4a91-4216-ba1e-7cd84df4c7c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:39:29.882807 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:29.882807 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:29.882807 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:29.882807 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:29.882807 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:29.882807 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:29.882807 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:29.882807 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:29.882807 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:29.882807 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:29.882807 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:29.882807 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:39:29.882807 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:39:29.882807 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:39:29.882807 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:39:29.883724 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:39:29.883724 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:39:29.883724 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:39:29.883724 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:39:29.883724 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:29.883724 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:29.883724 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:29.883724 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:29.883724 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:29.883724 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:29.883724 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:29.883724 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:29.883724 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:29.883724 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:29.883724 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:29.883724 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:29.884473 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:29.884473 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:29.884473 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:29.884473 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:29.884473 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:39:29.884473 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:39:29.884473 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:39:29.884473 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:39:29.884473 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:39:29.884473 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:39:29.884473 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:39:29.884473 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:39:29.888504 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 33/69] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 10:39:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:39:29.889550 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92477a51-4a91-4216-ba1e-7cd84df4c7c6 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:29.937574 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060322e8-d33a-4f5b-947e-a56a30342d00 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:29.973266 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:29.982735 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d6ce0-8918-48e6-92d5-4305d9a59139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:29.984267 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d6ce0-8918-48e6-92d5-4305d9a59139 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:29.984724 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d6ce0-8918-48e6-92d5-4305d9a59139 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:29.985055 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d6ce0-8918-48e6-92d5-4305d9a59139 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:29.998926 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d6ce0-8918-48e6-92d5-4305d9a59139 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:39:30.006752 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-d77d6ce0-8918-48e6-92d5-4305d9a59139 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:39:30.006752 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:30.006752 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:30.006752 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:30.006752 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:30.006752 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:30.006752 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:30.006752 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:30.006752 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:30.006752 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:30.006752 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:30.006752 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:30.006752 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:39:30.006752 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:39:30.006752 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:39:30.006752 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:39:30.007797 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:39:30.007797 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:39:30.007797 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:39:30.007797 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:39:30.007797 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:30.007797 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:30.007797 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:30.007797 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:30.007797 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:30.007797 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:30.007797 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:30.007797 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:30.007797 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:30.007797 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:30.007797 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:30.007797 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:30.008550 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:30.008550 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:30.008550 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:30.008550 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:30.008550 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:39:30.008550 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:39:30.008550 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:39:30.008550 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:39:30.008550 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:39:30.008550 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:39:30.008550 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:39:30.008550 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:39:30.009196 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92477a51-4a91-4216-ba1e-7cd84df4c7c6 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:30.009268 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 37/70] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:39:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:39:30.009268 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d6ce0-8918-48e6-92d5-4305d9a59139 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:30.045547 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e75a79-d169-418b-955d-52df39f0ff2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:30.046234 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e75a79-d169-418b-955d-52df39f0ff2d None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:30.046528 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e75a79-d169-418b-955d-52df39f0ff2d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:30.046812 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e75a79-d169-418b-955d-52df39f0ff2d None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:30.047613 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e75a79-d169-418b-955d-52df39f0ff2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:30.047929 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e75a79-d169-418b-955d-52df39f0ff2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:30.049338 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e75a79-d169-418b-955d-52df39f0ff2d None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:30.058168 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 34/71] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:39:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:30.059495 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d8ea4-d81b-4708-b9c6-6664e8d533bf None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:30.059794 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d8ea4-d81b-4708-b9c6-6664e8d533bf None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:30.060080 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d8ea4-d81b-4708-b9c6-6664e8d533bf None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:30.063468 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 35/72] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:30.063468 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba88340-5167-400c-b75f-54512945e292 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:30.063468 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba88340-5167-400c-b75f-54512945e292 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:30.063468 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba88340-5167-400c-b75f-54512945e292 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:30.064557 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 36/73] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:30.065261 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba88340-5167-400c-b75f-54512945e292 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:30.093508 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:30.117381 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d6ce0-8918-48e6-92d5-4305d9a59139 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:30.151513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432544c-fd51-4c42-bef6-ebaed445af68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:30.152199 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432544c-fd51-4c42-bef6-ebaed445af68 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:30.152487 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432544c-fd51-4c42-bef6-ebaed445af68 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:30.152762 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432544c-fd51-4c42-bef6-ebaed445af68 None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:30.153517 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432544c-fd51-4c42-bef6-ebaed445af68 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:30.153823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432544c-fd51-4c42-bef6-ebaed445af68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:30.155245 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432544c-fd51-4c42-bef6-ebaed445af68 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:30.163257 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 38/74] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:39:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:30.164059 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432544c-fd51-4c42-bef6-ebaed445af68 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:30.180061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba88340-5167-400c-b75f-54512945e292 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:30.215670 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a56ca-f22c-4905-851c-ed785b348b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:30.216249 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a56ca-f22c-4905-851c-ed785b348b91 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:30.216534 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a56ca-f22c-4905-851c-ed785b348b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:30.216804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a56ca-f22c-4905-851c-ed785b348b91 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:30.217187 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:30.218051 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a56ca-f22c-4905-851c-ed785b348b91 None admin] RBAC: Adding query filter params (name=member) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:30.218255 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a56ca-f22c-4905-851c-ed785b348b91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:30.219671 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a56ca-f22c-4905-851c-ed785b348b91 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:30.228643 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 37/75] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 10:39:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:30.233516 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177a374-a116-49d4-86c2-532609a4b111 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:30.233516 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177a374-a116-49d4-86c2-532609a4b111 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:30.233516 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177a374-a116-49d4-86c2-532609a4b111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:30.246507 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-f177a374-a116-49d4-86c2-532609a4b111 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:30.247705 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-f177a374-a116-49d4-86c2-532609a4b111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:30.270720 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432544c-fd51-4c42-bef6-ebaed445af68 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:30.304967 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf63687-fdd6-4440-8a85-2150bd7b3ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:30.305868 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf63687-fdd6-4440-8a85-2150bd7b3ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:30.306158 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf63687-fdd6-4440-8a85-2150bd7b3ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:30.306441 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf63687-fdd6-4440-8a85-2150bd7b3ca6 None admin] PATH_INFO: `/v3/users/ae7384e027454770bea6d011e8d5d6c6` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:30.307817 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf63687-fdd6-4440-8a85-2150bd7b3ca6 None admin] RBAC: Authorizing `identity:get_user(user_id=ae7384e027454770bea6d011e8d5d6c6)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:30.309328 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf63687-fdd6-4440-8a85-2150bd7b3ca6 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:30.310974 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 39/76] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:39:30 2022] GET /identity/v3/users/ae7384e027454770bea6d011e8d5d6c6 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:30.312159 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8fe47-7eb0-4381-a69d-73a542b9c081 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:30.312454 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8fe47-7eb0-4381-a69d-73a542b9c081 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:30.312738 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8fe47-7eb0-4381-a69d-73a542b9c081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:30.319104 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 38/77] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:30.319985 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177a374-a116-49d4-86c2-532609a4b111 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:30.334565 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-d4f8fe47-7eb0-4381-a69d-73a542b9c081 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:30.335812 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-d4f8fe47-7eb0-4381-a69d-73a542b9c081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:30.337533 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:30.405003 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 40/78] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:30.406009 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8fe47-7eb0-4381-a69d-73a542b9c081 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:30.446399 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177a374-a116-49d4-86c2-532609a4b111 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:30.460838 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:30.483200 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a0b69-c1d5-4fb7-bdf2-865558192a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:30.484023 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a0b69-c1d5-4fb7-bdf2-865558192a65 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:30.484302 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a0b69-c1d5-4fb7-bdf2-865558192a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:30.484581 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a0b69-c1d5-4fb7-bdf2-865558192a65 None admin] PATH_INFO: `/v3/users/b5108aa3ec1f4fa59fb30f4446107485` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:30.500364 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a0b69-c1d5-4fb7-bdf2-865558192a65 None admin] RBAC: Authorizing `identity:get_user(user_id=b5108aa3ec1f4fa59fb30f4446107485)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:30.501840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a0b69-c1d5-4fb7-bdf2-865558192a65 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:30.503593 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 39/79] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:39:30 2022] GET /identity/v3/users/b5108aa3ec1f4fa59fb30f4446107485 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:30.508313 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a0b69-c1d5-4fb7-bdf2-865558192a65 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:30.517299 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8fe47-7eb0-4381-a69d-73a542b9c081 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:30.551813 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e00f0-9c72-431d-b0af-3f6c7a87bc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:30.552777 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e00f0-9c72-431d-b0af-3f6c7a87bc1d None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:30.552991 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e00f0-9c72-431d-b0af-3f6c7a87bc1d None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:30.553272 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e00f0-9c72-431d-b0af-3f6c7a87bc1d None admin] PATH_INFO: `/v3/users/b5108aa3ec1f4fa59fb30f4446107485` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:30.554474 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e00f0-9c72-431d-b0af-3f6c7a87bc1d None admin] RBAC: Authorizing `identity:get_user(user_id=b5108aa3ec1f4fa59fb30f4446107485)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:30.555979 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e00f0-9c72-431d-b0af-3f6c7a87bc1d None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:30.557781 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 41/80] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:39:30 2022] GET /identity/v3/users/b5108aa3ec1f4fa59fb30f4446107485 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:30.558558 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e00f0-9c72-431d-b0af-3f6c7a87bc1d None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:30.580983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:30.613153 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a0b69-c1d5-4fb7-bdf2-865558192a65 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:30.647183 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44062262-316f-48fe-b96d-255fca8dfedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:30.647790 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44062262-316f-48fe-b96d-255fca8dfedc None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:30.648070 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44062262-316f-48fe-b96d-255fca8dfedc None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:30.648359 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44062262-316f-48fe-b96d-255fca8dfedc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:30.667810 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e00f0-9c72-431d-b0af-3f6c7a87bc1d None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:30.688083 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:30.707032 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bb359-fca9-4b0e-ab7b-65c740cd8da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:30.707891 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bb359-fca9-4b0e-ab7b-65c740cd8da5 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:30.708182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bb359-fca9-4b0e-ab7b-65c740cd8da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:30.708486 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bb359-fca9-4b0e-ab7b-65c740cd8da5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:30.719089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bb359-fca9-4b0e-ab7b-65c740cd8da5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:39:30.720176 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44062262-316f-48fe-b96d-255fca8dfedc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:30.721680 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44062262-316f-48fe-b96d-255fca8dfedc None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:30.726730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-e74bb359-fca9-4b0e-ab7b-65c740cd8da5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:39:30.726730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:30.726730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:30.726730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:30.726730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:30.726730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:30.726730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:30.726730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:30.726730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:30.726730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:30.726730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:30.726730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:30.726730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:39:30.726730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:39:30.726730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:39:30.726730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:39:30.727773 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:39:30.727773 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:39:30.727773 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:39:30.727773 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:39:30.727773 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:30.727773 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:30.727773 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:30.727773 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:30.727773 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:30.727773 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:30.727773 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:30.727773 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:30.727773 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:30.727773 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:30.727773 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:30.727773 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:30.728583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:30.728583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:30.728583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:30.728583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:30.728583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:39:30.728583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:39:30.728583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:39:30.728583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:39:30.728583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:39:30.728583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:39:30.728583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:39:30.728583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:39:30.728583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 42/81] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:39:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:39:30.729225 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bb359-fca9-4b0e-ab7b-65c740cd8da5 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:30.795095 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:30.827983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 40/82] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:39:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:30.828845 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44062262-316f-48fe-b96d-255fca8dfedc None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:30.831384 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bb359-fca9-4b0e-ab7b-65c740cd8da5 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:30.868776 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d745b-a93a-483f-a24c-8a6aabde582d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:30.869641 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d745b-a93a-483f-a24c-8a6aabde582d None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:30.869973 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d745b-a93a-483f-a24c-8a6aabde582d None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:30.870343 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d745b-a93a-483f-a24c-8a6aabde582d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:30.871678 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d745b-a93a-483f-a24c-8a6aabde582d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:30.873160 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d745b-a93a-483f-a24c-8a6aabde582d None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:30.874799 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 43/83] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:39:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:30.875599 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d745b-a93a-483f-a24c-8a6aabde582d None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:30.924438 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:30.935816 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44062262-316f-48fe-b96d-255fca8dfedc None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:30.972130 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba5e86-8e07-4a69-b7d3-41f0813e25c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:30.972817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba5e86-8e07-4a69-b7d3-41f0813e25c9 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:30.973111 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba5e86-8e07-4a69-b7d3-41f0813e25c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:30.973397 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba5e86-8e07-4a69-b7d3-41f0813e25c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:30.979339 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d745b-a93a-483f-a24c-8a6aabde582d None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:31.014728 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa983b4-7202-4d7e-8152-aa4c820c4a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:31.015428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa983b4-7202-4d7e-8152-aa4c820c4a75 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:31.015721 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa983b4-7202-4d7e-8152-aa4c820c4a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:31.016004 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa983b4-7202-4d7e-8152-aa4c820c4a75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:31.016820 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:31.045322 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba5e86-8e07-4a69-b7d3-41f0813e25c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:31.046730 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba5e86-8e07-4a69-b7d3-41f0813e25c9 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:31.086986 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa983b4-7202-4d7e-8152-aa4c820c4a75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:31.089028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa983b4-7202-4d7e-8152-aa4c820c4a75 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:31.134098 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:31.147852 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 41/84] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:39:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:31.148727 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba5e86-8e07-4a69-b7d3-41f0813e25c9 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:31.190970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 44/85] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:39:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:31.192239 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa983b4-7202-4d7e-8152-aa4c820c4a75 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:31.221037 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:31.252522 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba5e86-8e07-4a69-b7d3-41f0813e25c9 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:31.287796 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ab7ca-f05a-4fe0-86cc-5ffddcf14bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:31.288490 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ab7ca-f05a-4fe0-86cc-5ffddcf14bcd None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:31.288785 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ab7ca-f05a-4fe0-86cc-5ffddcf14bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:31.289071 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ab7ca-f05a-4fe0-86cc-5ffddcf14bcd None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:31.289835 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ab7ca-f05a-4fe0-86cc-5ffddcf14bcd None admin] RBAC: Adding query filter params (name=member) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:31.290152 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ab7ca-f05a-4fe0-86cc-5ffddcf14bcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:31.291283 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa983b4-7202-4d7e-8152-aa4c820c4a75 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:31.291629 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ab7ca-f05a-4fe0-86cc-5ffddcf14bcd None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:31.300529 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 42/86] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 10:39:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:31.301848 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ab7ca-f05a-4fe0-86cc-5ffddcf14bcd None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:31.326100 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a74e8-f9ef-42a2-af9d-de2dd0cd3ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:31.326986 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a74e8-f9ef-42a2-af9d-de2dd0cd3ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:31.327308 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a74e8-f9ef-42a2-af9d-de2dd0cd3ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:31.327583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a74e8-f9ef-42a2-af9d-de2dd0cd3ea0 None admin] PATH_INFO: `/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:31.328777 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a74e8-f9ef-42a2-af9d-de2dd0cd3ea0 None admin] RBAC: Authorizing `identity:get_project(project_id=2ac825c0a6b546859d4dafd68f22a7ca)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:31.330232 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a74e8-f9ef-42a2-af9d-de2dd0cd3ea0 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:31.336810 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 45/87] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:39:31 2022] GET /identity/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:31.336810 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a74e8-f9ef-42a2-af9d-de2dd0cd3ea0 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:31.347353 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:31.411339 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ab7ca-f05a-4fe0-86cc-5ffddcf14bcd None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:31.433763 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a74e8-f9ef-42a2-af9d-de2dd0cd3ea0 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:31.445614 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0981c-6095-48a6-9f74-e3dc330c1a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:31.446298 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0981c-6095-48a6-9f74-e3dc330c1a7c None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:31.446589 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0981c-6095-48a6-9f74-e3dc330c1a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:31.447064 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0981c-6095-48a6-9f74-e3dc330c1a7c None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:31.447652 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0981c-6095-48a6-9f74-e3dc330c1a7c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:31.449260 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0981c-6095-48a6-9f74-e3dc330c1a7c None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:31.456001 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:31.468266 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f52287-5597-4f0e-8493-8eebb76ce18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:31.469168 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f52287-5597-4f0e-8493-8eebb76ce18f None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:31.469447 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f52287-5597-4f0e-8493-8eebb76ce18f None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:31.469735 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f52287-5597-4f0e-8493-8eebb76ce18f None admin] PATH_INFO: `/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:31.470931 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f52287-5597-4f0e-8493-8eebb76ce18f None admin] RBAC: Authorizing `identity:get_project(project_id=2ac825c0a6b546859d4dafd68f22a7ca)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:31.471452 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 43/88] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 10:39:31 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:39:31.472272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0981c-6095-48a6-9f74-e3dc330c1a7c None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:31.472609 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f52287-5597-4f0e-8493-8eebb76ce18f None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:31.479728 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 46/89] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:39:31 2022] GET /identity/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:31.479728 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f52287-5597-4f0e-8493-8eebb76ce18f None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:31.578020 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:31.595539 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0981c-6095-48a6-9f74-e3dc330c1a7c None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:31.599868 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f52287-5597-4f0e-8493-8eebb76ce18f None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:31.639081 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3a996-1f29-4ed4-b18e-065d53212556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:31.639906 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a8087-f04d-4b26-bff5-ca7bb4cad9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:31.640322 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3a996-1f29-4ed4-b18e-065d53212556 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:31.640562 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a8087-f04d-4b26-bff5-ca7bb4cad9e2 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:31.640664 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3a996-1f29-4ed4-b18e-065d53212556 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:31.640872 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a8087-f04d-4b26-bff5-ca7bb4cad9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:31.640994 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3a996-1f29-4ed4-b18e-065d53212556 None admin] PATH_INFO: `/v3/users/b5108aa3ec1f4fa59fb30f4446107485` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:31.641161 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a8087-f04d-4b26-bff5-ca7bb4cad9e2 None admin] PATH_INFO: `/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:31.642395 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3a996-1f29-4ed4-b18e-065d53212556 None admin] RBAC: Authorizing `identity:get_user(user_id=b5108aa3ec1f4fa59fb30f4446107485)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:31.642495 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a8087-f04d-4b26-bff5-ca7bb4cad9e2 None admin] RBAC: Authorizing `identity:get_project(project_id=2ac825c0a6b546859d4dafd68f22a7ca)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:31.643630 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3a996-1f29-4ed4-b18e-065d53212556 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:31.643842 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a8087-f04d-4b26-bff5-ca7bb4cad9e2 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:31.645447 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 47/90] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:39:31 2022] GET /identity/v3/users/b5108aa3ec1f4fa59fb30f4446107485 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:31.650145 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 44/91] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:39:31 2022] GET /identity/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:31.650279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3a996-1f29-4ed4-b18e-065d53212556 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:31.650353 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a8087-f04d-4b26-bff5-ca7bb4cad9e2 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:31.723259 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:31.778745 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a8087-f04d-4b26-bff5-ca7bb4cad9e2 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:31.783041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3a996-1f29-4ed4-b18e-065d53212556 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:31.819827 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f02e7-714e-4678-8c5f-d363e3d6dbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:31.820408 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f02e7-714e-4678-8c5f-d363e3d6dbaf None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:31.820697 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f02e7-714e-4678-8c5f-d363e3d6dbaf None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:31.820982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f02e7-714e-4678-8c5f-d363e3d6dbaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:31.821832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f02e7-714e-4678-8c5f-d363e3d6dbaf None admin] RBAC: Adding query filter params (role.id=19b4d737ab92430caeb4cd548049bcfc, scope.project.id=2ac825c0a6b546859d4dafd68f22a7ca, user.id=b5108aa3ec1f4fa59fb30f4446107485) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:31.822218 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f02e7-714e-4678-8c5f-d363e3d6dbaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:31.823846 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f02e7-714e-4678-8c5f-d363e3d6dbaf None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:31.830107 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658bca5-2885-41d4-98cf-3281984a3933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:31.831052 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658bca5-2885-41d4-98cf-3281984a3933 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:31.831600 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658bca5-2885-41d4-98cf-3281984a3933 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:31.832055 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658bca5-2885-41d4-98cf-3281984a3933 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:31.833071 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658bca5-2885-41d4-98cf-3281984a3933 None admin] RBAC: Adding query filter params (role.id=4867b69c45554ce18e23167c05a02175, scope.project.id=2ac825c0a6b546859d4dafd68f22a7ca, user.id=ae7384e027454770bea6d011e8d5d6c6) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:31.833384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 45/92] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:39:31 2022] GET /identity/v3/role_assignments?user.id=b5108aa3ec1f4fa59fb30f4446107485&scope.project.id=2ac825c0a6b546859d4dafd68f22a7ca&role.id=19b4d737ab92430caeb4cd548049bcfc => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:31.833758 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658bca5-2885-41d4-98cf-3281984a3933 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:31.834244 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f02e7-714e-4678-8c5f-d363e3d6dbaf None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:31.835777 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658bca5-2885-41d4-98cf-3281984a3933 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:31.857125 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 48/93] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:39:31 2022] GET /identity/v3/role_assignments?user.id=ae7384e027454770bea6d011e8d5d6c6&scope.project.id=2ac825c0a6b546859d4dafd68f22a7ca&role.id=4867b69c45554ce18e23167c05a02175 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:31.858307 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658bca5-2885-41d4-98cf-3281984a3933 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:31.887180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:31.961245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f02e7-714e-4678-8c5f-d363e3d6dbaf None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:31.989047 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:32.003323 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54cc131-efae-4607-b2e9-dad308e67d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:32.004009 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cc131-efae-4607-b2e9-dad308e67d06 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:32.004299 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cc131-efae-4607-b2e9-dad308e67d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:32.004580 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cc131-efae-4607-b2e9-dad308e67d06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:32.084905 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54cc131-efae-4607-b2e9-dad308e67d06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:32.086332 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54cc131-efae-4607-b2e9-dad308e67d06 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:32.110951 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658bca5-2885-41d4-98cf-3281984a3933 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:32.157442 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f785d-1f79-4859-828b-894a784194ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:32.158460 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f785d-1f79-4859-828b-894a784194ab None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:32.158923 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f785d-1f79-4859-828b-894a784194ab None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:32.159436 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f785d-1f79-4859-828b-894a784194ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:32.160491 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f785d-1f79-4859-828b-894a784194ab None admin] RBAC: Adding query filter params (role.id=4827ddfe1a0e476294ecf7f1d122cc32, scope.project.id=2ac825c0a6b546859d4dafd68f22a7ca, user.id=b5108aa3ec1f4fa59fb30f4446107485) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:32.161003 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f785d-1f79-4859-828b-894a784194ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:32.163410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f785d-1f79-4859-828b-894a784194ab None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:32.177226 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 49/94] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:39:31 2022] GET /identity/v3/role_assignments?user.id=b5108aa3ec1f4fa59fb30f4446107485&scope.project.id=2ac825c0a6b546859d4dafd68f22a7ca&role.id=4827ddfe1a0e476294ecf7f1d122cc32 => generated 259 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:32.209278 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 46/95] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:39:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:32.215481 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f785d-1f79-4859-828b-894a784194ab None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:32.351208 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:32.384771 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f785d-1f79-4859-828b-894a784194ab None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:32.426122 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c0840-28d0-4a78-ac93-ad753134b16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:32.427029 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c0840-28d0-4a78-ac93-ad753134b16f None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:32.427354 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c0840-28d0-4a78-ac93-ad753134b16f None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:32.427649 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c0840-28d0-4a78-ac93-ad753134b16f None admin] PATH_INFO: `/v3/projects/f0f1591696ee4f588f3c1040938dc83b` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:32.428933 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c0840-28d0-4a78-ac93-ad753134b16f None admin] RBAC: Authorizing `identity:get_project(project_id=f0f1591696ee4f588f3c1040938dc83b)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:32.430403 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c0840-28d0-4a78-ac93-ad753134b16f None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:32.432359 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 50/96] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:39:32 2022] GET /identity/v3/projects/f0f1591696ee4f588f3c1040938dc83b => generated 312 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:32.438610 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54cc131-efae-4607-b2e9-dad308e67d06 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:32.471295 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:32.567293 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54cc131-efae-4607-b2e9-dad308e67d06 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:32.611479 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a2068-81ae-4638-b854-b20cd22a0682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:32.612071 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a2068-81ae-4638-b854-b20cd22a0682 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:32.612362 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a2068-81ae-4638-b854-b20cd22a0682 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:32.612649 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a2068-81ae-4638-b854-b20cd22a0682 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:32.613503 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a2068-81ae-4638-b854-b20cd22a0682 None admin] RBAC: Adding query filter params (role.id=4827ddfe1a0e476294ecf7f1d122cc32, scope.project.id=f0f1591696ee4f588f3c1040938dc83b, user.id=b5108aa3ec1f4fa59fb30f4446107485) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:32.613824 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a2068-81ae-4638-b854-b20cd22a0682 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:32.615337 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a2068-81ae-4638-b854-b20cd22a0682 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:32.621843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 47/97] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:39:32 2022] GET /identity/v3/role_assignments?user.id=b5108aa3ec1f4fa59fb30f4446107485&scope.project.id=f0f1591696ee4f588f3c1040938dc83b&role.id=4827ddfe1a0e476294ecf7f1d122cc32 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:34.233328 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1b328-36a7-4493-98be-9056e671a8ec None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:34.233885 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1b328-36a7-4493-98be-9056e671a8ec None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:34.233885 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1b328-36a7-4493-98be-9056e671a8ec None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:34.235284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 51/98] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:34.240855 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cba4c-0a70-45ba-b9ff-badf510cb74b None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:34.241354 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cba4c-0a70-45ba-b9ff-badf510cb74b None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:34.241440 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cba4c-0a70-45ba-b9ff-badf510cb74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:34.268470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-ce4cba4c-0a70-45ba-b9ff-badf510cb74b None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:34.269687 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-ce4cba4c-0a70-45ba-b9ff-badf510cb74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:34.353149 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 48/99] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:34.392899 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1b328-36a7-4493-98be-9056e671a8ec None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:34.543583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1b328-36a7-4493-98be-9056e671a8ec None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:34.595976 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483dd03-736e-4891-b88e-a53f9aff7296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:34.596817 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483dd03-736e-4891-b88e-a53f9aff7296 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:34.597109 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483dd03-736e-4891-b88e-a53f9aff7296 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:34.597395 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483dd03-736e-4891-b88e-a53f9aff7296 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:34.620244 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d483dd03-736e-4891-b88e-a53f9aff7296 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:39:34.628376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-d483dd03-736e-4891-b88e-a53f9aff7296 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:39:34.628376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:34.628376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:34.628376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:34.628376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:34.628376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:34.628376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:34.628376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:34.628376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:34.628376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:34.628376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:34.628376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:34.628376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:39:34.628376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:39:34.628376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:39:34.628376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:39:34.629296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:39:34.629296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:39:34.629296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:39:34.629296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:39:34.629296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:34.629296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:34.629296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:34.629296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:34.629296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:34.629296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:34.629296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:34.629296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:34.629296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:34.629296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:34.629296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:34.629296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:34.630120 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:34.630120 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:34.630120 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:34.630120 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:34.630120 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:39:34.630120 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:39:34.630120 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:39:34.630120 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:39:34.630120 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:39:34.630120 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:39:34.630120 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:39:34.630120 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:39:34.630120 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 52/100] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:39:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:39:34.636217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cba4c-0a70-45ba-b9ff-badf510cb74b None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:34.670750 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:34.746343 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81db7eb-82ac-49c1-ab7b-c8ee6fecdde8 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:34.746905 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81db7eb-82ac-49c1-ab7b-c8ee6fecdde8 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:34.747360 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81db7eb-82ac-49c1-ab7b-c8ee6fecdde8 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:34.749001 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 53/101] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:34.754567 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08bbe7-5fde-4f81-8432-ab846635855e None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:34.755036 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08bbe7-5fde-4f81-8432-ab846635855e None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:34.755505 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08bbe7-5fde-4f81-8432-ab846635855e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:34.771800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:34.793910 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-2f08bbe7-5fde-4f81-8432-ab846635855e None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:34.795053 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-2f08bbe7-5fde-4f81-8432-ab846635855e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:34.801570 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cba4c-0a70-45ba-b9ff-badf510cb74b None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:34.855264 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab22152-2fe4-4382-870b-2abeb6775a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:34.855984 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab22152-2fe4-4382-870b-2abeb6775a1e None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:34.856354 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab22152-2fe4-4382-870b-2abeb6775a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:34.856635 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab22152-2fe4-4382-870b-2abeb6775a1e None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:34.857402 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab22152-2fe4-4382-870b-2abeb6775a1e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:34.857710 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab22152-2fe4-4382-870b-2abeb6775a1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:34.859240 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab22152-2fe4-4382-870b-2abeb6775a1e None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:34.873843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 49/102] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 10:39:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:34.876307 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7a0ac-705e-46ba-8df7-9900adb73e18 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:34.876614 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7a0ac-705e-46ba-8df7-9900adb73e18 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:34.876899 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7a0ac-705e-46ba-8df7-9900adb73e18 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:34.883562 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 50/103] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:34.884428 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7a0ac-705e-46ba-8df7-9900adb73e18 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:34.950944 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 54/104] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:34.952878 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adaf94e-786f-4dbe-a689-3fe9ce64f031 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:34.960748 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adaf94e-786f-4dbe-a689-3fe9ce64f031 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:34.961061 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adaf94e-786f-4dbe-a689-3fe9ce64f031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:34.993336 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-3adaf94e-786f-4dbe-a689-3fe9ce64f031 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:34.994701 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-3adaf94e-786f-4dbe-a689-3fe9ce64f031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:35.063730 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:35.106584 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7a0ac-705e-46ba-8df7-9900adb73e18 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:35.150045 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 55/105] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:35.152618 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adaf94e-786f-4dbe-a689-3fe9ce64f031 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:35.179901 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366189e4-3f83-4227-86a0-41cc381f734f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:35.181177 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366189e4-3f83-4227-86a0-41cc381f734f None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:35.181912 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366189e4-3f83-4227-86a0-41cc381f734f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:35.182414 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366189e4-3f83-4227-86a0-41cc381f734f None admin] PATH_INFO: `/v3/users/70e14dc04e6c45d3bbc98eb44394ff35` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:35.203526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366189e4-3f83-4227-86a0-41cc381f734f None admin] RBAC: Authorizing `identity:get_user(user_id=70e14dc04e6c45d3bbc98eb44394ff35)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:35.206203 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366189e4-3f83-4227-86a0-41cc381f734f None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:35.208817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 51/106] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:39:34 2022] GET /identity/v3/users/70e14dc04e6c45d3bbc98eb44394ff35 => generated 289 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:35.214363 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366189e4-3f83-4227-86a0-41cc381f734f None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:35.244480 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:35.309856 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adaf94e-786f-4dbe-a689-3fe9ce64f031 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:35.370468 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4cbacd-2d5f-4bc5-91ed-611f866fb5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:35.372348 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cbacd-2d5f-4bc5-91ed-611f866fb5ac None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:35.372839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cbacd-2d5f-4bc5-91ed-611f866fb5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:35.373562 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cbacd-2d5f-4bc5-91ed-611f866fb5ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:35.381311 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366189e4-3f83-4227-86a0-41cc381f734f None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:35.388104 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4cbacd-2d5f-4bc5-91ed-611f866fb5ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:39:35.399285 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-af4cbacd-2d5f-4bc5-91ed-611f866fb5ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:39:35.399285 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:35.399285 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:35.399285 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:35.399285 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:35.399285 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:35.399285 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:35.399285 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:35.399285 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:35.399285 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:35.399285 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:35.399285 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:35.399285 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:39:35.399285 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:39:35.399285 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:39:35.399285 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:39:35.400183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:39:35.400183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:39:35.400183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:39:35.400183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:39:35.400183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:35.400183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:35.400183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:35.400183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:35.400183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:35.400183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:35.400183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:35.400183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:35.400183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:35.400183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:35.400183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:35.400183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:35.401420 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:35.401420 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:35.401420 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:35.401420 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:35.401420 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:39:35.401420 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:39:35.401420 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:39:35.401420 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:39:35.401420 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:39:35.401420 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:39:35.401420 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:39:35.401420 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:39:35.404132 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 56/107] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:39:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:39:35.405082 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4cbacd-2d5f-4bc5-91ed-611f866fb5ac None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:35.424531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4424405-b0ec-46c3-9c33-c2b1feea0a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:35.425840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4424405-b0ec-46c3-9c33-c2b1feea0a43 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:35.426269 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4424405-b0ec-46c3-9c33-c2b1feea0a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:35.426952 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4424405-b0ec-46c3-9c33-c2b1feea0a43 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:35.428902 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4424405-b0ec-46c3-9c33-c2b1feea0a43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:35.430874 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4424405-b0ec-46c3-9c33-c2b1feea0a43 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:35.433122 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 52/108] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:39:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:35.434341 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6ec5e-b61f-434b-9bb5-033fd1baa58a None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:35.434631 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6ec5e-b61f-434b-9bb5-033fd1baa58a None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:35.434908 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6ec5e-b61f-434b-9bb5-033fd1baa58a None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:35.440480 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 53/109] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:35.440480 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6ec5e-b61f-434b-9bb5-033fd1baa58a None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:35.442134 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:35.546913 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4cbacd-2d5f-4bc5-91ed-611f866fb5ac None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:35.547710 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6ec5e-b61f-434b-9bb5-033fd1baa58a None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:35.577269 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:35.586709 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b4e46-f7f2-4307-9691-a6e7f1e6bf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:35.587591 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b4e46-f7f2-4307-9691-a6e7f1e6bf00 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:35.588065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b4e46-f7f2-4307-9691-a6e7f1e6bf00 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:35.588459 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b4e46-f7f2-4307-9691-a6e7f1e6bf00 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:35.589513 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b4e46-f7f2-4307-9691-a6e7f1e6bf00 None admin] RBAC: Adding query filter params (name=member) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:35.589914 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b4e46-f7f2-4307-9691-a6e7f1e6bf00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:35.591097 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91c116-2acc-4ae1-b128-f80aa13036c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:35.591562 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b4e46-f7f2-4307-9691-a6e7f1e6bf00 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:35.592106 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91c116-2acc-4ae1-b128-f80aa13036c4 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:35.592548 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91c116-2acc-4ae1-b128-f80aa13036c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:35.592964 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91c116-2acc-4ae1-b128-f80aa13036c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:35.601461 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 54/110] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 10:39:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:35.603048 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b4e46-f7f2-4307-9691-a6e7f1e6bf00 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:35.670724 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f91c116-2acc-4ae1-b128-f80aa13036c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:35.672223 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f91c116-2acc-4ae1-b128-f80aa13036c4 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:35.677852 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:35.712172 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b4e46-f7f2-4307-9691-a6e7f1e6bf00 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:35.746272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe456c4-14bd-4202-91a5-219de1cbfd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:35.746938 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe456c4-14bd-4202-91a5-219de1cbfd51 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:35.747263 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe456c4-14bd-4202-91a5-219de1cbfd51 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:35.747549 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe456c4-14bd-4202-91a5-219de1cbfd51 None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:35.748260 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe456c4-14bd-4202-91a5-219de1cbfd51 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:35.749757 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe456c4-14bd-4202-91a5-219de1cbfd51 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:35.769264 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 57/111] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:39:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:35.770560 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fb7b8-780d-4983-9c96-c37def69fc5f None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:35.770855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fb7b8-780d-4983-9c96-c37def69fc5f None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:35.771141 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fb7b8-780d-4983-9c96-c37def69fc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:35.776441 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 55/112] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jun 24 10:39:35 2022] POST /identity/v3/projects => generated 302 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:39:35.777878 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9ff45-9258-4d12-9668-755485c530d3 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:35.778173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9ff45-9258-4d12-9668-755485c530d3 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:35.778681 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9ff45-9258-4d12-9668-755485c530d3 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:35.779744 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 56/113] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:35.780444 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9ff45-9258-4d12-9668-755485c530d3 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:35.799179 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-439fb7b8-780d-4983-9c96-c37def69fc5f None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:35.800448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-439fb7b8-780d-4983-9c96-c37def69fc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:35.820838 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:35.892102 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 58/114] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:35.892102 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be33e60-3a37-4665-9fb3-f538254cad31 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:35.892102 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be33e60-3a37-4665-9fb3-f538254cad31 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:35.892102 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be33e60-3a37-4665-9fb3-f538254cad31 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:35.892102 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 59/115] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:35.892102 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be33e60-3a37-4665-9fb3-f538254cad31 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:35.910017 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9ff45-9258-4d12-9668-755485c530d3 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:35.930591 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:35.955534 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef92f4-d42d-4003-ab1d-16f808dae87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:35.956699 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef92f4-d42d-4003-ab1d-16f808dae87d None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:35.956993 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef92f4-d42d-4003-ab1d-16f808dae87d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:35.957275 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef92f4-d42d-4003-ab1d-16f808dae87d None admin] PATH_INFO: `/v3/users/b5108aa3ec1f4fa59fb30f4446107485` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:35.958487 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef92f4-d42d-4003-ab1d-16f808dae87d None admin] RBAC: Authorizing `identity:get_user(user_id=b5108aa3ec1f4fa59fb30f4446107485)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:35.959983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef92f4-d42d-4003-ab1d-16f808dae87d None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:35.962445 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 57/116] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:39:35 2022] GET /identity/v3/users/b5108aa3ec1f4fa59fb30f4446107485 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:35.963360 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30154554-cfaf-43cb-9008-667dd6093779 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:35.963652 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30154554-cfaf-43cb-9008-667dd6093779 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:35.963933 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30154554-cfaf-43cb-9008-667dd6093779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:35.981886 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-30154554-cfaf-43cb-9008-667dd6093779 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:35.983393 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-30154554-cfaf-43cb-9008-667dd6093779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:36.014736 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be33e60-3a37-4665-9fb3-f538254cad31 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:36.050133 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ce968-b424-4f99-943a-5c3e81d65f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:36.050557 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 58/117] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:36.051950 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2250b-fa05-4264-802c-398902afd08a None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:36.052301 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2250b-fa05-4264-802c-398902afd08a None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:36.052585 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2250b-fa05-4264-802c-398902afd08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:36.052777 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ce968-b424-4f99-943a-5c3e81d65f73 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:36.053250 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ce968-b424-4f99-943a-5c3e81d65f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:36.053850 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ce968-b424-4f99-943a-5c3e81d65f73 None admin] PATH_INFO: `/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:36.055561 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ce968-b424-4f99-943a-5c3e81d65f73 None admin] RBAC: Authorizing `identity:get_project(project_id=2ac825c0a6b546859d4dafd68f22a7ca)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:36.057763 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ce968-b424-4f99-943a-5c3e81d65f73 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:36.060893 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 60/118] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:39:35 2022] GET /identity/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:36.061902 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ce968-b424-4f99-943a-5c3e81d65f73 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:36.069790 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-e9f2250b-fa05-4264-802c-398902afd08a None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:36.070967 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e9f2250b-fa05-4264-802c-398902afd08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:36.091853 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:36.146297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 59/119] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:36.147440 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2250b-fa05-4264-802c-398902afd08a None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:36.199181 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ce968-b424-4f99-943a-5c3e81d65f73 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:36.211236 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:36.239839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62b49e-369a-4152-a740-882c7f028007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:36.240677 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62b49e-369a-4152-a740-882c7f028007 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:36.240968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62b49e-369a-4152-a740-882c7f028007 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:36.241251 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62b49e-369a-4152-a740-882c7f028007 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:36.253283 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62b49e-369a-4152-a740-882c7f028007 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:39:36.261841 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-db62b49e-369a-4152-a740-882c7f028007 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:39:36.261841 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:36.261841 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:36.261841 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:36.261841 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:36.261841 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:36.261841 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:36.261841 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:36.261841 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:36.261841 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:36.261841 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:36.261841 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:36.261841 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:39:36.261841 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:39:36.261841 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:39:36.261841 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:39:36.262727 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:39:36.262727 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:39:36.262727 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:39:36.262727 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:39:36.262727 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:36.262727 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:36.262727 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:36.262727 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:36.262727 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:36.262727 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:36.262727 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:36.262727 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:36.262727 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:36.262727 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:36.262727 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:36.262727 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:36.263515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:36.263515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:36.263515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:36.263515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:36.263515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:39:36.263515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:39:36.263515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:39:36.263515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:39:36.263515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:39:36.263515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:39:36.263515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:39:36.263515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:39:36.263515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 61/120] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 10:39:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:39:36.264209 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62b49e-369a-4152-a740-882c7f028007 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:36.273789 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2250b-fa05-4264-802c-398902afd08a None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:36.315357 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c37ed8-ef16-4a38-9b61-2344e814dfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:36.316559 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c37ed8-ef16-4a38-9b61-2344e814dfed None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:36.316850 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c37ed8-ef16-4a38-9b61-2344e814dfed None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:36.317137 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c37ed8-ef16-4a38-9b61-2344e814dfed None admin] PATH_INFO: `/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:36.318363 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c37ed8-ef16-4a38-9b61-2344e814dfed None admin] RBAC: Authorizing `identity:get_project(project_id=2ac825c0a6b546859d4dafd68f22a7ca)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:36.319873 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c37ed8-ef16-4a38-9b61-2344e814dfed None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:36.321599 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 60/121] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:39:36 2022] GET /identity/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:36.322496 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c37ed8-ef16-4a38-9b61-2344e814dfed None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:36.367109 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:36.388933 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62b49e-369a-4152-a740-882c7f028007 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:36.423663 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab078f4-de15-41d9-aa92-34877fb40806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:36.424363 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab078f4-de15-41d9-aa92-34877fb40806 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:36.424650 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab078f4-de15-41d9-aa92-34877fb40806 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:36.424936 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab078f4-de15-41d9-aa92-34877fb40806 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:36.425765 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab078f4-de15-41d9-aa92-34877fb40806 None admin] RBAC: Adding query filter params (role.id=32aef7aad733481291827ac4c11ac6dd, scope.project.id=2ac825c0a6b546859d4dafd68f22a7ca, user.id=70e14dc04e6c45d3bbc98eb44394ff35) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:36.426080 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab078f4-de15-41d9-aa92-34877fb40806 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:36.427573 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab078f4-de15-41d9-aa92-34877fb40806 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:36.434537 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 62/122] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:39:36 2022] GET /identity/v3/role_assignments?user.id=70e14dc04e6c45d3bbc98eb44394ff35&scope.project.id=2ac825c0a6b546859d4dafd68f22a7ca&role.id=32aef7aad733481291827ac4c11ac6dd => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:36.436047 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab078f4-de15-41d9-aa92-34877fb40806 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:36.436153 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c37ed8-ef16-4a38-9b61-2344e814dfed None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:36.455560 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:36.482094 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637e68d-2c0b-465c-bd22-bb0488dfacf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:36.482920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637e68d-2c0b-465c-bd22-bb0488dfacf4 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:36.483327 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637e68d-2c0b-465c-bd22-bb0488dfacf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:36.483521 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637e68d-2c0b-465c-bd22-bb0488dfacf4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:36.497231 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637e68d-2c0b-465c-bd22-bb0488dfacf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:39:36.504892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-0637e68d-2c0b-465c-bd22-bb0488dfacf4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:39:36.504892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:36.504892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:36.504892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:36.504892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:36.504892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:36.504892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:36.504892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:36.504892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:36.504892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:36.504892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:36.504892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:36.504892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:39:36.504892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:39:36.504892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:39:36.504892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:39:36.505864 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:39:36.505864 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:39:36.505864 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:39:36.505864 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:39:36.505864 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:36.505864 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:36.505864 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:36.505864 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:36.505864 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:36.505864 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:36.505864 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:36.505864 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:36.505864 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:36.505864 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:36.505864 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:36.505864 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:36.506716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:36.506716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:36.506716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:36.506716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:36.506716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:39:36.506716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:39:36.506716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:39:36.506716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:39:36.506716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:39:36.506716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:39:36.506716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:39:36.506716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:39:36.506716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 61/123] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:39:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:39:36.507972 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637e68d-2c0b-465c-bd22-bb0488dfacf4 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:36.593601 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab078f4-de15-41d9-aa92-34877fb40806 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:36.628109 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637e68d-2c0b-465c-bd22-bb0488dfacf4 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:36.642034 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fb8b3-30af-4097-8c3c-4e0f69c26e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:36.643136 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fb8b3-30af-4097-8c3c-4e0f69c26e64 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:36.643649 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fb8b3-30af-4097-8c3c-4e0f69c26e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:36.644146 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fb8b3-30af-4097-8c3c-4e0f69c26e64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:36.655135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20fb8b3-30af-4097-8c3c-4e0f69c26e64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:39:36.665904 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-b20fb8b3-30af-4097-8c3c-4e0f69c26e64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:39:36.665904 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:36.665904 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:36.665904 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:36.665904 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:36.665904 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:36.665904 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:36.665904 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:36.665904 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:36.665904 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:36.665904 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:36.665904 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:36.665904 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:39:36.665904 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:39:36.665904 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:39:36.665904 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:39:36.666831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:39:36.666831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:39:36.666831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:39:36.666831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:39:36.666831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:36.666831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:36.666831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:36.666831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:36.666831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:36.666831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:36.666831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:36.666831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:36.666831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:36.666831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:36.666831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:36.666831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:36.667683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:36.667683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:36.667683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:36.667683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:36.667683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:39:36.667683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:39:36.667683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:39:36.667683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:39:36.667683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:39:36.667683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:39:36.667683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:39:36.667683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:39:36.670121 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 63/124] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:39:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:39:36.671361 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fb8b3-30af-4097-8c3c-4e0f69c26e64 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:36.672362 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684de9c-d626-45c2-a6a1-9ea72a64e93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:36.673027 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684de9c-d626-45c2-a6a1-9ea72a64e93f None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:36.673313 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684de9c-d626-45c2-a6a1-9ea72a64e93f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:36.673592 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684de9c-d626-45c2-a6a1-9ea72a64e93f None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:36.674359 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684de9c-d626-45c2-a6a1-9ea72a64e93f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:36.674671 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684de9c-d626-45c2-a6a1-9ea72a64e93f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:36.676444 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684de9c-d626-45c2-a6a1-9ea72a64e93f None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:36.691167 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 62/125] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:39:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:36.692493 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684de9c-d626-45c2-a6a1-9ea72a64e93f None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:36.693554 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:36.730518 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:36.801361 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684de9c-d626-45c2-a6a1-9ea72a64e93f None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:36.802774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fb8b3-30af-4097-8c3c-4e0f69c26e64 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:36.836677 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c1ba2-46e5-4b97-a0ee-9b26ffa6a222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:36.837425 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c1ba2-46e5-4b97-a0ee-9b26ffa6a222 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:36.837691 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c1ba2-46e5-4b97-a0ee-9b26ffa6a222 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:36.837982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c1ba2-46e5-4b97-a0ee-9b26ffa6a222 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:36.838750 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c1ba2-46e5-4b97-a0ee-9b26ffa6a222 None admin] RBAC: Adding query filter params (name=member) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:36.839064 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c1ba2-46e5-4b97-a0ee-9b26ffa6a222 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:36.840908 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c1ba2-46e5-4b97-a0ee-9b26ffa6a222 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:36.842715 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b49a5-05c8-4bab-8cc7-62b226e1c33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:36.843973 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b49a5-05c8-4bab-8cc7-62b226e1c33e None admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:36.844451 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b49a5-05c8-4bab-8cc7-62b226e1c33e None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:36.844914 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b49a5-05c8-4bab-8cc7-62b226e1c33e None admin] PATH_INFO: `/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca/users/b5108aa3ec1f4fa59fb30f4446107485/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:36.847364 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b49a5-05c8-4bab-8cc7-62b226e1c33e None admin] RBAC: Authorizing `identity:create_grant(project_id=2ac825c0a6b546859d4dafd68f22a7ca, user_id=b5108aa3ec1f4fa59fb30f4446107485, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:36.849038 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b49a5-05c8-4bab-8cc7-62b226e1c33e None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:36.849927 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 63/126] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 10:39:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:36.850579 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c1ba2-46e5-4b97-a0ee-9b26ffa6a222 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:36.867215 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 64/127] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 10:39:36 2022] PUT /identity/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca/users/b5108aa3ec1f4fa59fb30f4446107485/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:39:36.868419 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b49a5-05c8-4bab-8cc7-62b226e1c33e None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:36.951081 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:36.957408 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:36.961993 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c1ba2-46e5-4b97-a0ee-9b26ffa6a222 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:36.997395 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b49a5-05c8-4bab-8cc7-62b226e1c33e None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:37.000237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13ab2e-8e13-451f-8407-cc06c227cbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:37.001368 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13ab2e-8e13-451f-8407-cc06c227cbab None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:37.001368 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13ab2e-8e13-451f-8407-cc06c227cbab None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:37.001555 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13ab2e-8e13-451f-8407-cc06c227cbab None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:37.002238 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13ab2e-8e13-451f-8407-cc06c227cbab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:37.002555 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13ab2e-8e13-451f-8407-cc06c227cbab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:37.003981 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13ab2e-8e13-451f-8407-cc06c227cbab None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:37.013368 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 64/128] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:39:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:37.014084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13ab2e-8e13-451f-8407-cc06c227cbab None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:37.044535 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654280c-4854-45a8-ae48-808a330df7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:37.048447 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654280c-4854-45a8-ae48-808a330df7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:37.049047 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654280c-4854-45a8-ae48-808a330df7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:37.050305 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654280c-4854-45a8-ae48-808a330df7f2 None admin] PATH_INFO: `/v3/users/b5108aa3ec1f4fa59fb30f4446107485` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:37.052584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654280c-4854-45a8-ae48-808a330df7f2 None admin] RBAC: Authorizing `identity:get_user(user_id=b5108aa3ec1f4fa59fb30f4446107485)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:37.055060 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654280c-4854-45a8-ae48-808a330df7f2 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:37.065034 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 65/129] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:39:36 2022] GET /identity/v3/users/b5108aa3ec1f4fa59fb30f4446107485 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:37.068714 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654280c-4854-45a8-ae48-808a330df7f2 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:37.180297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13ab2e-8e13-451f-8407-cc06c227cbab None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:37.206193 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654280c-4854-45a8-ae48-808a330df7f2 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:37.229914 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057ff20-4bc8-4fcf-a9be-52ef6fcc5a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:37.231839 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057ff20-4bc8-4fcf-a9be-52ef6fcc5a5c None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:37.232337 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057ff20-4bc8-4fcf-a9be-52ef6fcc5a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:37.232873 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057ff20-4bc8-4fcf-a9be-52ef6fcc5a5c None admin] PATH_INFO: `/v3/users/b5108aa3ec1f4fa59fb30f4446107485` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:37.234431 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2057ff20-4bc8-4fcf-a9be-52ef6fcc5a5c None admin] RBAC: Authorizing `identity:get_user(user_id=b5108aa3ec1f4fa59fb30f4446107485)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:37.236359 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2057ff20-4bc8-4fcf-a9be-52ef6fcc5a5c None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:37.238226 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 65/130] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:39:37 2022] GET /identity/v3/users/b5108aa3ec1f4fa59fb30f4446107485 => generated 275 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:37.239320 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057ff20-4bc8-4fcf-a9be-52ef6fcc5a5c None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:37.273781 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:37.291909 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603a19a-9a3e-420e-bbe5-1aaf168e8b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:37.292828 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603a19a-9a3e-420e-bbe5-1aaf168e8b8e None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:37.293126 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603a19a-9a3e-420e-bbe5-1aaf168e8b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:37.293414 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603a19a-9a3e-420e-bbe5-1aaf168e8b8e None admin] PATH_INFO: `/v3/users/ae7384e027454770bea6d011e8d5d6c6` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:37.294704 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603a19a-9a3e-420e-bbe5-1aaf168e8b8e None admin] RBAC: Authorizing `identity:get_user(user_id=ae7384e027454770bea6d011e8d5d6c6)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:37.296225 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603a19a-9a3e-420e-bbe5-1aaf168e8b8e None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:37.297898 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 66/131] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:39:37 2022] GET /identity/v3/users/ae7384e027454770bea6d011e8d5d6c6 => generated 247 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:37.298685 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603a19a-9a3e-420e-bbe5-1aaf168e8b8e None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:37.309530 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:37.362753 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057ff20-4bc8-4fcf-a9be-52ef6fcc5a5c None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:37.402104 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d540671-2d58-458e-8b16-99fbf1469851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:37.403377 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d540671-2d58-458e-8b16-99fbf1469851 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:37.404273 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d540671-2d58-458e-8b16-99fbf1469851 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:37.404763 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d540671-2d58-458e-8b16-99fbf1469851 None admin] PATH_INFO: `/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:37.407914 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d540671-2d58-458e-8b16-99fbf1469851 None admin] RBAC: Authorizing `identity:get_project(project_id=2ac825c0a6b546859d4dafd68f22a7ca)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:37.411878 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d540671-2d58-458e-8b16-99fbf1469851 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:37.415424 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 66/132] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:39:37 2022] GET /identity/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:37.416576 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d540671-2d58-458e-8b16-99fbf1469851 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:37.525703 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:37.534026 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d540671-2d58-458e-8b16-99fbf1469851 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:37.547916 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603a19a-9a3e-420e-bbe5-1aaf168e8b8e None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:37.587388 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acec4ff-aa7d-4187-b38e-0434fa032499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:37.591167 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acec4ff-aa7d-4187-b38e-0434fa032499 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:37.591695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acec4ff-aa7d-4187-b38e-0434fa032499 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:37.592184 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acec4ff-aa7d-4187-b38e-0434fa032499 None admin] PATH_INFO: `/v3/projects/f0f1591696ee4f588f3c1040938dc83b` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:37.593678 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acec4ff-aa7d-4187-b38e-0434fa032499 None admin] RBAC: Authorizing `identity:get_project(project_id=f0f1591696ee4f588f3c1040938dc83b)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:37.595592 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acec4ff-aa7d-4187-b38e-0434fa032499 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:37.597647 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 67/133] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:39:37 2022] GET /identity/v3/projects/f0f1591696ee4f588f3c1040938dc83b => generated 312 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:37.598696 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acec4ff-aa7d-4187-b38e-0434fa032499 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:37.606940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db47a8-0a78-4762-ab78-e52fba95793b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:37.607873 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db47a8-0a78-4762-ab78-e52fba95793b None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:37.608164 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db47a8-0a78-4762-ab78-e52fba95793b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:37.608443 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db47a8-0a78-4762-ab78-e52fba95793b None admin] PATH_INFO: `/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:37.609678 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db47a8-0a78-4762-ab78-e52fba95793b None admin] RBAC: Authorizing `identity:get_project(project_id=2ac825c0a6b546859d4dafd68f22a7ca)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:37.611214 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db47a8-0a78-4762-ab78-e52fba95793b None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:37.612930 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 67/134] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:39:37 2022] GET /identity/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:37.613685 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db47a8-0a78-4762-ab78-e52fba95793b None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:37.679521 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:37.711794 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acec4ff-aa7d-4187-b38e-0434fa032499 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:37.752225 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bb807-f7c7-40c9-b66b-60ee752e512e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:37.753315 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bb807-f7c7-40c9-b66b-60ee752e512e None admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:37.753709 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bb807-f7c7-40c9-b66b-60ee752e512e None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:37.754115 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bb807-f7c7-40c9-b66b-60ee752e512e None admin] PATH_INFO: `/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca/users/b5108aa3ec1f4fa59fb30f4446107485/roles/19b4d737ab92430caeb4cd548049bcfc` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:37.757044 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9bb807-f7c7-40c9-b66b-60ee752e512e None admin] RBAC: Authorizing `identity:create_grant(project_id=2ac825c0a6b546859d4dafd68f22a7ca, user_id=b5108aa3ec1f4fa59fb30f4446107485, role_id=19b4d737ab92430caeb4cd548049bcfc)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:37.758636 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9bb807-f7c7-40c9-b66b-60ee752e512e None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:37.777812 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 68/135] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 10:39:37 2022] PUT /identity/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca/users/b5108aa3ec1f4fa59fb30f4446107485/roles/19b4d737ab92430caeb4cd548049bcfc => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:39:37.779096 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bb807-f7c7-40c9-b66b-60ee752e512e None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:37.933186 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db47a8-0a78-4762-ab78-e52fba95793b None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:37.980913 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bb807-f7c7-40c9-b66b-60ee752e512e None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:38.002708 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7263644-11d2-4351-ae14-e7d3c1077c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:38.003657 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7263644-11d2-4351-ae14-e7d3c1077c40 None admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:38.003940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7263644-11d2-4351-ae14-e7d3c1077c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:38.004229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7263644-11d2-4351-ae14-e7d3c1077c40 None admin] PATH_INFO: `/v3/projects/f0f1591696ee4f588f3c1040938dc83b/users/b5108aa3ec1f4fa59fb30f4446107485/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:38.006357 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7263644-11d2-4351-ae14-e7d3c1077c40 None admin] RBAC: Authorizing `identity:create_grant(project_id=f0f1591696ee4f588f3c1040938dc83b, user_id=b5108aa3ec1f4fa59fb30f4446107485, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:38.008065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7263644-11d2-4351-ae14-e7d3c1077c40 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:38.014428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:38.021374 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346262e9-acf1-4f37-96d1-0a382683b6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:38.023024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346262e9-acf1-4f37-96d1-0a382683b6c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:38.023365 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346262e9-acf1-4f37-96d1-0a382683b6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:38.023607 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346262e9-acf1-4f37-96d1-0a382683b6c5 None admin] PATH_INFO: `/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca/users/ae7384e027454770bea6d011e8d5d6c6/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:38.026572 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346262e9-acf1-4f37-96d1-0a382683b6c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ac825c0a6b546859d4dafd68f22a7ca, user_id=ae7384e027454770bea6d011e8d5d6c6, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:38.028240 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346262e9-acf1-4f37-96d1-0a382683b6c5 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:38.035208 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 68/136] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 10:39:37 2022] PUT /identity/v3/projects/f0f1591696ee4f588f3c1040938dc83b/users/b5108aa3ec1f4fa59fb30f4446107485/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:39:38.066894 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 69/137] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 10:39:37 2022] PUT /identity/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca/users/ae7384e027454770bea6d011e8d5d6c6/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:39:38.088815 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26d05f-89e7-40af-82c3-e795c574de93 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:38.089197 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26d05f-89e7-40af-82c3-e795c574de93 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:38.089488 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26d05f-89e7-40af-82c3-e795c574de93 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:38.091228 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 69/138] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:38.097962 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53840609-7ebd-4b4a-8686-a83ecc02ad3b None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:38.098292 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53840609-7ebd-4b4a-8686-a83ecc02ad3b None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:38.098536 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53840609-7ebd-4b4a-8686-a83ecc02ad3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:38.137852 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-53840609-7ebd-4b4a-8686-a83ecc02ad3b None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:38.139096 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-53840609-7ebd-4b4a-8686-a83ecc02ad3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:38.256575 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 70/139] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:38.292893 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26d05f-89e7-40af-82c3-e795c574de93 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:38.331429 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:38.437125 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26d05f-89e7-40af-82c3-e795c574de93 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:38.474470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bd45f-d99d-4627-b6c3-90085947ddf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:38.475325 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bd45f-d99d-4627-b6c3-90085947ddf2 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:38.475605 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bd45f-d99d-4627-b6c3-90085947ddf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:38.475882 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bd45f-d99d-4627-b6c3-90085947ddf2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:38.480831 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7bd45f-d99d-4627-b6c3-90085947ddf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:38.482402 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7bd45f-d99d-4627-b6c3-90085947ddf2 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:38.484410 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 70/140] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:39:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:38.489720 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53840609-7ebd-4b4a-8686-a83ecc02ad3b None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:38.661728 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53840609-7ebd-4b4a-8686-a83ecc02ad3b None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:38.691578 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:38.697785 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc049067-22e8-4a7f-8499-893ecfe99c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:38.698760 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc049067-22e8-4a7f-8499-893ecfe99c33 None admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:38.699048 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc049067-22e8-4a7f-8499-893ecfe99c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:38.699526 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc049067-22e8-4a7f-8499-893ecfe99c33 None admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:38.700627 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc049067-22e8-4a7f-8499-893ecfe99c33 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:38.702423 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc049067-22e8-4a7f-8499-893ecfe99c33 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:38.733159 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 71/141] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 10:39:38 2022] POST /identity/v3/users => generated 283 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:39:39.148642 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e29f9-2333-4d9c-b873-615aa4ee163b None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:39.149182 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e29f9-2333-4d9c-b873-615aa4ee163b None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:39.149182 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e29f9-2333-4d9c-b873-615aa4ee163b None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:39.151212 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 71/142] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:39.156373 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9291cf-1a24-4930-a2d8-f4d04d76e95e None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:39.156664 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9291cf-1a24-4930-a2d8-f4d04d76e95e None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:39.156951 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9291cf-1a24-4930-a2d8-f4d04d76e95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:39.180213 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-de9291cf-1a24-4930-a2d8-f4d04d76e95e None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:39.181449 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-de9291cf-1a24-4930-a2d8-f4d04d76e95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:39.266678 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 72/143] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:39.305199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e29f9-2333-4d9c-b873-615aa4ee163b None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:39.426326 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:39.445658 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e29f9-2333-4d9c-b873-615aa4ee163b None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:39.490832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e4380-f59e-4af7-8f1e-d44d7766afb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:39.491678 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e4380-f59e-4af7-8f1e-d44d7766afb4 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:39.491964 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e4380-f59e-4af7-8f1e-d44d7766afb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:39.492237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e4380-f59e-4af7-8f1e-d44d7766afb4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:39.505101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e4380-f59e-4af7-8f1e-d44d7766afb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:39:39.513344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-925e4380-f59e-4af7-8f1e-d44d7766afb4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:39:39.513344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:39.513344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:39.513344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:39.513344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:39.513344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:39.513344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:39.513344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:39.513344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:39.513344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:39.513344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:39.513344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:39.513344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:39:39.513344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:39:39.513344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:39:39.513344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:39:39.514298 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:39:39.514298 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:39:39.514298 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:39:39.514298 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:39:39.514298 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:39.514298 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:39.514298 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:39.514298 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:39.514298 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:39.514298 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:39.514298 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:39.514298 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:39.514298 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:39.514298 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:39.514298 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:39.514298 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:39.515091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:39.515091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:39.515091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:39.515091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:39.515091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:39:39.515091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:39:39.515091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:39:39.515091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:39:39.515091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:39:39.515091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:39:39.515091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:39:39.515091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:39:39.515091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 72/144] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:39:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:39:39.520881 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9291cf-1a24-4930-a2d8-f4d04d76e95e None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:39.633777 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9291cf-1a24-4930-a2d8-f4d04d76e95e None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:39.644327 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:39.676051 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c07428-3958-4636-86bd-e9ac855296d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:39.677334 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c07428-3958-4636-86bd-e9ac855296d5 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:39.678144 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c07428-3958-4636-86bd-e9ac855296d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:39.678419 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c07428-3958-4636-86bd-e9ac855296d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:39.679209 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c07428-3958-4636-86bd-e9ac855296d5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:39.679524 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c07428-3958-4636-86bd-e9ac855296d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:39.680932 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c07428-3958-4636-86bd-e9ac855296d5 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:39.690019 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 73/145] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 10:39:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:39.696038 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e4380-f59e-4af7-8f1e-d44d7766afb4 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:39.807271 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e4380-f59e-4af7-8f1e-d44d7766afb4 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:39.843027 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10bfa4f-2645-4a45-a4ea-15a8015ae651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:39.843992 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bfa4f-2645-4a45-a4ea-15a8015ae651 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:39.844275 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bfa4f-2645-4a45-a4ea-15a8015ae651 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:39.844550 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bfa4f-2645-4a45-a4ea-15a8015ae651 None admin] PATH_INFO: `/v3/users/70e14dc04e6c45d3bbc98eb44394ff35` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:39.847229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10bfa4f-2645-4a45-a4ea-15a8015ae651 None admin] RBAC: Authorizing `identity:get_user(user_id=70e14dc04e6c45d3bbc98eb44394ff35)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:39.848684 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10bfa4f-2645-4a45-a4ea-15a8015ae651 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:39.850504 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 73/146] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:39:39 2022] GET /identity/v3/users/70e14dc04e6c45d3bbc98eb44394ff35 => generated 289 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:39.855996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c07428-3958-4636-86bd-e9ac855296d5 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:39.869274 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c055c0f-acd1-4657-b866-5a3c5b474cca None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:39.869916 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c055c0f-acd1-4657-b866-5a3c5b474cca None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:39.869916 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c055c0f-acd1-4657-b866-5a3c5b474cca None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:39.871295 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 74/147] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:39.876521 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c91db3-ac19-4dd8-9854-c3b015d59b7e None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:39.876807 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c91db3-ac19-4dd8-9854-c3b015d59b7e None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:39.877085 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c91db3-ac19-4dd8-9854-c3b015d59b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:39.903564 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-c2c91db3-ac19-4dd8-9854-c3b015d59b7e None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:39.904968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c2c91db3-ac19-4dd8-9854-c3b015d59b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:39.925976 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:40.035995 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 75/148] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:40.071268 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c07428-3958-4636-86bd-e9ac855296d5 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:40.104368 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c91db3-ac19-4dd8-9854-c3b015d59b7e None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:40.140607 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857edc7d-b0ae-4c01-aae5-00f85350c945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:40.141499 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857edc7d-b0ae-4c01-aae5-00f85350c945 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:40.141791 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857edc7d-b0ae-4c01-aae5-00f85350c945 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:40.142066 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857edc7d-b0ae-4c01-aae5-00f85350c945 None admin] PATH_INFO: `/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:40.146181 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857edc7d-b0ae-4c01-aae5-00f85350c945 None admin] RBAC: Authorizing `identity:get_project(project_id=2ac825c0a6b546859d4dafd68f22a7ca)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:40.147702 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857edc7d-b0ae-4c01-aae5-00f85350c945 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:40.149622 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 74/149] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:39:39 2022] GET /identity/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca => generated 298 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:40.156839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857edc7d-b0ae-4c01-aae5-00f85350c945 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:40.236991 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:40.334719 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c91db3-ac19-4dd8-9854-c3b015d59b7e None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:40.382937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857edc7d-b0ae-4c01-aae5-00f85350c945 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:40.412592 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974a7e5-b12f-4f73-bea5-1c07732d7279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:40.413437 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974a7e5-b12f-4f73-bea5-1c07732d7279 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:40.413717 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974a7e5-b12f-4f73-bea5-1c07732d7279 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:40.414043 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974a7e5-b12f-4f73-bea5-1c07732d7279 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:40.432757 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79ffb1-3eb6-4230-9fb3-c74594614961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:40.433675 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79ffb1-3eb6-4230-9fb3-c74594614961 None admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:40.433961 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79ffb1-3eb6-4230-9fb3-c74594614961 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:40.434242 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79ffb1-3eb6-4230-9fb3-c74594614961 None admin] PATH_INFO: `/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca/users/70e14dc04e6c45d3bbc98eb44394ff35/roles/32aef7aad733481291827ac4c11ac6dd` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:40.436295 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e79ffb1-3eb6-4230-9fb3-c74594614961 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ac825c0a6b546859d4dafd68f22a7ca, user_id=70e14dc04e6c45d3bbc98eb44394ff35, role_id=32aef7aad733481291827ac4c11ac6dd)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:40.437765 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e79ffb1-3eb6-4230-9fb3-c74594614961 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:40.444902 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974a7e5-b12f-4f73-bea5-1c07732d7279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:39:40.453170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-f974a7e5-b12f-4f73-bea5-1c07732d7279 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:39:40.453170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:40.453170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:40.453170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:40.453170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:40.453170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:40.453170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:40.453170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:40.453170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:40.453170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:40.453170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:40.453170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:40.453170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:39:40.453170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:39:40.453170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:39:40.453170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:39:40.454045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:39:40.454045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:39:40.454045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:39:40.454045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:39:40.454045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:40.454045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:40.454045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:40.454045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:40.454045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:40.454045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:40.454045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:40.454045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:40.454045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:40.454045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:40.454045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:40.454045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:40.454876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:40.454876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:40.454876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:40.454876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:40.454876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:39:40.454876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:39:40.454876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:39:40.454876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:39:40.454876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:39:40.454876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:39:40.454876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:39:40.454876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:39:40.454876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 76/150] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:39:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:39:40.462763 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 75/151] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 10:39:40 2022] PUT /identity/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca/users/70e14dc04e6c45d3bbc98eb44394ff35/roles/32aef7aad733481291827ac4c11ac6dd => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:39:40.463723 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974a7e5-b12f-4f73-bea5-1c07732d7279 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:40.511828 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:40.588293 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974a7e5-b12f-4f73-bea5-1c07732d7279 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:40.629230 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a829c26-fca6-4c6f-b728-9046a23732b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:40.629921 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a829c26-fca6-4c6f-b728-9046a23732b4 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:40.630274 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a829c26-fca6-4c6f-b728-9046a23732b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:40.630559 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a829c26-fca6-4c6f-b728-9046a23732b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:40.631349 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a829c26-fca6-4c6f-b728-9046a23732b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:40.631661 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a829c26-fca6-4c6f-b728-9046a23732b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:40.633080 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a829c26-fca6-4c6f-b728-9046a23732b4 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:40.643720 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 77/152] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 10:39:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:40.649055 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79ffb1-3eb6-4230-9fb3-c74594614961 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:40.754028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:40.760309 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79ffb1-3eb6-4230-9fb3-c74594614961 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:40.798311 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e87fd9-e08a-442b-ab0a-ab6e6edef42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:40.799252 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e87fd9-e08a-442b-ab0a-ab6e6edef42e None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:40.799539 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e87fd9-e08a-442b-ab0a-ab6e6edef42e None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:40.799818 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e87fd9-e08a-442b-ab0a-ab6e6edef42e None admin] PATH_INFO: `/v3/users/b5108aa3ec1f4fa59fb30f4446107485` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:40.801091 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e87fd9-e08a-442b-ab0a-ab6e6edef42e None admin] RBAC: Authorizing `identity:get_user(user_id=b5108aa3ec1f4fa59fb30f4446107485)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:40.802580 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e87fd9-e08a-442b-ab0a-ab6e6edef42e None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:40.804509 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 76/153] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:39:40 2022] GET /identity/v3/users/b5108aa3ec1f4fa59fb30f4446107485 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:40.810656 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a829c26-fca6-4c6f-b728-9046a23732b4 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:40.891126 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:40.923120 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a829c26-fca6-4c6f-b728-9046a23732b4 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:40.958549 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6e637-026e-4985-9979-719205df75e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:40.959244 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6e637-026e-4985-9979-719205df75e5 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:40.959536 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6e637-026e-4985-9979-719205df75e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:40.959816 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6e637-026e-4985-9979-719205df75e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:41.042579 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6e637-026e-4985-9979-719205df75e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:41.044157 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6e637-026e-4985-9979-719205df75e5 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:41.132440 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:41.172451 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 78/154] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:39:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:41.178153 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e87fd9-e08a-442b-ab0a-ab6e6edef42e None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:41.199983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750fb6f-9196-4df3-b857-6ca94e8e1988 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:41.200549 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750fb6f-9196-4df3-b857-6ca94e8e1988 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:41.200991 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750fb6f-9196-4df3-b857-6ca94e8e1988 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:41.202798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 79/155] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:41.207943 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec5457-6d42-4072-b952-ad3a65ac6392 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:41.208417 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec5457-6d42-4072-b952-ad3a65ac6392 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:41.208859 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec5457-6d42-4072-b952-ad3a65ac6392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:41.240165 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-dcec5457-6d42-4072-b952-ad3a65ac6392 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:41.241935 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-dcec5457-6d42-4072-b952-ad3a65ac6392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:41.369243 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e87fd9-e08a-442b-ab0a-ab6e6edef42e None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:41.378290 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 80/156] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:39:41.420823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485f14d-bd71-4fc1-80ac-8a24b40614a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:41.421732 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485f14d-bd71-4fc1-80ac-8a24b40614a3 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:41.422019 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485f14d-bd71-4fc1-80ac-8a24b40614a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:41.422296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485f14d-bd71-4fc1-80ac-8a24b40614a3 None admin] PATH_INFO: `/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:41.423604 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485f14d-bd71-4fc1-80ac-8a24b40614a3 None admin] RBAC: Authorizing `identity:get_project(project_id=2ac825c0a6b546859d4dafd68f22a7ca)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:41.425129 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485f14d-bd71-4fc1-80ac-8a24b40614a3 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:41.426866 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 77/157] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:39:41 2022] GET /identity/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:41.431081 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec5457-6d42-4072-b952-ad3a65ac6392 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:41.445421 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485f14d-bd71-4fc1-80ac-8a24b40614a3 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:41.531282 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:41.634312 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec5457-6d42-4072-b952-ad3a65ac6392 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:41.636397 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:41.655895 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485f14d-bd71-4fc1-80ac-8a24b40614a3 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:41.717370 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb49bf-3c96-49af-bec5-23435eeec27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:41.719108 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb49bf-3c96-49af-bec5-23435eeec27d None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:41.719584 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb49bf-3c96-49af-bec5-23435eeec27d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:41.720135 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb49bf-3c96-49af-bec5-23435eeec27d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:41.746722 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb49bf-3c96-49af-bec5-23435eeec27d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:39:41.760866 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-c5bb49bf-3c96-49af-bec5-23435eeec27d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:39:41.760866 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:41.760866 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:41.760866 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:41.760866 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:41.760866 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:41.760866 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:41.760866 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:41.760866 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:41.760866 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:41.760866 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:41.760866 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:41.760866 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:39:41.760866 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:39:41.760866 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:39:41.760866 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:39:41.762120 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:39:41.762120 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:39:41.762120 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:39:41.762120 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:39:41.762120 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:41.762120 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:41.762120 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:41.762120 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:41.762120 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:41.762120 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:41.762120 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:41.762120 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:41.762120 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:41.762120 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:41.762120 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:41.762120 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:41.763083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:41.763083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:41.763083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:41.763083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:41.763083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:39:41.763083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:39:41.763083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:39:41.763083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:39:41.763083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:39:41.763083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:39:41.763083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:39:41.763083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:39:41.765439 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 81/158] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 10:39:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:39:41.768026 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd860a-8c8f-4dd2-90aa-c0369672993b None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:41.768478 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd860a-8c8f-4dd2-90aa-c0369672993b None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:41.768897 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd860a-8c8f-4dd2-90aa-c0369672993b None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:41.774222 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 82/159] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:41.775319 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd860a-8c8f-4dd2-90aa-c0369672993b None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:41.777135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5136f59-99aa-4e3f-8c9e-949594ab6ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:41.777829 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5136f59-99aa-4e3f-8c9e-949594ab6ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:41.778115 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5136f59-99aa-4e3f-8c9e-949594ab6ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:41.778401 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5136f59-99aa-4e3f-8c9e-949594ab6ad7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:41.779322 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5136f59-99aa-4e3f-8c9e-949594ab6ad7 None admin] RBAC: Adding query filter params (role.id=4827ddfe1a0e476294ecf7f1d122cc32, scope.project.id=2ac825c0a6b546859d4dafd68f22a7ca, user.id=b5108aa3ec1f4fa59fb30f4446107485) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:41.779623 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5136f59-99aa-4e3f-8c9e-949594ab6ad7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:41.781105 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5136f59-99aa-4e3f-8c9e-949594ab6ad7 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:41.797393 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 78/160] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:39:41 2022] GET /identity/v3/role_assignments?user.id=b5108aa3ec1f4fa59fb30f4446107485&scope.project.id=2ac825c0a6b546859d4dafd68f22a7ca&role.id=4827ddfe1a0e476294ecf7f1d122cc32 => generated 608 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:41.799249 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c9274-13d6-49da-910d-b324ad4baaf6 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:41.799249 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c9274-13d6-49da-910d-b324ad4baaf6 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:41.799249 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c9274-13d6-49da-910d-b324ad4baaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:41.831205 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-479c9274-13d6-49da-910d-b324ad4baaf6 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:41.832437 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-479c9274-13d6-49da-910d-b324ad4baaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:41.970024 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd860a-8c8f-4dd2-90aa-c0369672993b None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:41.996238 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 79/161] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:41.997812 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f296df-5567-406f-b16a-6699524a317b None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:41.998241 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f296df-5567-406f-b16a-6699524a317b None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:41.998740 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f296df-5567-406f-b16a-6699524a317b None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:42.000856 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 80/162] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:42.008699 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2383d-e615-472a-80b4-e05f1c454dd4 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:42.009165 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2383d-e615-472a-80b4-e05f1c454dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:42.009661 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2383d-e615-472a-80b4-e05f1c454dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:42.033207 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba31fa2-48cd-4f38-b741-ad77a799b122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:42.033889 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba31fa2-48cd-4f38-b741-ad77a799b122 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:42.034174 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba31fa2-48cd-4f38-b741-ad77a799b122 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:42.034451 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba31fa2-48cd-4f38-b741-ad77a799b122 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:42.035376 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba31fa2-48cd-4f38-b741-ad77a799b122 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:42.035691 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba31fa2-48cd-4f38-b741-ad77a799b122 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:42.037074 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-5fa2383d-e615-472a-80b4-e05f1c454dd4 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:42.037187 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba31fa2-48cd-4f38-b741-ad77a799b122 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:42.038489 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-5fa2383d-e615-472a-80b4-e05f1c454dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:42.051451 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 83/163] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:39:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:42.052523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba31fa2-48cd-4f38-b741-ad77a799b122 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:42.069734 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:42.080119 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:42.169982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba31fa2-48cd-4f38-b741-ad77a799b122 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:42.172265 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 81/164] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:42.173414 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2383d-e615-472a-80b4-e05f1c454dd4 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:42.217898 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7fd0d4-5fcc-4f3e-b2d4-d180d700b52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:42.218965 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fd0d4-5fcc-4f3e-b2d4-d180d700b52e None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:42.219405 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fd0d4-5fcc-4f3e-b2d4-d180d700b52e None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:42.219811 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fd0d4-5fcc-4f3e-b2d4-d180d700b52e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:42.239217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7fd0d4-5fcc-4f3e-b2d4-d180d700b52e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:39:42.247401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-8f7fd0d4-5fcc-4f3e-b2d4-d180d700b52e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:39:42.247401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:42.247401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:42.247401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:42.247401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:42.247401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:42.247401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:42.247401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:42.247401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:42.247401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:42.247401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:42.247401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:42.247401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:39:42.247401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:39:42.247401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:39:42.247401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:39:42.248245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:39:42.248245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:39:42.248245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:39:42.248245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:39:42.248245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:42.248245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:42.248245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:42.248245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:42.248245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:42.248245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:42.248245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:42.248245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:42.248245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:42.248245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:42.248245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:42.248245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:42.249014 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:42.249014 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:42.249014 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:42.249014 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:42.249014 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:39:42.249014 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:39:42.249014 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:39:42.249014 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:39:42.249014 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:39:42.249014 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:39:42.249014 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:39:42.249014 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:39:42.251415 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 84/165] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:39:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:39:42.256125 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7fd0d4-5fcc-4f3e-b2d4-d180d700b52e None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:42.354632 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:42.371689 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7fd0d4-5fcc-4f3e-b2d4-d180d700b52e None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:42.392718 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2383d-e615-472a-80b4-e05f1c454dd4 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:42.410246 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740564f-da75-4976-82ce-d70bdb437db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:42.411062 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740564f-da75-4976-82ce-d70bdb437db8 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:42.411377 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740564f-da75-4976-82ce-d70bdb437db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:42.411656 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740564f-da75-4976-82ce-d70bdb437db8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:42.422507 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0740564f-da75-4976-82ce-d70bdb437db8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:39:42.430382 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-0740564f-da75-4976-82ce-d70bdb437db8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:39:42.430382 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:42.430382 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:42.430382 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:42.430382 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:42.430382 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:42.430382 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:42.430382 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:42.430382 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:42.430382 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:42.430382 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:42.430382 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:42.430382 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:39:42.430382 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:39:42.430382 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:39:42.430382 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:39:42.431441 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:39:42.431441 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:39:42.431441 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:39:42.431441 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:39:42.431441 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:42.431441 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:42.431441 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:42.431441 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:42.431441 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:42.431441 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:42.431441 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:42.431441 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:42.431441 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:42.431441 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:42.431441 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:42.431441 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:42.432398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:42.432398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:42.432398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:42.432398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:42.432398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:39:42.432398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:39:42.432398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:39:42.432398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:39:42.432398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:39:42.432398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:39:42.432398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:39:42.432398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:39:42.434857 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 85/166] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:39:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:39:42.435878 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740564f-da75-4976-82ce-d70bdb437db8 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:42.471926 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a259005-3842-42c9-9408-86bd9db0ecb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:42.473044 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a259005-3842-42c9-9408-86bd9db0ecb4 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:42.473402 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a259005-3842-42c9-9408-86bd9db0ecb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:42.473752 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a259005-3842-42c9-9408-86bd9db0ecb4 None admin] PATH_INFO: `/v3/users/b5108aa3ec1f4fa59fb30f4446107485` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:42.475204 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a259005-3842-42c9-9408-86bd9db0ecb4 None admin] RBAC: Authorizing `identity:get_user(user_id=b5108aa3ec1f4fa59fb30f4446107485)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:42.476776 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a259005-3842-42c9-9408-86bd9db0ecb4 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:42.478546 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 82/167] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:39:42 2022] GET /identity/v3/users/b5108aa3ec1f4fa59fb30f4446107485 => generated 275 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:42.479517 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a259005-3842-42c9-9408-86bd9db0ecb4 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:42.532125 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:42.544201 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740564f-da75-4976-82ce-d70bdb437db8 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:42.581558 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d245d-23ef-4aac-ab73-495d9bb29a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:42.582631 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d245d-23ef-4aac-ab73-495d9bb29a6a None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:42.583115 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d245d-23ef-4aac-ab73-495d9bb29a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:42.583624 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d245d-23ef-4aac-ab73-495d9bb29a6a None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:42.584577 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d245d-23ef-4aac-ab73-495d9bb29a6a None admin] RBAC: Adding query filter params (name=member) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:42.585072 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d245d-23ef-4aac-ab73-495d9bb29a6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:42.586746 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d245d-23ef-4aac-ab73-495d9bb29a6a None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:42.596278 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 86/168] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 10:39:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:42.597457 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d245d-23ef-4aac-ab73-495d9bb29a6a None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:42.615815 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:42.663035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a259005-3842-42c9-9408-86bd9db0ecb4 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:42.717020 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d245d-23ef-4aac-ab73-495d9bb29a6a None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:42.727362 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff9f2c-7559-4e1c-b527-3c303b28101d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:42.728110 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff9f2c-7559-4e1c-b527-3c303b28101d None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:42.728400 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff9f2c-7559-4e1c-b527-3c303b28101d None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:42.728681 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff9f2c-7559-4e1c-b527-3c303b28101d None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:42.729584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff9f2c-7559-4e1c-b527-3c303b28101d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:42.730080 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff9f2c-7559-4e1c-b527-3c303b28101d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:42.731710 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff9f2c-7559-4e1c-b527-3c303b28101d None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:42.747752 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 83/169] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:39:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:42.748950 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff9f2c-7559-4e1c-b527-3c303b28101d None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:42.765135 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa44e86-708f-492c-9b7d-b51aa574f5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:42.765973 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa44e86-708f-492c-9b7d-b51aa574f5ef None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:42.766489 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa44e86-708f-492c-9b7d-b51aa574f5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:42.766743 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa44e86-708f-492c-9b7d-b51aa574f5ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:42.855293 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:42.887174 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa44e86-708f-492c-9b7d-b51aa574f5ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:42.887409 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff9f2c-7559-4e1c-b527-3c303b28101d None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:42.889277 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa44e86-708f-492c-9b7d-b51aa574f5ef None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:42.898423 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:42.937128 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264bbc8-6c8b-4b2d-980c-db4ba3d39742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:42.938122 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264bbc8-6c8b-4b2d-980c-db4ba3d39742 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:42.938635 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264bbc8-6c8b-4b2d-980c-db4ba3d39742 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:42.939091 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264bbc8-6c8b-4b2d-980c-db4ba3d39742 None admin] PATH_INFO: `/v3/users/b5108aa3ec1f4fa59fb30f4446107485` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:42.943866 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264bbc8-6c8b-4b2d-980c-db4ba3d39742 None admin] RBAC: Authorizing `identity:get_user(user_id=b5108aa3ec1f4fa59fb30f4446107485)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:42.945542 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264bbc8-6c8b-4b2d-980c-db4ba3d39742 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:42.947871 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 84/170] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:39:42 2022] GET /identity/v3/users/b5108aa3ec1f4fa59fb30f4446107485 => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:42.948932 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264bbc8-6c8b-4b2d-980c-db4ba3d39742 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:43.032645 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 87/171] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:39:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:43.033846 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa44e86-708f-492c-9b7d-b51aa574f5ef None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:43.120122 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264bbc8-6c8b-4b2d-980c-db4ba3d39742 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:43.131844 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa44e86-708f-492c-9b7d-b51aa574f5ef None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:43.139774 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:43.174763 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19818839-8336-4e73-b654-8bc67a610e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:43.175689 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19818839-8336-4e73-b654-8bc67a610e8c None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:43.175978 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19818839-8336-4e73-b654-8bc67a610e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:43.176257 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19818839-8336-4e73-b654-8bc67a610e8c None admin] PATH_INFO: `/v3/users/ae7384e027454770bea6d011e8d5d6c6` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:43.178589 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19818839-8336-4e73-b654-8bc67a610e8c None admin] RBAC: Authorizing `identity:get_user(user_id=ae7384e027454770bea6d011e8d5d6c6)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:43.180104 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19818839-8336-4e73-b654-8bc67a610e8c None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:43.182063 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 85/172] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:39:42 2022] GET /identity/v3/users/ae7384e027454770bea6d011e8d5d6c6 => generated 247 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:43.182841 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19818839-8336-4e73-b654-8bc67a610e8c None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:43.193493 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa76cc-5a1b-4c05-b637-429a788e553c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:43.194160 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa76cc-5a1b-4c05-b637-429a788e553c None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:43.194446 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa76cc-5a1b-4c05-b637-429a788e553c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:43.194720 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa76cc-5a1b-4c05-b637-429a788e553c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:43.241570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:43.345434 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa76cc-5a1b-4c05-b637-429a788e553c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:43.346942 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa76cc-5a1b-4c05-b637-429a788e553c None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:43.379760 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19818839-8336-4e73-b654-8bc67a610e8c None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:43.454999 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a71ff-2aea-400d-9037-080132b3f1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:43.455928 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a71ff-2aea-400d-9037-080132b3f1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:43.456214 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a71ff-2aea-400d-9037-080132b3f1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:43.456495 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a71ff-2aea-400d-9037-080132b3f1b2 None admin] PATH_INFO: `/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:43.457718 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a71ff-2aea-400d-9037-080132b3f1b2 None admin] RBAC: Authorizing `identity:get_project(project_id=2ac825c0a6b546859d4dafd68f22a7ca)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:43.459223 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a71ff-2aea-400d-9037-080132b3f1b2 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:43.467424 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 86/173] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:39:43 2022] GET /identity/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:43.469194 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0eec8b-f9d3-4c15-af32-a0c489350824 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:43.469488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0eec8b-f9d3-4c15-af32-a0c489350824 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:43.469767 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0eec8b-f9d3-4c15-af32-a0c489350824 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:43.471370 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 87/174] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:43.472089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0eec8b-f9d3-4c15-af32-a0c489350824 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:43.485994 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 88/175] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:39:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:43.486860 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa76cc-5a1b-4c05-b637-429a788e553c None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:43.495458 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:43.591516 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa76cc-5a1b-4c05-b637-429a788e553c None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:43.632884 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b8634-8a41-4d23-bb11-3352f9818412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:43.633485 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b8634-8a41-4d23-bb11-3352f9818412 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:43.633766 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b8634-8a41-4d23-bb11-3352f9818412 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:43.634042 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b8634-8a41-4d23-bb11-3352f9818412 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:43.635346 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b8634-8a41-4d23-bb11-3352f9818412 None admin] RBAC: Adding query filter params (role.id=19b4d737ab92430caeb4cd548049bcfc, scope.project.id=2ac825c0a6b546859d4dafd68f22a7ca, user.id=b5108aa3ec1f4fa59fb30f4446107485) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:43.635665 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b8634-8a41-4d23-bb11-3352f9818412 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:43.643104 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b8634-8a41-4d23-bb11-3352f9818412 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:43.652495 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 89/176] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:39:43 2022] GET /identity/v3/role_assignments?user.id=b5108aa3ec1f4fa59fb30f4446107485&scope.project.id=2ac825c0a6b546859d4dafd68f22a7ca&role.id=19b4d737ab92430caeb4cd548049bcfc => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:43.656670 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b68bd-7a46-4704-a72d-42fea613abfe None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:43.656670 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b68bd-7a46-4704-a72d-42fea613abfe None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:43.656670 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b68bd-7a46-4704-a72d-42fea613abfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:43.684499 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-9c2b68bd-7a46-4704-a72d-42fea613abfe None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:43.686177 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:43.689500 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9c2b68bd-7a46-4704-a72d-42fea613abfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:43.714444 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0eec8b-f9d3-4c15-af32-a0c489350824 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:43.788177 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b23ded-d891-409a-b8a2-c835de39f4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:43.788872 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b23ded-d891-409a-b8a2-c835de39f4b1 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:43.789148 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b23ded-d891-409a-b8a2-c835de39f4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:43.789428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b23ded-d891-409a-b8a2-c835de39f4b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:43.845170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:43.854673 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 90/177] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:43.856531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b68bd-7a46-4704-a72d-42fea613abfe None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:43.935267 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b23ded-d891-409a-b8a2-c835de39f4b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:43.937314 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b23ded-d891-409a-b8a2-c835de39f4b1 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:44.022704 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b68bd-7a46-4704-a72d-42fea613abfe None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:44.062011 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:44.069218 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4fedd-fba3-4dfb-a971-962b2cb87093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:44.070107 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4fedd-fba3-4dfb-a971-962b2cb87093 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:44.071311 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4fedd-fba3-4dfb-a971-962b2cb87093 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:44.071311 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4fedd-fba3-4dfb-a971-962b2cb87093 None admin] PATH_INFO: `/v3/projects/f0f1591696ee4f588f3c1040938dc83b` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:44.072263 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc4fedd-fba3-4dfb-a971-962b2cb87093 None admin] RBAC: Authorizing `identity:get_project(project_id=f0f1591696ee4f588f3c1040938dc83b)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:44.073566 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 88/178] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:39:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:44.074037 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc4fedd-fba3-4dfb-a971-962b2cb87093 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:44.075824 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 91/179] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:39:43 2022] GET /identity/v3/projects/f0f1591696ee4f588f3c1040938dc83b => generated 312 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:44.075931 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b23ded-d891-409a-b8a2-c835de39f4b1 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:44.077060 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bd184-651a-4a67-8eab-dab11912b37e None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:44.077348 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bd184-651a-4a67-8eab-dab11912b37e None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:44.077625 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bd184-651a-4a67-8eab-dab11912b37e None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:44.079053 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 92/180] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:44.084452 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adb1d0-45eb-4d9c-af7e-3a7bac9441e5 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:44.084771 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adb1d0-45eb-4d9c-af7e-3a7bac9441e5 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:44.085012 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adb1d0-45eb-4d9c-af7e-3a7bac9441e5 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:44.086420 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 93/181] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:44.087448 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d17e7e-d324-4948-a2d2-8c590863a887 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:44.087731 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d17e7e-d324-4948-a2d2-8c590863a887 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:44.087997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d17e7e-d324-4948-a2d2-8c590863a887 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:44.089387 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 94/182] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:44.093978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d17e7e-d324-4948-a2d2-8c590863a887 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:44.159416 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:44.183665 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b23ded-d891-409a-b8a2-c835de39f4b1 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:44.196699 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d17e7e-d324-4948-a2d2-8c590863a887 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:44.218162 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb013e4-c943-431e-b0b3-74a1a135048b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:44.218963 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb013e4-c943-431e-b0b3-74a1a135048b None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:44.219271 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb013e4-c943-431e-b0b3-74a1a135048b None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:44.219540 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb013e4-c943-431e-b0b3-74a1a135048b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:44.229743 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb013e4-c943-431e-b0b3-74a1a135048b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:39:44.229982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2af0a4-2bc8-4979-ab6c-cce9574dcb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:44.230848 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2af0a4-2bc8-4979-ab6c-cce9574dcb8c None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:44.231130 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2af0a4-2bc8-4979-ab6c-cce9574dcb8c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:44.231433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2af0a4-2bc8-4979-ab6c-cce9574dcb8c None admin] PATH_INFO: `/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:44.232603 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2af0a4-2bc8-4979-ab6c-cce9574dcb8c None admin] RBAC: Authorizing `identity:get_project(project_id=2ac825c0a6b546859d4dafd68f22a7ca)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:44.234058 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2af0a4-2bc8-4979-ab6c-cce9574dcb8c None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:44.235803 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 95/183] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:39:44 2022] GET /identity/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:44.237104 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa0515-bf48-45ee-b01c-682461073875 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:44.237396 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa0515-bf48-45ee-b01c-682461073875 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:44.237669 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa0515-bf48-45ee-b01c-682461073875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:44.238661 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-8cb013e4-c943-431e-b0b3-74a1a135048b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:39:44.238661 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:44.238661 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:44.238661 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:44.238661 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:44.238661 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:44.238661 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:44.238661 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:44.238661 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:44.238661 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:44.238661 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:44.238661 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:44.238661 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:39:44.238661 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:39:44.238661 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:39:44.238661 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:39:44.239589 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:39:44.239589 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:39:44.239589 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:39:44.239589 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:39:44.239589 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:44.239589 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:44.239589 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:44.239589 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:44.239589 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:44.239589 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:44.239589 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:44.239589 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:44.239589 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:44.239589 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:44.239589 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:44.239589 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:44.242089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:44.242089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:44.242089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:44.242089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:44.242089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:39:44.242089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:39:44.242089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:39:44.242089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:39:44.242089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:39:44.242089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:39:44.242089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:39:44.242089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:39:44.242089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 89/184] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:39:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:39:44.242089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb013e4-c943-431e-b0b3-74a1a135048b None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:44.259448 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-63aa0515-bf48-45ee-b01c-682461073875 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:44.260806 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-63aa0515-bf48-45ee-b01c-682461073875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:44.292427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:44.327678 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 96/185] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:44.332499 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611a9ce-43bc-41c8-a1d0-611568acafd1 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:44.332795 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611a9ce-43bc-41c8-a1d0-611568acafd1 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:44.333078 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611a9ce-43bc-41c8-a1d0-611568acafd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:44.344878 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb013e4-c943-431e-b0b3-74a1a135048b None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:44.349831 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-0611a9ce-43bc-41c8-a1d0-611568acafd1 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:44.351112 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-0611a9ce-43bc-41c8-a1d0-611568acafd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:44.379950 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafecb3f-816c-4829-b2e4-5b88ce11637b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:44.380606 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafecb3f-816c-4829-b2e4-5b88ce11637b None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:44.380888 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafecb3f-816c-4829-b2e4-5b88ce11637b None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:44.381163 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafecb3f-816c-4829-b2e4-5b88ce11637b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:44.382263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafecb3f-816c-4829-b2e4-5b88ce11637b None admin] RBAC: Adding query filter params (role.id=4827ddfe1a0e476294ecf7f1d122cc32, scope.project.id=f0f1591696ee4f588f3c1040938dc83b, user.id=b5108aa3ec1f4fa59fb30f4446107485) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:44.382561 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafecb3f-816c-4829-b2e4-5b88ce11637b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:44.384037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafecb3f-816c-4829-b2e4-5b88ce11637b None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:44.389857 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 90/186] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:39:44 2022] GET /identity/v3/role_assignments?user.id=b5108aa3ec1f4fa59fb30f4446107485&scope.project.id=f0f1591696ee4f588f3c1040938dc83b&role.id=4827ddfe1a0e476294ecf7f1d122cc32 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:44.391078 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f587ca2-c4fd-44cf-932b-4345f961a550 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:44.391395 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f587ca2-c4fd-44cf-932b-4345f961a550 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:44.391672 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f587ca2-c4fd-44cf-932b-4345f961a550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:44.416197 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:44.421428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-9f587ca2-c4fd-44cf-932b-4345f961a550 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:44.422664 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-9f587ca2-c4fd-44cf-932b-4345f961a550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:44.425357 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 97/187] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:44.428160 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611a9ce-43bc-41c8-a1d0-611568acafd1 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:44.499614 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 91/188] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:44.500991 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f587ca2-c4fd-44cf-932b-4345f961a550 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:44.555565 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611a9ce-43bc-41c8-a1d0-611568acafd1 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:44.564394 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:44.600814 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74e91b-039c-4571-a395-c1172f5a0908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:44.601481 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74e91b-039c-4571-a395-c1172f5a0908 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:44.601764 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74e91b-039c-4571-a395-c1172f5a0908 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:44.602039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74e91b-039c-4571-a395-c1172f5a0908 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:44.602933 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74e91b-039c-4571-a395-c1172f5a0908 None admin] RBAC: Adding query filter params (role.id=4867b69c45554ce18e23167c05a02175, scope.project.id=2ac825c0a6b546859d4dafd68f22a7ca, user.id=ae7384e027454770bea6d011e8d5d6c6) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:44.603288 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74e91b-039c-4571-a395-c1172f5a0908 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:44.604926 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74e91b-039c-4571-a395-c1172f5a0908 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:44.611936 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 98/189] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:39:44 2022] GET /identity/v3/role_assignments?user.id=ae7384e027454770bea6d011e8d5d6c6&scope.project.id=2ac825c0a6b546859d4dafd68f22a7ca&role.id=4867b69c45554ce18e23167c05a02175 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:44.612750 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74e91b-039c-4571-a395-c1172f5a0908 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:44.661956 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f587ca2-c4fd-44cf-932b-4345f961a550 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:44.683423 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:44.703538 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a526ba-2b80-4847-8f84-fac11b21e053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:44.704344 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a526ba-2b80-4847-8f84-fac11b21e053 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:44.704692 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a526ba-2b80-4847-8f84-fac11b21e053 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:44.705059 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a526ba-2b80-4847-8f84-fac11b21e053 None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:44.705900 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a526ba-2b80-4847-8f84-fac11b21e053 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:44.706270 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a526ba-2b80-4847-8f84-fac11b21e053 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:44.707798 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a526ba-2b80-4847-8f84-fac11b21e053 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:44.718115 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 92/190] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:39:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:44.718115 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a526ba-2b80-4847-8f84-fac11b21e053 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:44.733758 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74e91b-039c-4571-a395-c1172f5a0908 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:44.773135 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82c141-bf9f-4b5b-a4fc-210f29ef0b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:44.774003 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82c141-bf9f-4b5b-a4fc-210f29ef0b33 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:44.774289 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82c141-bf9f-4b5b-a4fc-210f29ef0b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:44.774582 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82c141-bf9f-4b5b-a4fc-210f29ef0b33 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:44.776721 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a82c141-bf9f-4b5b-a4fc-210f29ef0b33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:44.778184 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a82c141-bf9f-4b5b-a4fc-210f29ef0b33 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:44.780807 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 99/191] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:39:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:44.785230 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82c141-bf9f-4b5b-a4fc-210f29ef0b33 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:44.829550 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a526ba-2b80-4847-8f84-fac11b21e053 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:44.837042 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:44.865787 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05753b-690f-4ff6-860c-599265bb808e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:44.866619 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05753b-690f-4ff6-860c-599265bb808e None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:44.866896 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05753b-690f-4ff6-860c-599265bb808e None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:44.867194 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05753b-690f-4ff6-860c-599265bb808e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:44.877886 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05753b-690f-4ff6-860c-599265bb808e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:39:44.886049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-bc05753b-690f-4ff6-860c-599265bb808e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:39:44.886049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:44.886049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:44.886049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:44.886049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:44.886049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:44.886049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:44.886049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:44.886049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:44.886049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:44.886049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:44.886049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:44.886049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:39:44.886049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:39:44.886049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:39:44.886049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:39:44.887133 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:39:44.887133 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:39:44.887133 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:39:44.887133 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:39:44.887133 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:44.887133 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:44.887133 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:44.887133 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:44.887133 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:44.887133 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:44.887133 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:44.887133 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:44.887133 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:44.887133 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:44.887133 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:44.887133 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:44.887964 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:44.887964 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:44.887964 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:44.887964 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:44.887964 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:39:44.887964 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:39:44.887964 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:39:44.887964 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:39:44.887964 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:39:44.887964 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:39:44.887964 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:39:44.887964 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:39:44.891392 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 93/192] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 10:39:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:39:44.892425 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05753b-690f-4ff6-860c-599265bb808e None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:44.902021 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82c141-bf9f-4b5b-a4fc-210f29ef0b33 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:44.927813 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:44.936428 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda6b5b-ed21-403e-b82f-06a74a22fa33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:44.937239 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda6b5b-ed21-403e-b82f-06a74a22fa33 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:44.937523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda6b5b-ed21-403e-b82f-06a74a22fa33 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:44.937800 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda6b5b-ed21-403e-b82f-06a74a22fa33 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:44.948147 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda6b5b-ed21-403e-b82f-06a74a22fa33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:39:44.955743 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-9dda6b5b-ed21-403e-b82f-06a74a22fa33 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:39:44.955743 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:44.955743 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:44.955743 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:44.955743 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:44.955743 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:44.955743 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:44.955743 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:44.955743 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:44.955743 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:44.955743 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:44.955743 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:44.955743 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:39:44.955743 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:39:44.955743 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:39:44.955743 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:39:44.956604 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:39:44.956604 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:39:44.956604 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:39:44.956604 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:39:44.956604 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:44.956604 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:44.956604 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:44.956604 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:44.956604 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:44.956604 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:44.956604 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:44.956604 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:44.956604 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:44.956604 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:44.956604 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:44.956604 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:44.957366 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:44.957366 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:44.957366 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:44.957366 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:44.957366 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:39:44.957366 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:39:44.957366 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:39:44.957366 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:39:44.957366 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:39:44.957366 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:39:44.957366 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:39:44.957366 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:39:44.957366 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 100/193] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:39:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:39:44.958024 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda6b5b-ed21-403e-b82f-06a74a22fa33 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:44.998806 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05753b-690f-4ff6-860c-599265bb808e None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:45.033567 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7119a-cda2-4ef9-b727-05e18f49602b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:45.034382 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7119a-cda2-4ef9-b727-05e18f49602b None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:45.034663 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7119a-cda2-4ef9-b727-05e18f49602b None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:45.034939 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7119a-cda2-4ef9-b727-05e18f49602b None admin] PATH_INFO: `/v3/users/678a7846b23044589cb9bc673c289dad` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:45.048431 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac7119a-cda2-4ef9-b727-05e18f49602b None admin] RBAC: Authorizing `identity:get_user(user_id=678a7846b23044589cb9bc673c289dad)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:45.049898 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac7119a-cda2-4ef9-b727-05e18f49602b None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:45.051589 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 94/194] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:39:44 2022] GET /identity/v3/users/678a7846b23044589cb9bc673c289dad => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:45.052349 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7119a-cda2-4ef9-b727-05e18f49602b None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:45.062758 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda6b5b-ed21-403e-b82f-06a74a22fa33 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:45.079170 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:45.097501 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74caee18-75a3-499c-9e7c-78b55dea7426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:45.098177 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74caee18-75a3-499c-9e7c-78b55dea7426 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:45.098461 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74caee18-75a3-499c-9e7c-78b55dea7426 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:45.098740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74caee18-75a3-499c-9e7c-78b55dea7426 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:45.099497 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74caee18-75a3-499c-9e7c-78b55dea7426 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:45.100943 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74caee18-75a3-499c-9e7c-78b55dea7426 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:45.121830 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 101/195] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 10:39:44 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:39:45.122860 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74caee18-75a3-499c-9e7c-78b55dea7426 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:45.167986 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7119a-cda2-4ef9-b727-05e18f49602b None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:45.176498 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:45.216193 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8815b01-ccac-46fc-b5e7-e7448778eb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:45.217052 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8815b01-ccac-46fc-b5e7-e7448778eb2f None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:45.217249 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8815b01-ccac-46fc-b5e7-e7448778eb2f None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:45.217494 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8815b01-ccac-46fc-b5e7-e7448778eb2f None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:45.218514 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8815b01-ccac-46fc-b5e7-e7448778eb2f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:45.218616 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8815b01-ccac-46fc-b5e7-e7448778eb2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:45.220026 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8815b01-ccac-46fc-b5e7-e7448778eb2f None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:45.233498 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 95/196] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:39:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:45.233498 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8815b01-ccac-46fc-b5e7-e7448778eb2f None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:45.249904 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74caee18-75a3-499c-9e7c-78b55dea7426 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:45.293853 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467cb346-c743-4239-9a40-1e557e45228f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:45.294548 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cb346-c743-4239-9a40-1e557e45228f None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:45.294548 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cb346-c743-4239-9a40-1e557e45228f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:45.294813 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cb346-c743-4239-9a40-1e557e45228f None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:45.295894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467cb346-c743-4239-9a40-1e557e45228f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:45.295894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467cb346-c743-4239-9a40-1e557e45228f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:45.297246 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467cb346-c743-4239-9a40-1e557e45228f None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:45.307439 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 102/197] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 10:39:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:45.308140 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467cb346-c743-4239-9a40-1e557e45228f None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:45.336429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:45.353712 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8815b01-ccac-46fc-b5e7-e7448778eb2f None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:45.396995 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd052052-2953-415d-9457-576bbe9e8f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:45.397987 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd052052-2953-415d-9457-576bbe9e8f01 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:45.398470 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd052052-2953-415d-9457-576bbe9e8f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:45.398918 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd052052-2953-415d-9457-576bbe9e8f01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:45.430602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467cb346-c743-4239-9a40-1e557e45228f None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:45.442051 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:45.474535 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a5156-3966-423e-8f11-62d71a6f45b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:45.475457 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a5156-3966-423e-8f11-62d71a6f45b6 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:45.475741 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a5156-3966-423e-8f11-62d71a6f45b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:45.476011 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a5156-3966-423e-8f11-62d71a6f45b6 None admin] PATH_INFO: `/v3/users/678a7846b23044589cb9bc673c289dad` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:45.477334 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a5156-3966-423e-8f11-62d71a6f45b6 None admin] RBAC: Authorizing `identity:get_user(user_id=678a7846b23044589cb9bc673c289dad)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:45.479361 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a5156-3966-423e-8f11-62d71a6f45b6 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:45.481248 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 103/198] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:39:45 2022] GET /identity/v3/users/678a7846b23044589cb9bc673c289dad => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:45.485665 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a5156-3966-423e-8f11-62d71a6f45b6 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:45.489683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd052052-2953-415d-9457-576bbe9e8f01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:45.491433 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd052052-2953-415d-9457-576bbe9e8f01 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:45.599875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:45.604356 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a5156-3966-423e-8f11-62d71a6f45b6 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:45.622449 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 96/199] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:39:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:45.623698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd052052-2953-415d-9457-576bbe9e8f01 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:45.649466 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96606a34-da8d-45aa-9275-a9cb07337ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:45.651217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96606a34-da8d-45aa-9275-a9cb07337ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:45.651865 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96606a34-da8d-45aa-9275-a9cb07337ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:45.652374 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96606a34-da8d-45aa-9275-a9cb07337ac1 None admin] PATH_INFO: `/v3/users/70e14dc04e6c45d3bbc98eb44394ff35` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:45.653830 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96606a34-da8d-45aa-9275-a9cb07337ac1 None admin] RBAC: Authorizing `identity:get_user(user_id=70e14dc04e6c45d3bbc98eb44394ff35)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:45.655611 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96606a34-da8d-45aa-9275-a9cb07337ac1 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:45.658105 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 104/200] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:39:45 2022] GET /identity/v3/users/70e14dc04e6c45d3bbc98eb44394ff35 => generated 289 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:45.659089 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96606a34-da8d-45aa-9275-a9cb07337ac1 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:45.705958 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:45.748631 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd052052-2953-415d-9457-576bbe9e8f01 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:45.771711 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96606a34-da8d-45aa-9275-a9cb07337ac1 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:45.792153 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64544bc-f5fe-42f7-a368-0b8ce4fed2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:45.793706 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64544bc-f5fe-42f7-a368-0b8ce4fed2fa None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:45.794183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64544bc-f5fe-42f7-a368-0b8ce4fed2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:45.794908 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64544bc-f5fe-42f7-a368-0b8ce4fed2fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:45.808359 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa9391-9dfc-439a-944b-f935acd38327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:45.809252 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa9391-9dfc-439a-944b-f935acd38327 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:45.809869 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa9391-9dfc-439a-944b-f935acd38327 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:45.809975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa9391-9dfc-439a-944b-f935acd38327 None admin] PATH_INFO: `/v3/projects/d72a8e31265a4e11b5e71c627e803005` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:45.811193 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa9391-9dfc-439a-944b-f935acd38327 None admin] RBAC: Authorizing `identity:get_project(project_id=d72a8e31265a4e11b5e71c627e803005)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:45.812700 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa9391-9dfc-439a-944b-f935acd38327 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:45.819946 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 105/201] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:39:45 2022] GET /identity/v3/projects/d72a8e31265a4e11b5e71c627e803005 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:45.819946 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa9391-9dfc-439a-944b-f935acd38327 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:45.867808 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:45.882932 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64544bc-f5fe-42f7-a368-0b8ce4fed2fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:45.884623 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64544bc-f5fe-42f7-a368-0b8ce4fed2fa None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:45.944275 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa9391-9dfc-439a-944b-f935acd38327 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:45.957814 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:45.988147 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1562cad-245d-47a4-88cc-15a112cd1ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:45.988814 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1562cad-245d-47a4-88cc-15a112cd1ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:45.989098 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1562cad-245d-47a4-88cc-15a112cd1ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:45.989367 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1562cad-245d-47a4-88cc-15a112cd1ab5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:45.994554 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 97/202] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:39:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:45.995740 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64544bc-f5fe-42f7-a368-0b8ce4fed2fa None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:46.077782 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1562cad-245d-47a4-88cc-15a112cd1ab5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:46.079650 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1562cad-245d-47a4-88cc-15a112cd1ab5 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:46.087675 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:46.106420 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64544bc-f5fe-42f7-a368-0b8ce4fed2fa None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:46.143575 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837827b4-959b-4932-8da6-d44fbededa40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:46.144570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837827b4-959b-4932-8da6-d44fbededa40 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:46.145153 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837827b4-959b-4932-8da6-d44fbededa40 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:46.145626 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837827b4-959b-4932-8da6-d44fbededa40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:46.146707 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837827b4-959b-4932-8da6-d44fbededa40 None admin] RBAC: Adding query filter params (role.id=4867b69c45554ce18e23167c05a02175, scope.project.id=d72a8e31265a4e11b5e71c627e803005, user.id=678a7846b23044589cb9bc673c289dad) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:46.147407 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837827b4-959b-4932-8da6-d44fbededa40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:46.149265 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837827b4-959b-4932-8da6-d44fbededa40 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:46.155527 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 98/203] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:39:45 2022] GET /identity/v3/role_assignments?user.id=678a7846b23044589cb9bc673c289dad&scope.project.id=d72a8e31265a4e11b5e71c627e803005&role.id=4867b69c45554ce18e23167c05a02175 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:46.156529 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837827b4-959b-4932-8da6-d44fbededa40 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:46.233906 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 106/204] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:39:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:46.240121 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1562cad-245d-47a4-88cc-15a112cd1ab5 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:46.260839 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:46.373323 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837827b4-959b-4932-8da6-d44fbededa40 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:46.439089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594b4a2-bf42-46dd-a7f6-11f0dfd6f422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:46.441821 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594b4a2-bf42-46dd-a7f6-11f0dfd6f422 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:46.443005 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594b4a2-bf42-46dd-a7f6-11f0dfd6f422 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:46.443527 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594b4a2-bf42-46dd-a7f6-11f0dfd6f422 None admin] PATH_INFO: `/v3/projects/d72a8e31265a4e11b5e71c627e803005` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:46.445533 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594b4a2-bf42-46dd-a7f6-11f0dfd6f422 None admin] RBAC: Authorizing `identity:get_project(project_id=d72a8e31265a4e11b5e71c627e803005)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:46.449089 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1562cad-245d-47a4-88cc-15a112cd1ab5 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:46.450012 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594b4a2-bf42-46dd-a7f6-11f0dfd6f422 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:46.453545 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 99/205] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:39:46 2022] GET /identity/v3/projects/d72a8e31265a4e11b5e71c627e803005 => generated 302 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:46.464087 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594b4a2-bf42-46dd-a7f6-11f0dfd6f422 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:46.502601 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ddd736-ddfc-437a-92d1-192d302218be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:46.504998 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddd736-ddfc-437a-92d1-192d302218be None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:46.505652 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddd736-ddfc-437a-92d1-192d302218be None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:46.507504 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddd736-ddfc-437a-92d1-192d302218be None admin] PATH_INFO: `/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:46.509462 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:46.510191 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ddd736-ddfc-437a-92d1-192d302218be None admin] RBAC: Authorizing `identity:get_project(project_id=2ac825c0a6b546859d4dafd68f22a7ca)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:46.516196 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ddd736-ddfc-437a-92d1-192d302218be None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:46.518417 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 107/206] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:39:46 2022] GET /identity/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:46.525044 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ddd736-ddfc-437a-92d1-192d302218be None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:46.640170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:46.672656 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594b4a2-bf42-46dd-a7f6-11f0dfd6f422 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:46.684471 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ddd736-ddfc-437a-92d1-192d302218be None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:46.726853 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f2077-7050-4d0a-80e9-81ad0ad2ae59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:46.727511 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f2077-7050-4d0a-80e9-81ad0ad2ae59 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:46.727841 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f2077-7050-4d0a-80e9-81ad0ad2ae59 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:46.728472 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f2077-7050-4d0a-80e9-81ad0ad2ae59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:46.729658 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f2077-7050-4d0a-80e9-81ad0ad2ae59 None admin] RBAC: Adding query filter params (role.id=19b4d737ab92430caeb4cd548049bcfc, scope.project.id=d72a8e31265a4e11b5e71c627e803005, user.id=678a7846b23044589cb9bc673c289dad) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:46.729969 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f2077-7050-4d0a-80e9-81ad0ad2ae59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:46.731493 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f2077-7050-4d0a-80e9-81ad0ad2ae59 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:46.739995 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 100/207] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:39:46 2022] GET /identity/v3/role_assignments?user.id=678a7846b23044589cb9bc673c289dad&scope.project.id=d72a8e31265a4e11b5e71c627e803005&role.id=19b4d737ab92430caeb4cd548049bcfc => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:46.745707 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e7583-3a06-425e-8161-fe7e1075a7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:46.746400 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e7583-3a06-425e-8161-fe7e1075a7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:46.746685 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e7583-3a06-425e-8161-fe7e1075a7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:46.746959 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e7583-3a06-425e-8161-fe7e1075a7a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:46.747850 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e7583-3a06-425e-8161-fe7e1075a7a4 None admin] RBAC: Adding query filter params (role.id=32aef7aad733481291827ac4c11ac6dd, scope.project.id=2ac825c0a6b546859d4dafd68f22a7ca, user.id=70e14dc04e6c45d3bbc98eb44394ff35) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:46.748165 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e7583-3a06-425e-8161-fe7e1075a7a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:46.749657 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e7583-3a06-425e-8161-fe7e1075a7a4 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:46.757088 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 108/208] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:39:46 2022] GET /identity/v3/role_assignments?user.id=70e14dc04e6c45d3bbc98eb44394ff35&scope.project.id=2ac825c0a6b546859d4dafd68f22a7ca&role.id=32aef7aad733481291827ac4c11ac6dd => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:39:47.411384 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc037b-cbae-437c-8d8b-fc10b336acd9 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:47.411946 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc037b-cbae-437c-8d8b-fc10b336acd9 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:47.411946 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc037b-cbae-437c-8d8b-fc10b336acd9 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:47.413575 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 101/209] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:47.419374 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252da36d-080c-4e0d-8704-3ef02ac7224c None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:47.419939 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252da36d-080c-4e0d-8704-3ef02ac7224c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:47.420408 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252da36d-080c-4e0d-8704-3ef02ac7224c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:47.430596 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed7ad7-d54b-48bf-bb53-5f91a21d8fe4 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:47.431826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed7ad7-d54b-48bf-bb53-5f91a21d8fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:47.432314 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed7ad7-d54b-48bf-bb53-5f91a21d8fe4 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:47.433888 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 102/210] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:47.438390 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-252da36d-080c-4e0d-8704-3ef02ac7224c None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:47.439508 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfb5e6-8e67-49ef-a220-9323eae81fe3 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:47.439613 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-252da36d-080c-4e0d-8704-3ef02ac7224c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:47.440098 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfb5e6-8e67-49ef-a220-9323eae81fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:47.440923 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfb5e6-8e67-49ef-a220-9323eae81fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:47.464459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-60dfb5e6-8e67-49ef-a220-9323eae81fe3 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:47.466686 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-60dfb5e6-8e67-49ef-a220-9323eae81fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:47.524503 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 109/211] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:47.549205 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252da36d-080c-4e0d-8704-3ef02ac7224c None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:47.559928 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 103/212] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:39:47.585158 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfb5e6-8e67-49ef-a220-9323eae81fe3 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:47.600246 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:47.625818 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:47.658160 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252da36d-080c-4e0d-8704-3ef02ac7224c None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:47.688218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfb5e6-8e67-49ef-a220-9323eae81fe3 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:47.695033 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe01cd-5ac4-44a1-91f7-bad5a5116b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:47.696051 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe01cd-5ac4-44a1-91f7-bad5a5116b80 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:47.696585 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe01cd-5ac4-44a1-91f7-bad5a5116b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:47.697466 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe01cd-5ac4-44a1-91f7-bad5a5116b80 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:47.708265 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe01cd-5ac4-44a1-91f7-bad5a5116b80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:39:47.716983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-c2fe01cd-5ac4-44a1-91f7-bad5a5116b80 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:39:47.716983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:47.716983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:47.716983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:47.716983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:47.716983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:47.716983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:47.716983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:47.716983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:47.716983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:47.716983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:47.716983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:47.716983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:39:47.716983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:39:47.716983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:39:47.716983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:39:47.717873 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:39:47.717873 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:39:47.717873 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:39:47.717873 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:39:47.717873 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:47.717873 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:47.717873 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:47.717873 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:47.717873 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:47.717873 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:47.717873 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:47.717873 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:47.717873 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:47.717873 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:47.717873 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:47.717873 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:47.718667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:47.718667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:47.718667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:47.718667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:47.718667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:39:47.718667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:39:47.718667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:39:47.718667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:39:47.718667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:39:47.718667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:39:47.718667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:39:47.718667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:39:47.721442 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 110/213] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:39:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:39:47.725178 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de95f1-e076-46be-8258-b83d2340725c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:47.726163 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de95f1-e076-46be-8258-b83d2340725c None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:47.726621 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de95f1-e076-46be-8258-b83d2340725c None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:47.727532 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de95f1-e076-46be-8258-b83d2340725c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:47.727809 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe01cd-5ac4-44a1-91f7-bad5a5116b80 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:47.729244 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de95f1-e076-46be-8258-b83d2340725c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:47.730767 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de95f1-e076-46be-8258-b83d2340725c None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:47.737031 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 104/214] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:39:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:47.738618 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de95f1-e076-46be-8258-b83d2340725c None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:47.819555 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:47.838502 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe01cd-5ac4-44a1-91f7-bad5a5116b80 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:47.839742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de95f1-e076-46be-8258-b83d2340725c None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:47.871030 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:47.876172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14ad4a-0107-437d-8807-91c2a5133f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:47.876962 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14ad4a-0107-437d-8807-91c2a5133f9c None admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:47.877307 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14ad4a-0107-437d-8807-91c2a5133f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:47.877676 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14ad4a-0107-437d-8807-91c2a5133f9c None admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:47.878473 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14ad4a-0107-437d-8807-91c2a5133f9c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:47.878805 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41dd7f-2e93-4a49-80d1-aab40c0a2a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:47.879699 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41dd7f-2e93-4a49-80d1-aab40c0a2a0c None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:47.880157 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14ad4a-0107-437d-8807-91c2a5133f9c None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:47.880260 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41dd7f-2e93-4a49-80d1-aab40c0a2a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:47.880720 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41dd7f-2e93-4a49-80d1-aab40c0a2a0c None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:47.881746 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e41dd7f-2e93-4a49-80d1-aab40c0a2a0c None admin] RBAC: Adding query filter params (name=member) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:47.882219 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e41dd7f-2e93-4a49-80d1-aab40c0a2a0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:47.883813 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e41dd7f-2e93-4a49-80d1-aab40c0a2a0c None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:47.894680 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 111/215] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 10:39:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:47.901243 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41dd7f-2e93-4a49-80d1-aab40c0a2a0c None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:47.907659 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 105/216] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 10:39:47 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:39:48.031064 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41dd7f-2e93-4a49-80d1-aab40c0a2a0c None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:48.071705 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647a2e2-2818-4618-8624-f30b14c5e99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:48.073490 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647a2e2-2818-4618-8624-f30b14c5e99f None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:48.074056 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647a2e2-2818-4618-8624-f30b14c5e99f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:48.074507 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647a2e2-2818-4618-8624-f30b14c5e99f None admin] PATH_INFO: `/v3/users/2cfbd5bb2f5d4c1d94167a55d5506a9b` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:48.089818 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647a2e2-2818-4618-8624-f30b14c5e99f None admin] RBAC: Authorizing `identity:get_user(user_id=2cfbd5bb2f5d4c1d94167a55d5506a9b)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:48.091606 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647a2e2-2818-4618-8624-f30b14c5e99f None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:48.093511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 112/217] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:39:47 2022] GET /identity/v3/users/2cfbd5bb2f5d4c1d94167a55d5506a9b => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:48.101962 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14ad4a-0107-437d-8807-91c2a5133f9c None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:48.216816 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14ad4a-0107-437d-8807-91c2a5133f9c None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:48.253350 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fc139-1743-44ea-b8dc-20c7b27e65fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:48.254022 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fc139-1743-44ea-b8dc-20c7b27e65fb None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:48.254300 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fc139-1743-44ea-b8dc-20c7b27e65fb None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:48.254579 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fc139-1743-44ea-b8dc-20c7b27e65fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:48.260818 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:48.338966 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9fc139-1743-44ea-b8dc-20c7b27e65fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:48.340394 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9fc139-1743-44ea-b8dc-20c7b27e65fb None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:48.455492 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9da942-7a84-411a-b900-6e50f7d066fd None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:48.455815 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9da942-7a84-411a-b900-6e50f7d066fd None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:48.456051 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9da942-7a84-411a-b900-6e50f7d066fd None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:48.457427 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 113/218] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:48.462973 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387722e6-349d-4724-8cd6-9c07598c9078 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:48.463474 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387722e6-349d-4724-8cd6-9c07598c9078 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:48.463762 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387722e6-349d-4724-8cd6-9c07598c9078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:48.464584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 106/219] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:39:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:48.470972 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fc139-1743-44ea-b8dc-20c7b27e65fb None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:48.482164 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-387722e6-349d-4724-8cd6-9c07598c9078 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:48.483598 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-387722e6-349d-4724-8cd6-9c07598c9078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:48.523577 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:48.535225 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:48.568590 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 114/220] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:39:48.594560 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387722e6-349d-4724-8cd6-9c07598c9078 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:48.649072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fc139-1743-44ea-b8dc-20c7b27e65fb None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:48.715805 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387722e6-349d-4724-8cd6-9c07598c9078 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:48.751902 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7996b6d-0d2b-4860-b3c7-dab4a00dec69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:48.752814 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7996b6d-0d2b-4860-b3c7-dab4a00dec69 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:48.753118 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7996b6d-0d2b-4860-b3c7-dab4a00dec69 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:48.753381 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7996b6d-0d2b-4860-b3c7-dab4a00dec69 None admin] PATH_INFO: `/v3/projects/d72a8e31265a4e11b5e71c627e803005` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:48.755487 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c38bf-5d45-405e-8979-7e28537798b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:48.756524 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c38bf-5d45-405e-8979-7e28537798b9 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:48.757009 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c38bf-5d45-405e-8979-7e28537798b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:48.757468 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c38bf-5d45-405e-8979-7e28537798b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:48.759935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7996b6d-0d2b-4860-b3c7-dab4a00dec69 None admin] RBAC: Authorizing `identity:get_project(project_id=d72a8e31265a4e11b5e71c627e803005)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:48.765594 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7996b6d-0d2b-4860-b3c7-dab4a00dec69 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:48.765594 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 107/221] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:39:48 2022] GET /identity/v3/projects/d72a8e31265a4e11b5e71c627e803005 => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:39:48.772687 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7996b6d-0d2b-4860-b3c7-dab4a00dec69 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:48.785747 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c38bf-5d45-405e-8979-7e28537798b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:39:48.799978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-ff6c38bf-5d45-405e-8979-7e28537798b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:39:48.799978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:48.799978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:48.799978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:48.799978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:48.799978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:48.799978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:48.799978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:48.799978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:48.799978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:48.799978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:48.799978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:48.799978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:39:48.799978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:39:48.799978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:39:48.799978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:39:48.801229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:39:48.801229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:39:48.801229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:39:48.801229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:39:48.801229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:48.801229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:48.801229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:48.801229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:48.801229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:48.801229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:48.801229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:48.801229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:48.801229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:48.801229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:48.801229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:48.801229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:48.802206 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:48.802206 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:48.802206 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:48.802206 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:48.802206 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:39:48.802206 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:39:48.802206 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:39:48.802206 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:39:48.802206 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:39:48.802206 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:39:48.802206 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:39:48.802206 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:39:48.802206 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 115/222] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:39:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:39:48.806548 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c38bf-5d45-405e-8979-7e28537798b9 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:48.890629 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:48.917153 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7996b6d-0d2b-4860-b3c7-dab4a00dec69 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:48.920397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:48.956145 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c38bf-5d45-405e-8979-7e28537798b9 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:48.963728 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33125d-dcca-41c6-8bcc-dd5cecc1dc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:48.964943 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33125d-dcca-41c6-8bcc-dd5cecc1dc92 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:48.965231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33125d-dcca-41c6-8bcc-dd5cecc1dc92 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:48.965511 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33125d-dcca-41c6-8bcc-dd5cecc1dc92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:48.966369 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33125d-dcca-41c6-8bcc-dd5cecc1dc92 None admin] RBAC: Adding query filter params (role.id=4827ddfe1a0e476294ecf7f1d122cc32, scope.project.id=d72a8e31265a4e11b5e71c627e803005, user.id=2cfbd5bb2f5d4c1d94167a55d5506a9b) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:48.966684 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33125d-dcca-41c6-8bcc-dd5cecc1dc92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:48.968761 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33125d-dcca-41c6-8bcc-dd5cecc1dc92 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:48.983311 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 108/223] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:39:48 2022] GET /identity/v3/role_assignments?user.id=2cfbd5bb2f5d4c1d94167a55d5506a9b&scope.project.id=d72a8e31265a4e11b5e71c627e803005&role.id=4827ddfe1a0e476294ecf7f1d122cc32 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:48.986422 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63167a5-1511-4411-bbda-59b7a53c77d2 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:48.987113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63167a5-1511-4411-bbda-59b7a53c77d2 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:48.989045 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63167a5-1511-4411-bbda-59b7a53c77d2 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:48.990737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 109/224] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:48.998280 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c40dbe-6d82-44c6-8304-698182f007d0 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:48.998604 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c40dbe-6d82-44c6-8304-698182f007d0 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:49.000377 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c40dbe-6d82-44c6-8304-698182f007d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:49.020247 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ab1af-1391-472e-ab56-9e4cb0b48032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:49.020951 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ab1af-1391-472e-ab56-9e4cb0b48032 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:49.021231 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ab1af-1391-472e-ab56-9e4cb0b48032 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:49.021503 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ab1af-1391-472e-ab56-9e4cb0b48032 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:49.022296 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ab1af-1391-472e-ab56-9e4cb0b48032 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:49.022597 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ab1af-1391-472e-ab56-9e4cb0b48032 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:49.024052 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ab1af-1391-472e-ab56-9e4cb0b48032 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:49.036893 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-66c40dbe-6d82-44c6-8304-698182f007d0 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:49.038145 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-66c40dbe-6d82-44c6-8304-698182f007d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:49.043999 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 116/225] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:39:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:39:49.049814 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ab1af-1391-472e-ab56-9e4cb0b48032 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:49.181481 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ab1af-1391-472e-ab56-9e4cb0b48032 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:49.183945 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:49.186160 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 110/226] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:49.214114 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c40dbe-6d82-44c6-8304-698182f007d0 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:49.238421 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888010f-f1b7-41bf-9ae2-227e98d53fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:49.239403 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888010f-f1b7-41bf-9ae2-227e98d53fac None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:49.239647 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888010f-f1b7-41bf-9ae2-227e98d53fac None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:49.239910 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888010f-f1b7-41bf-9ae2-227e98d53fac None admin] PATH_INFO: `/v3/users/678a7846b23044589cb9bc673c289dad` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:49.241218 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888010f-f1b7-41bf-9ae2-227e98d53fac None admin] RBAC: Authorizing `identity:get_user(user_id=678a7846b23044589cb9bc673c289dad)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:49.242695 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888010f-f1b7-41bf-9ae2-227e98d53fac None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:49.245002 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 117/227] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:39:49 2022] GET /identity/v3/users/678a7846b23044589cb9bc673c289dad => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:49.250272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888010f-f1b7-41bf-9ae2-227e98d53fac None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:49.354642 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888010f-f1b7-41bf-9ae2-227e98d53fac None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:49.358603 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:49.362483 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c40dbe-6d82-44c6-8304-698182f007d0 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:49.398685 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3a73f-47d9-4982-92db-be00edce6394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:49.399612 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3a73f-47d9-4982-92db-be00edce6394 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:49.400089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3a73f-47d9-4982-92db-be00edce6394 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:49.400438 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3a73f-47d9-4982-92db-be00edce6394 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:49.411222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3a73f-47d9-4982-92db-be00edce6394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:39:49.411854 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc2b1c-4025-48b2-ab64-64e4888a50e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:49.412741 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc2b1c-4025-48b2-ab64-64e4888a50e6 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:49.413025 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc2b1c-4025-48b2-ab64-64e4888a50e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:49.413300 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc2b1c-4025-48b2-ab64-64e4888a50e6 None admin] PATH_INFO: `/v3/projects/d72a8e31265a4e11b5e71c627e803005` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:49.414520 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc2b1c-4025-48b2-ab64-64e4888a50e6 None admin] RBAC: Authorizing `identity:get_project(project_id=d72a8e31265a4e11b5e71c627e803005)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:49.416361 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc2b1c-4025-48b2-ab64-64e4888a50e6 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:49.418407 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 118/228] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:39:49 2022] GET /identity/v3/projects/d72a8e31265a4e11b5e71c627e803005 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:49.419543 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-93a3a73f-47d9-4982-92db-be00edce6394 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:39:49.419543 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:49.419543 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:49.419543 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:49.419543 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:49.419543 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:49.419543 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:49.419543 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:49.419543 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:49.419543 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:49.419543 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:49.419543 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:49.419543 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:39:49.419543 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:39:49.419543 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:39:49.419543 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:39:49.420414 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:39:49.420414 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:39:49.420414 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:39:49.420414 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:39:49.420414 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:49.420414 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:49.420414 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:49.420414 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:49.420414 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:49.420414 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:49.420414 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:49.420414 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:49.420414 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:49.420414 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:49.420414 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:49.420414 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:49.421210 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:49.421210 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:49.421210 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:49.421210 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:49.421210 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:39:49.421210 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:39:49.421210 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:39:49.421210 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:39:49.421210 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:39:49.421210 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:39:49.421210 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:39:49.421210 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:39:49.421210 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 111/229] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 10:39:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:39:49.426295 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc2b1c-4025-48b2-ab64-64e4888a50e6 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:49.428012 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3a73f-47d9-4982-92db-be00edce6394 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:49.472720 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:49.532953 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc2b1c-4025-48b2-ab64-64e4888a50e6 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:49.569221 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9ca7e-2b42-4202-8bfc-05133146a529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:49.570137 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9ca7e-2b42-4202-8bfc-05133146a529 None admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:49.570414 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9ca7e-2b42-4202-8bfc-05133146a529 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:49.570687 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9ca7e-2b42-4202-8bfc-05133146a529 None admin] PATH_INFO: `/v3/projects/d72a8e31265a4e11b5e71c627e803005/users/678a7846b23044589cb9bc673c289dad/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:49.573047 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9ca7e-2b42-4202-8bfc-05133146a529 None admin] RBAC: Authorizing `identity:create_grant(project_id=d72a8e31265a4e11b5e71c627e803005, user_id=678a7846b23044589cb9bc673c289dad, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:49.574536 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9ca7e-2b42-4202-8bfc-05133146a529 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:49.590693 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 119/230] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 10:39:49 2022] PUT /identity/v3/projects/d72a8e31265a4e11b5e71c627e803005/users/678a7846b23044589cb9bc673c289dad/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:39:49.630310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3a73f-47d9-4982-92db-be00edce6394 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:49.668855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6130c-4764-4b7d-b299-5223aeb9815f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:49.669593 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6130c-4764-4b7d-b299-5223aeb9815f None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:49.669882 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6130c-4764-4b7d-b299-5223aeb9815f None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:49.670160 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6130c-4764-4b7d-b299-5223aeb9815f None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:49.670928 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6130c-4764-4b7d-b299-5223aeb9815f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:49.671266 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6130c-4764-4b7d-b299-5223aeb9815f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:49.672697 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6130c-4764-4b7d-b299-5223aeb9815f None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:49.683085 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 112/231] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:39:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:39:49.688468 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9ca7e-2b42-4202-8bfc-05133146a529 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:49.809963 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:49.813122 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9ca7e-2b42-4202-8bfc-05133146a529 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:49.849102 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b961d9d-8b6d-4e53-8831-21b8ff6f0eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:49.849999 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b961d9d-8b6d-4e53-8831-21b8ff6f0eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:49.850284 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b961d9d-8b6d-4e53-8831-21b8ff6f0eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:49.850556 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b961d9d-8b6d-4e53-8831-21b8ff6f0eb3 None admin] PATH_INFO: `/v3/users/678a7846b23044589cb9bc673c289dad` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:49.851785 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b961d9d-8b6d-4e53-8831-21b8ff6f0eb3 None admin] RBAC: Authorizing `identity:get_user(user_id=678a7846b23044589cb9bc673c289dad)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:49.853307 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b961d9d-8b6d-4e53-8831-21b8ff6f0eb3 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:49.855332 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 120/232] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:39:49 2022] GET /identity/v3/users/678a7846b23044589cb9bc673c289dad => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:49.864274 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6130c-4764-4b7d-b299-5223aeb9815f None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:49.901145 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:49.968400 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6130c-4764-4b7d-b299-5223aeb9815f None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:50.004572 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4a396-0375-4db1-beaa-ff9ff8a5c396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:50.005461 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4a396-0375-4db1-beaa-ff9ff8a5c396 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:50.005749 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4a396-0375-4db1-beaa-ff9ff8a5c396 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:50.006026 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4a396-0375-4db1-beaa-ff9ff8a5c396 None admin] PATH_INFO: `/v3/projects/d72a8e31265a4e11b5e71c627e803005` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:50.007318 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4a396-0375-4db1-beaa-ff9ff8a5c396 None admin] RBAC: Authorizing `identity:get_project(project_id=d72a8e31265a4e11b5e71c627e803005)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:50.008864 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4a396-0375-4db1-beaa-ff9ff8a5c396 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:50.010938 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 113/233] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:39:49 2022] GET /identity/v3/projects/d72a8e31265a4e11b5e71c627e803005 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:50.016646 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b961d9d-8b6d-4e53-8831-21b8ff6f0eb3 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:50.121817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b961d9d-8b6d-4e53-8831-21b8ff6f0eb3 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:50.157285 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ecfe3-bc7c-41b3-bbec-26c4e873281a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:50.158204 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ecfe3-bc7c-41b3-bbec-26c4e873281a None admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:50.158489 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ecfe3-bc7c-41b3-bbec-26c4e873281a None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:50.158766 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ecfe3-bc7c-41b3-bbec-26c4e873281a None admin] PATH_INFO: `/v3/projects/d72a8e31265a4e11b5e71c627e803005/users/678a7846b23044589cb9bc673c289dad/roles/19b4d737ab92430caeb4cd548049bcfc` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:50.161068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ecfe3-bc7c-41b3-bbec-26c4e873281a None admin] RBAC: Authorizing `identity:create_grant(project_id=d72a8e31265a4e11b5e71c627e803005, user_id=678a7846b23044589cb9bc673c289dad, role_id=19b4d737ab92430caeb4cd548049bcfc)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:50.162529 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ecfe3-bc7c-41b3-bbec-26c4e873281a None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:50.183094 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 121/234] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 10:39:50 2022] PUT /identity/v3/projects/d72a8e31265a4e11b5e71c627e803005/users/678a7846b23044589cb9bc673c289dad/roles/19b4d737ab92430caeb4cd548049bcfc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:39:50.524052 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cb942-e958-431f-adc5-f43e30cc186a None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:50.524507 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cb942-e958-431f-adc5-f43e30cc186a None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:50.524902 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cb942-e958-431f-adc5-f43e30cc186a None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:50.526661 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 114/235] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:50.532242 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487685a-05d5-4714-9d51-85d08308f700 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:50.532530 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487685a-05d5-4714-9d51-85d08308f700 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:50.532811 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487685a-05d5-4714-9d51-85d08308f700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:50.554044 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-2487685a-05d5-4714-9d51-85d08308f700 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:50.555286 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-2487685a-05d5-4714-9d51-85d08308f700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:50.582904 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:50.638712 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 122/236] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:50.671456 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cb942-e958-431f-adc5-f43e30cc186a None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:50.696079 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87489091-ecd9-431b-a23d-130dea861930 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:50.696423 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87489091-ecd9-431b-a23d-130dea861930 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:50.696718 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87489091-ecd9-431b-a23d-130dea861930 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:50.698834 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 123/237] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:39:50.704715 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3329b5-271d-4bd9-b359-f5d614caa6fe None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:50.705022 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3329b5-271d-4bd9-b359-f5d614caa6fe None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:50.705293 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3329b5-271d-4bd9-b359-f5d614caa6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:50.733199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-cf3329b5-271d-4bd9-b359-f5d614caa6fe None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:50.734402 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-cf3329b5-271d-4bd9-b359-f5d614caa6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:50.779381 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:50.793389 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cb942-e958-431f-adc5-f43e30cc186a None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:50.831389 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f5ba5-c424-46c4-ae40-8919e2656830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:50.832365 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f5ba5-c424-46c4-ae40-8919e2656830 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:50.832755 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f5ba5-c424-46c4-ae40-8919e2656830 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:50.833108 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f5ba5-c424-46c4-ae40-8919e2656830 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:50.844940 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f5ba5-c424-46c4-ae40-8919e2656830 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:39:50.853625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-c23f5ba5-c424-46c4-ae40-8919e2656830 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:39:50.853625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:50.853625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:50.853625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:50.853625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:50.853625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:50.853625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:50.853625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:50.853625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:50.853625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:50.853625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:50.853625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:50.853625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:39:50.853625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:39:50.853625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:39:50.853625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:39:50.854539 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:39:50.854539 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:39:50.854539 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:39:50.854539 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:39:50.854539 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:50.854539 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:50.854539 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:50.854539 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:50.854539 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:50.854539 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:50.854539 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:50.854539 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:50.854539 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:50.854539 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:50.854539 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:50.854539 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:50.855381 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:50.855381 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:50.855381 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:50.855381 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:50.855381 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:39:50.855381 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:39:50.855381 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:39:50.855381 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:39:50.855381 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:39:50.855381 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:39:50.855381 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:39:50.855381 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:39:50.855381 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 115/238] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:39:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:39:50.861659 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f5ba5-c424-46c4-ae40-8919e2656830 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:50.970069 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f5ba5-c424-46c4-ae40-8919e2656830 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:50.971212 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 124/239] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:39:51.007046 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9f663-eb9b-4ae2-85f0-9b41b2990241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:51.007878 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9f663-eb9b-4ae2-85f0-9b41b2990241 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:51.008232 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9f663-eb9b-4ae2-85f0-9b41b2990241 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:51.008448 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3329b5-271d-4bd9-b359-f5d614caa6fe None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:51.008682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9f663-eb9b-4ae2-85f0-9b41b2990241 None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:51.009668 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9f663-eb9b-4ae2-85f0-9b41b2990241 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:51.010043 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9f663-eb9b-4ae2-85f0-9b41b2990241 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:51.012779 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9f663-eb9b-4ae2-85f0-9b41b2990241 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:51.026574 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 116/240] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 10:39:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:39:51.027827 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9f663-eb9b-4ae2-85f0-9b41b2990241 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:51.041775 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:51.138320 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9f663-eb9b-4ae2-85f0-9b41b2990241 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:51.175318 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e58960-9832-4e02-b3a8-d45b49b464bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:51.176640 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e58960-9832-4e02-b3a8-d45b49b464bc None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:51.176996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e58960-9832-4e02-b3a8-d45b49b464bc None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:51.177344 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e58960-9832-4e02-b3a8-d45b49b464bc None admin] PATH_INFO: `/v3/users/d51bc959781a4ef49d9bff84a5abaf18` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:51.193653 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e58960-9832-4e02-b3a8-d45b49b464bc None admin] RBAC: Authorizing `identity:get_user(user_id=d51bc959781a4ef49d9bff84a5abaf18)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:51.195272 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e58960-9832-4e02-b3a8-d45b49b464bc None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:51.201538 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 117/241] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:39:51 2022] GET /identity/v3/users/d51bc959781a4ef49d9bff84a5abaf18 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:39:51.203537 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e58960-9832-4e02-b3a8-d45b49b464bc None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:51.278655 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:51.314718 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:51.317092 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e58960-9832-4e02-b3a8-d45b49b464bc None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:51.356070 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bb3ed-d0cd-4f73-93b5-1b6431390570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:51.357112 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bb3ed-d0cd-4f73-93b5-1b6431390570 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:51.357411 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bb3ed-d0cd-4f73-93b5-1b6431390570 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:51.357691 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bb3ed-d0cd-4f73-93b5-1b6431390570 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:51.369705 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3329b5-271d-4bd9-b359-f5d614caa6fe None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:51.430699 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801bb3ed-d0cd-4f73-93b5-1b6431390570 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:51.432340 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801bb3ed-d0cd-4f73-93b5-1b6431390570 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:51.486978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612403d-ca1e-41e9-8750-73e12403a2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:51.487823 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612403d-ca1e-41e9-8750-73e12403a2bc None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:51.488103 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612403d-ca1e-41e9-8750-73e12403a2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:51.488373 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612403d-ca1e-41e9-8750-73e12403a2bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:51.489561 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612403d-ca1e-41e9-8750-73e12403a2bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:51.491026 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612403d-ca1e-41e9-8750-73e12403a2bc None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:51.499575 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 125/242] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:39:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 492 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:39:51.504644 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612403d-ca1e-41e9-8750-73e12403a2bc None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:51.505222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:51.540643 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 118/243] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:39:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 10:39:51.547321 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bb3ed-d0cd-4f73-93b5-1b6431390570 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:51.662890 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bb3ed-d0cd-4f73-93b5-1b6431390570 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:51.705715 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176b168-194a-4ee1-a5b0-4cd588452b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:51.707483 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176b168-194a-4ee1-a5b0-4cd588452b80 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:51.707910 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176b168-194a-4ee1-a5b0-4cd588452b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:51.708357 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176b168-194a-4ee1-a5b0-4cd588452b80 None admin] PATH_INFO: `/v3/projects/d72a8e31265a4e11b5e71c627e803005` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:51.716680 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3176b168-194a-4ee1-a5b0-4cd588452b80 None admin] RBAC: Authorizing `identity:get_project(project_id=d72a8e31265a4e11b5e71c627e803005)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:51.718432 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3176b168-194a-4ee1-a5b0-4cd588452b80 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:51.727810 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 119/244] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:39:51 2022] GET /identity/v3/projects/d72a8e31265a4e11b5e71c627e803005 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:51.730356 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176b168-194a-4ee1-a5b0-4cd588452b80 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:51.774112 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:51.800785 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612403d-ca1e-41e9-8750-73e12403a2bc None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:51.876170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56093731-0d6e-4016-9228-db36d2a0b2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:51.877251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56093731-0d6e-4016-9228-db36d2a0b2c1 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:51.877730 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56093731-0d6e-4016-9228-db36d2a0b2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:51.878206 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56093731-0d6e-4016-9228-db36d2a0b2c1 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:51.879311 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56093731-0d6e-4016-9228-db36d2a0b2c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:51.880174 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176b168-194a-4ee1-a5b0-4cd588452b80 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:51.881198 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56093731-0d6e-4016-9228-db36d2a0b2c1 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:51.907647 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 126/245] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 10:39:51 2022] POST /identity/v3/users => generated 293 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:39:51.910599 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4383431-353a-49b9-8041-3e9dbc0fbe9e None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:51.911325 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4383431-353a-49b9-8041-3e9dbc0fbe9e None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:51.911812 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4383431-353a-49b9-8041-3e9dbc0fbe9e None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:51.913701 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 127/246] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:51.922981 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9aac7c-06d6-4af4-bcc5-942a5e61514b None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:51.923689 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9aac7c-06d6-4af4-bcc5-942a5e61514b None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:51.924178 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9aac7c-06d6-4af4-bcc5-942a5e61514b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:51.926142 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ef0a5-d205-4f56-b766-68ab1424696f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:51.927225 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ef0a5-d205-4f56-b766-68ab1424696f None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:51.927710 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ef0a5-d205-4f56-b766-68ab1424696f None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:51.928175 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ef0a5-d205-4f56-b766-68ab1424696f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:51.929237 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ef0a5-d205-4f56-b766-68ab1424696f None admin] RBAC: Adding query filter params (role.id=32aef7aad733481291827ac4c11ac6dd, scope.project.id=d72a8e31265a4e11b5e71c627e803005, user.id=d51bc959781a4ef49d9bff84a5abaf18) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:51.929746 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ef0a5-d205-4f56-b766-68ab1424696f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:51.932551 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ef0a5-d205-4f56-b766-68ab1424696f None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:51.940397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 120/247] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:39:51 2022] GET /identity/v3/role_assignments?user.id=d51bc959781a4ef49d9bff84a5abaf18&scope.project.id=d72a8e31265a4e11b5e71c627e803005&role.id=32aef7aad733481291827ac4c11ac6dd => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:51.961469 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-2d9aac7c-06d6-4af4-bcc5-942a5e61514b None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:51.963029 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-2d9aac7c-06d6-4af4-bcc5-942a5e61514b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:51.980409 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:52.082083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 128/248] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:52.125875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ef0a5-d205-4f56-b766-68ab1424696f None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:52.141473 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75a6f5-c956-4435-8454-d5404b52bb54 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:52.141798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75a6f5-c956-4435-8454-d5404b52bb54 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:52.142044 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75a6f5-c956-4435-8454-d5404b52bb54 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:52.143571 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 129/249] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:39:52.152439 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f5be4-cbcd-4020-9eb0-067c8ff8d409 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:52.153050 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f5be4-cbcd-4020-9eb0-067c8ff8d409 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:52.153533 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f5be4-cbcd-4020-9eb0-067c8ff8d409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:52.177648 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-5f6f5be4-cbcd-4020-9eb0-067c8ff8d409 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:52.179142 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5f6f5be4-cbcd-4020-9eb0-067c8ff8d409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:52.263585 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:52.266738 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ef0a5-d205-4f56-b766-68ab1424696f None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:52.320365 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c53774-61d7-4c42-ae10-8561c94d97d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:52.321287 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c53774-61d7-4c42-ae10-8561c94d97d6 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:52.321685 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c53774-61d7-4c42-ae10-8561c94d97d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:52.322507 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c53774-61d7-4c42-ae10-8561c94d97d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:52.323236 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 130/250] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:52.337151 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c53774-61d7-4c42-ae10-8561c94d97d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:39:52.345563 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f5be4-cbcd-4020-9eb0-067c8ff8d409 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:52.345824 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-68c53774-61d7-4c42-ae10-8561c94d97d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:39:52.345824 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:52.345824 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:52.345824 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:52.345824 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:52.345824 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:52.345824 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:52.345824 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:52.345824 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:52.345824 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:52.345824 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:52.345824 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:52.345824 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:39:52.345824 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:39:52.345824 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:39:52.345824 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:39:52.346688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:39:52.346688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:39:52.346688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:39:52.346688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:39:52.346688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:52.346688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:52.346688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:52.346688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:52.346688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:52.346688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:52.346688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:52.346688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:52.346688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:52.346688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:52.346688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:52.346688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:52.347562 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:52.347562 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:52.347562 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:52.347562 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:52.347562 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:39:52.347562 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:39:52.347562 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:39:52.347562 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:39:52.347562 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:39:52.347562 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:39:52.347562 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:39:52.347562 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:39:52.351302 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 121/251] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:39:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:39:52.354077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c53774-61d7-4c42-ae10-8561c94d97d6 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:52.453911 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:52.489507 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f5be4-cbcd-4020-9eb0-067c8ff8d409 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:52.492827 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c53774-61d7-4c42-ae10-8561c94d97d6 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:52.533176 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190aa6e-ba45-4846-9a87-1628e279904b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:52.534012 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190aa6e-ba45-4846-9a87-1628e279904b None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:52.534299 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190aa6e-ba45-4846-9a87-1628e279904b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:52.534579 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190aa6e-ba45-4846-9a87-1628e279904b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:52.548670 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f160d-8881-47c4-b0dd-6370d0ee8f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:52.549368 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f160d-8881-47c4-b0dd-6370d0ee8f75 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:52.549654 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f160d-8881-47c4-b0dd-6370d0ee8f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:52.549936 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f160d-8881-47c4-b0dd-6370d0ee8f75 None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:52.550707 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f160d-8881-47c4-b0dd-6370d0ee8f75 None admin] RBAC: Adding query filter params (name=member) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:52.551021 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f160d-8881-47c4-b0dd-6370d0ee8f75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:52.552444 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f160d-8881-47c4-b0dd-6370d0ee8f75 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:52.558860 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4190aa6e-ba45-4846-9a87-1628e279904b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:39:52.567090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-4190aa6e-ba45-4846-9a87-1628e279904b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:39:52.567090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:52.567090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:52.567090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:52.567090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:52.567090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:52.567090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:52.567090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:52.567090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:52.567090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:52.567090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:52.567090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:52.567090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:39:52.567090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:39:52.567090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:39:52.567090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:39:52.568025 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:39:52.568025 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:39:52.568025 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:39:52.568025 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:39:52.568025 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:52.568025 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:52.568025 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:52.568025 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:52.568025 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:52.568025 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:52.568025 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:52.568025 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:52.568025 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:52.568025 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:52.568025 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:52.568025 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:52.568798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:52.568798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:52.568798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:52.568798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:52.568798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:39:52.568798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:39:52.568798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:39:52.568798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:39:52.568798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:39:52.568798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:39:52.568798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:39:52.568798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:39:52.571901 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 131/252] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:39:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:39:52.579905 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190aa6e-ba45-4846-9a87-1628e279904b None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:52.582338 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 122/253] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 10:39:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:39:52.592520 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f160d-8881-47c4-b0dd-6370d0ee8f75 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:52.648999 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:52.803993 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190aa6e-ba45-4846-9a87-1628e279904b None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:52.851378 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:52.863226 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f160d-8881-47c4-b0dd-6370d0ee8f75 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:52.863842 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f0c8e-2e56-4223-81f1-b8f0dced6b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:52.864719 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f0c8e-2e56-4223-81f1-b8f0dced6b48 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:52.865173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f0c8e-2e56-4223-81f1-b8f0dced6b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:52.865592 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f0c8e-2e56-4223-81f1-b8f0dced6b48 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:52.866513 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f0c8e-2e56-4223-81f1-b8f0dced6b48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:52.866979 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f0c8e-2e56-4223-81f1-b8f0dced6b48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:52.868486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f0c8e-2e56-4223-81f1-b8f0dced6b48 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:52.885312 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 132/254] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:39:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:39:52.886690 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0be14-b334-4535-bf50-3bff41f50d3f None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:52.886980 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0be14-b334-4535-bf50-3bff41f50d3f None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:52.887287 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0be14-b334-4535-bf50-3bff41f50d3f None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:52.888659 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 133/255] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:52.894782 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1d26e-e80b-4233-9cf0-e478b1a75707 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:52.895071 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1d26e-e80b-4233-9cf0-e478b1a75707 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:52.895369 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1d26e-e80b-4233-9cf0-e478b1a75707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:52.914144 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-b2b1d26e-e80b-4233-9cf0-e478b1a75707 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:52.916259 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b2b1d26e-e80b-4233-9cf0-e478b1a75707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:52.916865 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c12ab8-8f60-48f8-b126-03ebed026eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:52.917780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c12ab8-8f60-48f8-b126-03ebed026eed None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:52.918062 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c12ab8-8f60-48f8-b126-03ebed026eed None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:52.918338 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c12ab8-8f60-48f8-b126-03ebed026eed None admin] PATH_INFO: `/v3/users/2cfbd5bb2f5d4c1d94167a55d5506a9b` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:52.923997 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c12ab8-8f60-48f8-b126-03ebed026eed None admin] RBAC: Authorizing `identity:get_user(user_id=2cfbd5bb2f5d4c1d94167a55d5506a9b)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:52.925472 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c12ab8-8f60-48f8-b126-03ebed026eed None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:52.927531 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 123/256] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:39:52 2022] GET /identity/v3/users/2cfbd5bb2f5d4c1d94167a55d5506a9b => generated 297 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:52.928383 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c12ab8-8f60-48f8-b126-03ebed026eed None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:53.027306 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 134/257] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:53.028884 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1d26e-e80b-4233-9cf0-e478b1a75707 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:53.083599 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:53.100946 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c12ab8-8f60-48f8-b126-03ebed026eed None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:53.161959 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54527a-489c-4b5e-8d0f-9ce64b72e57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:53.162926 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54527a-489c-4b5e-8d0f-9ce64b72e57e None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:53.163456 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54527a-489c-4b5e-8d0f-9ce64b72e57e None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:53.163745 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54527a-489c-4b5e-8d0f-9ce64b72e57e None admin] PATH_INFO: `/v3/users/678a7846b23044589cb9bc673c289dad` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:53.166720 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54527a-489c-4b5e-8d0f-9ce64b72e57e None admin] RBAC: Authorizing `identity:get_user(user_id=678a7846b23044589cb9bc673c289dad)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:53.168206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54527a-489c-4b5e-8d0f-9ce64b72e57e None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:53.171997 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 124/258] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:39:52 2022] GET /identity/v3/users/678a7846b23044589cb9bc673c289dad => generated 283 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:53.173528 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54527a-489c-4b5e-8d0f-9ce64b72e57e None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:53.213919 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1d26e-e80b-4233-9cf0-e478b1a75707 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:53.256591 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:53.278281 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad0def-b730-470a-ba5a-a0d86fc95152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:53.279328 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad0def-b730-470a-ba5a-a0d86fc95152 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:53.279699 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad0def-b730-470a-ba5a-a0d86fc95152 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:53.280036 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad0def-b730-470a-ba5a-a0d86fc95152 None admin] PATH_INFO: `/v3/projects/d72a8e31265a4e11b5e71c627e803005` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:53.282544 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad0def-b730-470a-ba5a-a0d86fc95152 None admin] RBAC: Authorizing `identity:get_project(project_id=d72a8e31265a4e11b5e71c627e803005)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:53.284110 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad0def-b730-470a-ba5a-a0d86fc95152 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:53.288513 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 135/259] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:39:53 2022] GET /identity/v3/projects/d72a8e31265a4e11b5e71c627e803005 => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:53.289328 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad0def-b730-470a-ba5a-a0d86fc95152 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:53.366501 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54527a-489c-4b5e-8d0f-9ce64b72e57e None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:53.433739 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5381872-4ed7-4364-865d-7fff3c965540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:53.434580 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5381872-4ed7-4364-865d-7fff3c965540 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:53.434870 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5381872-4ed7-4364-865d-7fff3c965540 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:53.435173 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5381872-4ed7-4364-865d-7fff3c965540 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:53.461560 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5381872-4ed7-4364-865d-7fff3c965540 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:39:53.468665 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad0def-b730-470a-ba5a-a0d86fc95152 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:53.479176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-d5381872-4ed7-4364-865d-7fff3c965540 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:39:53.479176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:53.479176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:53.479176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:53.479176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:53.479176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:53.479176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:53.479176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:53.479176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:53.479176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:53.479176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:53.479176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:53.479176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:39:53.479176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:39:53.479176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:39:53.479176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:39:53.480077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:39:53.480077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:39:53.480077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:39:53.480077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:39:53.480077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:53.480077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:53.480077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:53.480077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:53.480077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:53.480077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:53.480077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:53.480077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:53.480077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:53.480077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:53.480077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:53.480077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:53.480965 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:53.480965 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:53.480965 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:53.480965 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:53.480965 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:39:53.480965 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:39:53.480965 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:39:53.480965 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:39:53.480965 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:39:53.480965 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:39:53.480965 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:39:53.480965 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:39:53.483062 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 125/260] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 10:39:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:39:53.484617 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5381872-4ed7-4364-865d-7fff3c965540 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:53.531493 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:53.540164 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049cd67-b317-4354-b644-30568b59595d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:53.542843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049cd67-b317-4354-b644-30568b59595d None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:53.543141 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049cd67-b317-4354-b644-30568b59595d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:53.543463 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049cd67-b317-4354-b644-30568b59595d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:53.665435 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:53.681933 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1049cd67-b317-4354-b644-30568b59595d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:53.683441 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1049cd67-b317-4354-b644-30568b59595d None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:53.696999 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5381872-4ed7-4364-865d-7fff3c965540 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:53.737041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0255ad-3ed2-46e9-a884-81e41a34a981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:53.738310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0255ad-3ed2-46e9-a884-81e41a34a981 None admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:53.738740 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0255ad-3ed2-46e9-a884-81e41a34a981 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:53.739191 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0255ad-3ed2-46e9-a884-81e41a34a981 None admin] PATH_INFO: `/v3/projects/d72a8e31265a4e11b5e71c627e803005/users/2cfbd5bb2f5d4c1d94167a55d5506a9b/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:53.741330 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0255ad-3ed2-46e9-a884-81e41a34a981 None admin] RBAC: Authorizing `identity:create_grant(project_id=d72a8e31265a4e11b5e71c627e803005, user_id=2cfbd5bb2f5d4c1d94167a55d5506a9b, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:53.743093 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0255ad-3ed2-46e9-a884-81e41a34a981 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:53.756899 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 126/261] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 10:39:53 2022] PUT /identity/v3/projects/d72a8e31265a4e11b5e71c627e803005/users/2cfbd5bb2f5d4c1d94167a55d5506a9b/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:39:53.758041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0255ad-3ed2-46e9-a884-81e41a34a981 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:53.853751 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 136/262] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:39:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:53.858747 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:53.859329 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049cd67-b317-4354-b644-30568b59595d None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:53.874290 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0255ad-3ed2-46e9-a884-81e41a34a981 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:53.912104 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d8ed8-4e4e-4242-ad8f-4c61e5574d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:53.913339 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d8ed8-4e4e-4242-ad8f-4c61e5574d66 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:53.913774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d8ed8-4e4e-4242-ad8f-4c61e5574d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:53.914363 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d8ed8-4e4e-4242-ad8f-4c61e5574d66 None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:53.915415 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d8ed8-4e4e-4242-ad8f-4c61e5574d66 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:53.916118 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d8ed8-4e4e-4242-ad8f-4c61e5574d66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:53.917709 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d8ed8-4e4e-4242-ad8f-4c61e5574d66 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:53.927919 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 127/263] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:39:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:53.934278 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d8ed8-4e4e-4242-ad8f-4c61e5574d66 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:54.049876 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d8ed8-4e4e-4242-ad8f-4c61e5574d66 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:54.083099 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:54.089500 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ccc44-6163-4ee8-8228-44004a5c3cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:54.090629 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ccc44-6163-4ee8-8228-44004a5c3cce None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:54.091184 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ccc44-6163-4ee8-8228-44004a5c3cce None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:54.091605 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ccc44-6163-4ee8-8228-44004a5c3cce None admin] PATH_INFO: `/v3/users/678a7846b23044589cb9bc673c289dad` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:54.093071 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ccc44-6163-4ee8-8228-44004a5c3cce None admin] RBAC: Authorizing `identity:get_user(user_id=678a7846b23044589cb9bc673c289dad)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:54.094687 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ccc44-6163-4ee8-8228-44004a5c3cce None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:54.101914 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 128/264] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:39:53 2022] GET /identity/v3/users/678a7846b23044589cb9bc673c289dad => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:54.103124 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ccc44-6163-4ee8-8228-44004a5c3cce None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:54.107320 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049cd67-b317-4354-b644-30568b59595d None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:54.118278 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:54.218000 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ccc44-6163-4ee8-8228-44004a5c3cce None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:54.221157 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568b46a-d43c-49b5-ba54-f4f40a0ef5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:54.222016 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568b46a-d43c-49b5-ba54-f4f40a0ef5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:54.222303 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568b46a-d43c-49b5-ba54-f4f40a0ef5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:54.222585 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568b46a-d43c-49b5-ba54-f4f40a0ef5a7 None admin] PATH_INFO: `/v3/projects/d72a8e31265a4e11b5e71c627e803005` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:54.228332 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568b46a-d43c-49b5-ba54-f4f40a0ef5a7 None admin] RBAC: Authorizing `identity:get_project(project_id=d72a8e31265a4e11b5e71c627e803005)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:54.229494 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568b46a-d43c-49b5-ba54-f4f40a0ef5a7 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:54.231611 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 137/265] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:39:53 2022] GET /identity/v3/projects/d72a8e31265a4e11b5e71c627e803005 => generated 302 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:54.240161 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568b46a-d43c-49b5-ba54-f4f40a0ef5a7 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:54.257749 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a552e2d-b68a-4b4a-85a0-966c40bce3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:54.258805 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a552e2d-b68a-4b4a-85a0-966c40bce3ce None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:54.259919 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a552e2d-b68a-4b4a-85a0-966c40bce3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:54.260766 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a552e2d-b68a-4b4a-85a0-966c40bce3ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:54.340016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a552e2d-b68a-4b4a-85a0-966c40bce3ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:54.341884 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a552e2d-b68a-4b4a-85a0-966c40bce3ce None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:54.358408 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:54.454052 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 129/266] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:39:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:54.460335 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a552e2d-b68a-4b4a-85a0-966c40bce3ce None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:54.596209 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a552e2d-b68a-4b4a-85a0-966c40bce3ce None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:54.607857 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:54.634186 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568b46a-d43c-49b5-ba54-f4f40a0ef5a7 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:54.640183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f3f7c-bb1b-43b3-90d4-b0e9b4d3adf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:54.641075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f3f7c-bb1b-43b3-90d4-b0e9b4d3adf7 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:54.641357 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f3f7c-bb1b-43b3-90d4-b0e9b4d3adf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:54.641630 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f3f7c-bb1b-43b3-90d4-b0e9b4d3adf7 None admin] PATH_INFO: `/v3/projects/d72a8e31265a4e11b5e71c627e803005` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:54.649592 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f3f7c-bb1b-43b3-90d4-b0e9b4d3adf7 None admin] RBAC: Authorizing `identity:get_project(project_id=d72a8e31265a4e11b5e71c627e803005)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:54.651722 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f3f7c-bb1b-43b3-90d4-b0e9b4d3adf7 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:54.662556 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 130/267] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:39:54 2022] GET /identity/v3/projects/d72a8e31265a4e11b5e71c627e803005 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:54.667222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a767794-1113-4c06-9c91-65ad6a89af12 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:54.667512 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a767794-1113-4c06-9c91-65ad6a89af12 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:54.667787 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a767794-1113-4c06-9c91-65ad6a89af12 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:54.669161 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 131/268] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:54.669866 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a767794-1113-4c06-9c91-65ad6a89af12 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:54.694281 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5eb7c-4eeb-4158-9bc8-72941eec0837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:54.694948 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5eb7c-4eeb-4158-9bc8-72941eec0837 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:54.695260 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5eb7c-4eeb-4158-9bc8-72941eec0837 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:54.695536 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5eb7c-4eeb-4158-9bc8-72941eec0837 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:54.696462 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5eb7c-4eeb-4158-9bc8-72941eec0837 None admin] RBAC: Adding query filter params (role.id=4867b69c45554ce18e23167c05a02175, scope.project.id=d72a8e31265a4e11b5e71c627e803005, user.id=678a7846b23044589cb9bc673c289dad) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:54.697284 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5eb7c-4eeb-4158-9bc8-72941eec0837 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:54.698809 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5eb7c-4eeb-4158-9bc8-72941eec0837 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:54.705409 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 138/269] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:39:54 2022] GET /identity/v3/role_assignments?user.id=678a7846b23044589cb9bc673c289dad&scope.project.id=d72a8e31265a4e11b5e71c627e803005&role.id=4867b69c45554ce18e23167c05a02175 => generated 608 bytes in 466 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:54.707103 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bef673-8dc8-49d6-a4d9-5dc4d10eeff6 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:54.707504 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bef673-8dc8-49d6-a4d9-5dc4d10eeff6 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:54.707781 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bef673-8dc8-49d6-a4d9-5dc4d10eeff6 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:54.709058 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 139/270] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:54.710114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903ead3-3083-4a91-a5f0-a280e75ca8db None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:54.710399 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903ead3-3083-4a91-a5f0-a280e75ca8db None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:54.710676 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903ead3-3083-4a91-a5f0-a280e75ca8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:54.732192 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-d903ead3-3083-4a91-a5f0-a280e75ca8db None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:54.734998 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-d903ead3-3083-4a91-a5f0-a280e75ca8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:54.777619 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:54.832234 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 140/271] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:54.839589 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610112d-7727-467a-ae32-8d9605c5abb8 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:54.840115 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610112d-7727-467a-ae32-8d9605c5abb8 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:54.840406 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610112d-7727-467a-ae32-8d9605c5abb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:54.868719 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-7610112d-7727-467a-ae32-8d9605c5abb8 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:54.870080 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-7610112d-7727-467a-ae32-8d9605c5abb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:54.922999 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a767794-1113-4c06-9c91-65ad6a89af12 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:54.958675 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fbdba-8aa6-49d2-9f81-6d63238983c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:54.959400 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fbdba-8aa6-49d2-9f81-6d63238983c1 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:54.959687 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fbdba-8aa6-49d2-9f81-6d63238983c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:54.959966 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fbdba-8aa6-49d2-9f81-6d63238983c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:54.961025 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0fbdba-8aa6-49d2-9f81-6d63238983c1 None admin] RBAC: Adding query filter params (role.id=19b4d737ab92430caeb4cd548049bcfc, scope.project.id=d72a8e31265a4e11b5e71c627e803005, user.id=678a7846b23044589cb9bc673c289dad) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:54.963101 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0fbdba-8aa6-49d2-9f81-6d63238983c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:54.963892 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0fbdba-8aa6-49d2-9f81-6d63238983c1 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:54.965306 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 141/272] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:54.967296 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610112d-7727-467a-ae32-8d9605c5abb8 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:54.977355 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 132/273] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:39:54 2022] GET /identity/v3/role_assignments?user.id=678a7846b23044589cb9bc673c289dad&scope.project.id=d72a8e31265a4e11b5e71c627e803005&role.id=19b4d737ab92430caeb4cd548049bcfc => generated 608 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:54.993612 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fbdba-8aa6-49d2-9f81-6d63238983c1 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:55.043609 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:55.090635 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:55.111006 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610112d-7727-467a-ae32-8d9605c5abb8 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:55.155005 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fbdba-8aa6-49d2-9f81-6d63238983c1 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:55.171054 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1aa479-56e0-4c98-a671-471add8f0c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:55.172351 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1aa479-56e0-4c98-a671-471add8f0c0f None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:55.172865 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1aa479-56e0-4c98-a671-471add8f0c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:55.175489 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1aa479-56e0-4c98-a671-471add8f0c0f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:55.188772 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1aa479-56e0-4c98-a671-471add8f0c0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:39:55.201384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-5c1aa479-56e0-4c98-a671-471add8f0c0f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:39:55.201384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:55.201384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:55.201384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:55.201384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:55.201384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:55.201384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:55.201384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:55.201384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:55.201384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:55.201384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:55.201384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:55.201384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:39:55.201384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:39:55.201384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:39:55.201384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:39:55.202324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:39:55.202324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:39:55.202324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:39:55.202324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:39:55.202324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:55.202324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:55.202324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:55.202324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:55.202324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:55.202324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:55.202324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:55.202324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:55.202324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:55.202324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:55.202324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:55.202324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:55.203110 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:55.203110 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:55.203110 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:55.203110 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:55.203110 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:39:55.203110 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:39:55.203110 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:39:55.203110 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:39:55.203110 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:39:55.203110 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:39:55.203110 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:39:55.203110 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:39:55.204295 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c3af4-b50b-4c7d-919d-e4071cc42fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:55.204668 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c3af4-b50b-4c7d-919d-e4071cc42fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:55.204953 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c3af4-b50b-4c7d-919d-e4071cc42fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:55.205231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c3af4-b50b-4c7d-919d-e4071cc42fc2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:55.206952 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 142/274] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:39:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:39:55.208773 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8102c0-4f3b-40f8-9753-c3ba2d5a7693 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:55.209265 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8102c0-4f3b-40f8-9753-c3ba2d5a7693 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:55.209773 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8102c0-4f3b-40f8-9753-c3ba2d5a7693 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:55.212258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 143/275] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:55.214258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8102c0-4f3b-40f8-9753-c3ba2d5a7693 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:55.223654 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c3af4-b50b-4c7d-919d-e4071cc42fc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:39:55.231615 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-633c3af4-b50b-4c7d-919d-e4071cc42fc2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:39:55.231615 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:55.231615 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:55.231615 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:55.231615 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:55.231615 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:55.231615 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:55.231615 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:55.231615 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:55.231615 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:55.231615 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:55.231615 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:55.231615 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:39:55.231615 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:39:55.231615 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:39:55.231615 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:39:55.232534 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:39:55.232534 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:39:55.232534 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:39:55.232534 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:39:55.232534 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:55.232534 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:55.232534 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:55.232534 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:55.232534 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:55.232534 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:55.232534 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:55.232534 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:55.232534 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:55.232534 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:55.232534 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:55.232534 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:55.234118 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:55.234118 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:55.234118 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:55.234118 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:55.234118 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:39:55.234118 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:39:55.234118 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:39:55.234118 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:39:55.234118 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:39:55.234118 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:39:55.234118 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:39:55.234118 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:39:55.234118 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 133/276] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:39:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:39:55.234805 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c4ef2-0aec-4797-9066-dfe908b0a341 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:55.234805 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c4ef2-0aec-4797-9066-dfe908b0a341 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:55.234929 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c4ef2-0aec-4797-9066-dfe908b0a341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:55.261430 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-523c4ef2-0aec-4797-9066-dfe908b0a341 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:55.263003 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-523c4ef2-0aec-4797-9066-dfe908b0a341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:55.338535 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8102c0-4f3b-40f8-9753-c3ba2d5a7693 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:55.350512 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 134/277] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:55.351831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c4ef2-0aec-4797-9066-dfe908b0a341 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:55.386807 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:55.390349 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d5f50-afc5-4317-8c1d-703161732db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:55.391218 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d5f50-afc5-4317-8c1d-703161732db7 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:55.391496 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d5f50-afc5-4317-8c1d-703161732db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:55.391773 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d5f50-afc5-4317-8c1d-703161732db7 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:55.392528 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d5f50-afc5-4317-8c1d-703161732db7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:55.392842 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d5f50-afc5-4317-8c1d-703161732db7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:55.394242 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d5f50-afc5-4317-8c1d-703161732db7 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:55.404376 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 144/278] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 10:39:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:55.405246 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d5f50-afc5-4317-8c1d-703161732db7 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:55.414394 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:55.482852 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c4ef2-0aec-4797-9066-dfe908b0a341 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:55.512347 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d5f50-afc5-4317-8c1d-703161732db7 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:55.522162 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d50c39-3c26-4967-ba8d-efe697db83ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:55.522844 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d50c39-3c26-4967-ba8d-efe697db83ee None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:55.523134 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d50c39-3c26-4967-ba8d-efe697db83ee None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:55.523435 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d50c39-3c26-4967-ba8d-efe697db83ee None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:55.524223 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d50c39-3c26-4967-ba8d-efe697db83ee None admin] RBAC: Adding query filter params (name=reader) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:55.524688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d50c39-3c26-4967-ba8d-efe697db83ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:55.526539 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d50c39-3c26-4967-ba8d-efe697db83ee None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:55.539189 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 135/279] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 10:39:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:55.539189 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d50c39-3c26-4967-ba8d-efe697db83ee None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:55.552577 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5e000-1a71-4ef4-9adb-785b8385a9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:55.553394 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5e000-1a71-4ef4-9adb-785b8385a9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:55.553678 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5e000-1a71-4ef4-9adb-785b8385a9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:55.553955 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5e000-1a71-4ef4-9adb-785b8385a9f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:55.555131 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5e000-1a71-4ef4-9adb-785b8385a9f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:55.556657 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5e000-1a71-4ef4-9adb-785b8385a9f3 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:55.558524 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 145/280] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:39:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:55.563705 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5e000-1a71-4ef4-9adb-785b8385a9f3 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:55.639731 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:55.643315 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:55.650467 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d50c39-3c26-4967-ba8d-efe697db83ee None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:55.673445 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5e000-1a71-4ef4-9adb-785b8385a9f3 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:55.687442 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad65a1f-bc1d-4037-acec-081e6e393ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:55.688330 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad65a1f-bc1d-4037-acec-081e6e393ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:55.688614 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad65a1f-bc1d-4037-acec-081e6e393ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:55.688886 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad65a1f-bc1d-4037-acec-081e6e393ee4 None admin] PATH_INFO: `/v3/users/852158c4756241bb8cdb92c4f8f864b4` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:55.704406 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad65a1f-bc1d-4037-acec-081e6e393ee4 None admin] RBAC: Authorizing `identity:get_user(user_id=852158c4756241bb8cdb92c4f8f864b4)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:55.706075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad65a1f-bc1d-4037-acec-081e6e393ee4 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:55.713180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 136/281] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:39:55 2022] GET /identity/v3/users/852158c4756241bb8cdb92c4f8f864b4 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:55.713180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad65a1f-bc1d-4037-acec-081e6e393ee4 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:55.716331 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6eeddd-4d00-4ad6-b43b-de17dd013630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:55.717222 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6eeddd-4d00-4ad6-b43b-de17dd013630 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:55.717502 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6eeddd-4d00-4ad6-b43b-de17dd013630 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:55.717780 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6eeddd-4d00-4ad6-b43b-de17dd013630 None admin] PATH_INFO: `/v3/users/d51bc959781a4ef49d9bff84a5abaf18` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:55.718984 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6eeddd-4d00-4ad6-b43b-de17dd013630 None admin] RBAC: Authorizing `identity:get_user(user_id=d51bc959781a4ef49d9bff84a5abaf18)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:55.720497 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6eeddd-4d00-4ad6-b43b-de17dd013630 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:55.722134 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 146/282] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:39:55 2022] GET /identity/v3/users/d51bc959781a4ef49d9bff84a5abaf18 => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:55.722888 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6eeddd-4d00-4ad6-b43b-de17dd013630 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:55.820636 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad65a1f-bc1d-4037-acec-081e6e393ee4 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:55.829954 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6eeddd-4d00-4ad6-b43b-de17dd013630 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:55.858661 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f79d51-52f0-44e0-9e13-67cdcbc3203c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:55.859397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f79d51-52f0-44e0-9e13-67cdcbc3203c None admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:55.859680 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f79d51-52f0-44e0-9e13-67cdcbc3203c None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:55.860162 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f79d51-52f0-44e0-9e13-67cdcbc3203c None admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:55.860664 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f79d51-52f0-44e0-9e13-67cdcbc3203c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:55.862105 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f79d51-52f0-44e0-9e13-67cdcbc3203c None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:55.864702 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1a2d6-49c4-40bf-96ac-620a9dd3d538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:55.865359 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1a2d6-49c4-40bf-96ac-620a9dd3d538 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:55.865641 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1a2d6-49c4-40bf-96ac-620a9dd3d538 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:55.866505 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1a2d6-49c4-40bf-96ac-620a9dd3d538 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:55.867394 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1a2d6-49c4-40bf-96ac-620a9dd3d538 None admin] RBAC: Adding query filter params (role.id=4827ddfe1a0e476294ecf7f1d122cc32, user.id=852158c4756241bb8cdb92c4f8f864b4, scope.system=all) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:55.867704 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1a2d6-49c4-40bf-96ac-620a9dd3d538 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:55.869715 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1a2d6-49c4-40bf-96ac-620a9dd3d538 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:55.876112 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 147/283] 10.222.0.16 () {56 vars in 1308 bytes} [Fri Jun 24 10:39:55 2022] GET /identity/v3/role_assignments?user.id=852158c4756241bb8cdb92c4f8f864b4&scope.system=all&role.id=4827ddfe1a0e476294ecf7f1d122cc32 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:55.877063 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1a2d6-49c4-40bf-96ac-620a9dd3d538 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:55.888388 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:55.899230 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 137/284] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 10:39:55 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:39:56.015800 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1a2d6-49c4-40bf-96ac-620a9dd3d538 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:56.057130 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed92fe-6b9c-4883-8c95-101a0a2d95d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:56.058326 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed92fe-6b9c-4883-8c95-101a0a2d95d0 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:56.058745 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed92fe-6b9c-4883-8c95-101a0a2d95d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:56.059187 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed92fe-6b9c-4883-8c95-101a0a2d95d0 None admin] PATH_INFO: `/v3/projects/d72a8e31265a4e11b5e71c627e803005` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:56.060644 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed92fe-6b9c-4883-8c95-101a0a2d95d0 None admin] RBAC: Authorizing `identity:get_project(project_id=d72a8e31265a4e11b5e71c627e803005)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:56.062247 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed92fe-6b9c-4883-8c95-101a0a2d95d0 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:56.064500 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 148/285] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:39:55 2022] GET /identity/v3/projects/d72a8e31265a4e11b5e71c627e803005 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:56.070802 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f79d51-52f0-44e0-9e13-67cdcbc3203c None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:56.081715 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:56.188914 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f79d51-52f0-44e0-9e13-67cdcbc3203c None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:56.229222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd04707-8d57-4f56-ada5-4f8a3a5402a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:56.230138 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd04707-8d57-4f56-ada5-4f8a3a5402a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:56.230417 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd04707-8d57-4f56-ada5-4f8a3a5402a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:56.230693 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd04707-8d57-4f56-ada5-4f8a3a5402a4 None admin] PATH_INFO: `/v3/projects/d72a8e31265a4e11b5e71c627e803005/users/d51bc959781a4ef49d9bff84a5abaf18/roles/32aef7aad733481291827ac4c11ac6dd` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:56.232729 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd04707-8d57-4f56-ada5-4f8a3a5402a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d72a8e31265a4e11b5e71c627e803005, user_id=d51bc959781a4ef49d9bff84a5abaf18, role_id=32aef7aad733481291827ac4c11ac6dd)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:56.234185 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd04707-8d57-4f56-ada5-4f8a3a5402a4 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:56.249050 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 138/286] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 10:39:56 2022] PUT /identity/v3/projects/d72a8e31265a4e11b5e71c627e803005/users/d51bc959781a4ef49d9bff84a5abaf18/roles/32aef7aad733481291827ac4c11ac6dd => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:39:56.449815 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f90739-d7b8-4749-9c97-ed8d49a0fa6c None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:56.450696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f90739-d7b8-4749-9c97-ed8d49a0fa6c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:56.450983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f90739-d7b8-4749-9c97-ed8d49a0fa6c None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:56.452616 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 149/287] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:56.458304 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f8cf2-6044-40a3-b760-4d669b39e14f None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:56.458839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f8cf2-6044-40a3-b760-4d669b39e14f None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:56.459359 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f8cf2-6044-40a3-b760-4d669b39e14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:56.478902 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-642f8cf2-6044-40a3-b760-4d669b39e14f None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:56.480496 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-642f8cf2-6044-40a3-b760-4d669b39e14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:56.545911 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:56.559443 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 139/288] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:56.579242 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f90739-d7b8-4749-9c97-ed8d49a0fa6c None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:56.685277 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:56.718213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f90739-d7b8-4749-9c97-ed8d49a0fa6c None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:56.752875 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13874e8a-c6ad-4980-8725-615bc171ce53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:56.753690 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13874e8a-c6ad-4980-8725-615bc171ce53 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:56.753968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13874e8a-c6ad-4980-8725-615bc171ce53 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:56.754242 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13874e8a-c6ad-4980-8725-615bc171ce53 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:56.764809 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13874e8a-c6ad-4980-8725-615bc171ce53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:39:56.772471 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-13874e8a-c6ad-4980-8725-615bc171ce53 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:39:56.772471 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:56.772471 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:56.772471 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:56.772471 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:56.772471 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:56.772471 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:56.772471 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:56.772471 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:56.772471 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:56.772471 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:56.772471 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:56.772471 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:39:56.772471 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:39:56.772471 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:39:56.772471 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:39:56.773356 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:39:56.773356 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:39:56.773356 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:39:56.773356 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:39:56.773356 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:56.773356 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:56.773356 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:56.773356 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:56.773356 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:56.773356 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:56.773356 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:56.773356 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:56.773356 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:56.773356 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:56.773356 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:56.773356 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:56.774333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:56.774333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:56.774333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:56.774333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:56.774333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:39:56.774333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:39:56.774333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:39:56.774333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:39:56.774333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:39:56.774333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:39:56.774333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:39:56.774333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:39:56.774333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 150/289] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:39:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:39:56.784299 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f8cf2-6044-40a3-b760-4d669b39e14f None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:56.891995 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f8cf2-6044-40a3-b760-4d669b39e14f None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:56.927563 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3084738-cc3a-447d-8d5a-0cf293a17759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:56.928254 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3084738-cc3a-447d-8d5a-0cf293a17759 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:56.928539 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3084738-cc3a-447d-8d5a-0cf293a17759 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:56.928818 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3084738-cc3a-447d-8d5a-0cf293a17759 None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:56.929580 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3084738-cc3a-447d-8d5a-0cf293a17759 None admin] RBAC: Adding query filter params (name=member) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:56.929889 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3084738-cc3a-447d-8d5a-0cf293a17759 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:56.931460 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3084738-cc3a-447d-8d5a-0cf293a17759 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:56.945327 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 140/290] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 10:39:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:56.946795 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13874e8a-c6ad-4980-8725-615bc171ce53 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:57.082809 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13874e8a-c6ad-4980-8725-615bc171ce53 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:57.116324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145dc5d9-d929-486f-a024-bd9d46510fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:57.117227 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dc5d9-d929-486f-a024-bd9d46510fea None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:57.117512 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dc5d9-d929-486f-a024-bd9d46510fea None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:57.117787 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dc5d9-d929-486f-a024-bd9d46510fea None admin] PATH_INFO: `/v3/users/2cfbd5bb2f5d4c1d94167a55d5506a9b` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:57.119437 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145dc5d9-d929-486f-a024-bd9d46510fea None admin] RBAC: Authorizing `identity:get_user(user_id=2cfbd5bb2f5d4c1d94167a55d5506a9b)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:57.120913 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145dc5d9-d929-486f-a024-bd9d46510fea None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:57.127169 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 151/291] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:39:56 2022] GET /identity/v3/users/2cfbd5bb2f5d4c1d94167a55d5506a9b => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:57.128610 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3084738-cc3a-447d-8d5a-0cf293a17759 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:57.191605 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:57.232931 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3084738-cc3a-447d-8d5a-0cf293a17759 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:57.267076 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211fba39-5aac-4ae5-962a-a194b453ede8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:57.267775 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fba39-5aac-4ae5-962a-a194b453ede8 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:57.268062 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fba39-5aac-4ae5-962a-a194b453ede8 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:57.268341 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fba39-5aac-4ae5-962a-a194b453ede8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:57.338220 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211fba39-5aac-4ae5-962a-a194b453ede8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:57.339645 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211fba39-5aac-4ae5-962a-a194b453ede8 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:57.399853 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:57.449198 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 141/292] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:39:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:57.450677 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145dc5d9-d929-486f-a024-bd9d46510fea None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:57.467537 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:57.559339 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145dc5d9-d929-486f-a024-bd9d46510fea None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:57.602573 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc66b9-cf49-4534-a74e-d0026d9849a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:57.603485 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc66b9-cf49-4534-a74e-d0026d9849a5 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:57.603771 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc66b9-cf49-4534-a74e-d0026d9849a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:57.604050 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc66b9-cf49-4534-a74e-d0026d9849a5 None admin] PATH_INFO: `/v3/projects/d72a8e31265a4e11b5e71c627e803005` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:57.607881 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc66b9-cf49-4534-a74e-d0026d9849a5 None admin] RBAC: Authorizing `identity:get_project(project_id=d72a8e31265a4e11b5e71c627e803005)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:57.609413 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc66b9-cf49-4534-a74e-d0026d9849a5 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:57.611177 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 152/293] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:39:57 2022] GET /identity/v3/projects/d72a8e31265a4e11b5e71c627e803005 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:57.617140 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211fba39-5aac-4ae5-962a-a194b453ede8 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:57.718842 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211fba39-5aac-4ae5-962a-a194b453ede8 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:57.753878 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3321d-bb7c-4b4a-940f-923c4e33c3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:57.754550 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3321d-bb7c-4b4a-940f-923c4e33c3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:57.754839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3321d-bb7c-4b4a-940f-923c4e33c3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:57.755118 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3321d-bb7c-4b4a-940f-923c4e33c3d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:57.755979 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3321d-bb7c-4b4a-940f-923c4e33c3d8 None admin] RBAC: Adding query filter params (role.id=4827ddfe1a0e476294ecf7f1d122cc32, scope.project.id=d72a8e31265a4e11b5e71c627e803005, user.id=2cfbd5bb2f5d4c1d94167a55d5506a9b) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:57.756292 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3321d-bb7c-4b4a-940f-923c4e33c3d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:57.757735 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3321d-bb7c-4b4a-940f-923c4e33c3d8 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:57.771304 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 142/294] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:39:57 2022] GET /identity/v3/role_assignments?user.id=2cfbd5bb2f5d4c1d94167a55d5506a9b&scope.project.id=d72a8e31265a4e11b5e71c627e803005&role.id=4827ddfe1a0e476294ecf7f1d122cc32 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:58.285732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7475cbf-9e84-4763-8a30-a646bca51439 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:58.286109 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7475cbf-9e84-4763-8a30-a646bca51439 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:58.286311 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7475cbf-9e84-4763-8a30-a646bca51439 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:58.287694 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 153/295] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:58.294190 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab1296-42c3-4356-9535-b78b1a38f3ff None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:58.294668 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab1296-42c3-4356-9535-b78b1a38f3ff None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:58.294767 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab1296-42c3-4356-9535-b78b1a38f3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:58.311802 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-17ab1296-42c3-4356-9535-b78b1a38f3ff None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:58.313005 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-17ab1296-42c3-4356-9535-b78b1a38f3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:58.333033 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:58.396314 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 143/296] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:58.418455 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7475cbf-9e84-4763-8a30-a646bca51439 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:58.492466 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:58.526859 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7475cbf-9e84-4763-8a30-a646bca51439 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:58.561634 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32d0ad-e551-486a-89f9-df31bb644a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:58.562364 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32d0ad-e551-486a-89f9-df31bb644a01 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:58.562693 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32d0ad-e551-486a-89f9-df31bb644a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:58.562976 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32d0ad-e551-486a-89f9-df31bb644a01 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:58.574057 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b32d0ad-e551-486a-89f9-df31bb644a01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:39:58.581991 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-4b32d0ad-e551-486a-89f9-df31bb644a01 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:39:58.581991 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:58.581991 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:58.581991 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:58.581991 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:58.581991 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:58.581991 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:58.581991 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:58.581991 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:58.581991 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:58.581991 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:58.581991 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:58.581991 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:39:58.581991 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:39:58.581991 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:39:58.581991 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:39:58.582883 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:39:58.582883 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:39:58.582883 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:39:58.582883 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:39:58.582883 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:58.582883 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:58.582883 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:58.582883 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:58.582883 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:58.582883 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:58.582883 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:58.582883 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:58.582883 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:58.582883 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:58.582883 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:58.582883 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:58.583707 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:58.583707 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:58.583707 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:58.583707 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:58.583707 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:39:58.583707 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:39:58.583707 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:39:58.583707 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:39:58.583707 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:39:58.583707 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:39:58.583707 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:39:58.583707 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:39:58.583707 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 154/297] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:39:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:39:58.589584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab1296-42c3-4356-9535-b78b1a38f3ff None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:58.626144 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e83c9a-db54-4271-a0dc-0954d0272e86 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:58.626445 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e83c9a-db54-4271-a0dc-0954d0272e86 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:58.626711 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e83c9a-db54-4271-a0dc-0954d0272e86 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:58.628128 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 155/298] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:58.633041 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab18337-a050-417c-9038-604df6320a75 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:58.633468 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab18337-a050-417c-9038-604df6320a75 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:58.633869 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab18337-a050-417c-9038-604df6320a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:58.650635 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-7ab18337-a050-417c-9038-604df6320a75 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:58.652225 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-7ab18337-a050-417c-9038-604df6320a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:58.705853 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab1296-42c3-4356-9535-b78b1a38f3ff None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:58.735552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 156/299] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:39:58.748786 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c9f77-69d9-44ce-8317-507bb7f27dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:58.749760 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c9f77-69d9-44ce-8317-507bb7f27dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:58.750212 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c9f77-69d9-44ce-8317-507bb7f27dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:58.750629 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c9f77-69d9-44ce-8317-507bb7f27dc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:58.751606 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c9f77-69d9-44ce-8317-507bb7f27dc1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:58.752051 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c9f77-69d9-44ce-8317-507bb7f27dc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:58.753671 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c9f77-69d9-44ce-8317-507bb7f27dc1 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:58.760104 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab18337-a050-417c-9038-604df6320a75 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:58.763448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 144/300] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 10:39:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:58.768403 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c9f77-69d9-44ce-8317-507bb7f27dc1 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:58.787536 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:58.823322 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:58.864933 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab18337-a050-417c-9038-604df6320a75 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:58.879002 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c9f77-69d9-44ce-8317-507bb7f27dc1 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:58.902103 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bd50b-f0d3-4061-8bd1-1f6d884fc14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:58.902907 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bd50b-f0d3-4061-8bd1-1f6d884fc14e None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:58.903214 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bd50b-f0d3-4061-8bd1-1f6d884fc14e None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:58.903491 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bd50b-f0d3-4061-8bd1-1f6d884fc14e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:58.913821 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1bd50b-f0d3-4061-8bd1-1f6d884fc14e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:39:58.914529 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c9506-ef3b-41f0-be81-f8552f194d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:58.915652 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c9506-ef3b-41f0-be81-f8552f194d92 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:58.915938 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c9506-ef3b-41f0-be81-f8552f194d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:58.916215 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c9506-ef3b-41f0-be81-f8552f194d92 None admin] PATH_INFO: `/v3/users/852158c4756241bb8cdb92c4f8f864b4` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:58.917479 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c9506-ef3b-41f0-be81-f8552f194d92 None admin] RBAC: Authorizing `identity:get_user(user_id=852158c4756241bb8cdb92c4f8f864b4)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:58.918941 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c9506-ef3b-41f0-be81-f8552f194d92 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:58.920618 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 145/301] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:39:58 2022] GET /identity/v3/users/852158c4756241bb8cdb92c4f8f864b4 => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:39:58.921503 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-4c1bd50b-f0d3-4061-8bd1-1f6d884fc14e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:39:58.921503 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:58.921503 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:58.921503 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:58.921503 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:58.921503 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:58.921503 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:58.921503 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:58.921503 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:58.921503 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:58.921503 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:58.921503 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:58.921503 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:39:58.921503 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:39:58.921503 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:39:58.921503 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:39:58.922508 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:39:58.922508 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:39:58.922508 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:39:58.922508 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:39:58.922508 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:58.922508 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:58.922508 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:58.922508 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:58.922508 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:58.922508 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:58.922508 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:58.922508 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:58.922508 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:58.922508 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:58.922508 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:58.922508 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:58.923334 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:58.923334 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:58.923334 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:58.923334 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:58.923334 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:39:58.923334 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:39:58.923334 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:39:58.923334 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:39:58.923334 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:39:58.923334 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:39:58.923334 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:39:58.923334 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:39:58.924479 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337ddd9-9d26-499d-9e3b-180fc4597379 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:58.924736 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337ddd9-9d26-499d-9e3b-180fc4597379 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:58.925017 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337ddd9-9d26-499d-9e3b-180fc4597379 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:58.926363 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 146/302] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:58.927305 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 157/303] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:39:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:39:58.927540 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c3465-2c71-4e4a-b275-7d4c6a5b3362 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:58.927829 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c3465-2c71-4e4a-b275-7d4c6a5b3362 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:58.927985 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bd50b-f0d3-4061-8bd1-1f6d884fc14e None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:58.928075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c3465-2c71-4e4a-b275-7d4c6a5b3362 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:58.931348 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 147/304] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:39:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:39:58.931348 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c3465-2c71-4e4a-b275-7d4c6a5b3362 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:59.015051 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:59.025602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bd50b-f0d3-4061-8bd1-1f6d884fc14e None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:59.035184 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c3465-2c71-4e4a-b275-7d4c6a5b3362 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:59.045976 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:59.060203 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aabc8d-d5a5-47fc-be37-d545d106a8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:59.061074 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aabc8d-d5a5-47fc-be37-d545d106a8df None admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:59.061355 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aabc8d-d5a5-47fc-be37-d545d106a8df None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:59.061633 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aabc8d-d5a5-47fc-be37-d545d106a8df None admin] PATH_INFO: `/v3/system/users/852158c4756241bb8cdb92c4f8f864b4/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:59.063102 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aabc8d-d5a5-47fc-be37-d545d106a8df None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=852158c4756241bb8cdb92c4f8f864b4, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:59.064527 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aabc8d-d5a5-47fc-be37-d545d106a8df None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:59.068676 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64270bac-068f-4ab6-921e-717b25581a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:59.069425 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64270bac-068f-4ab6-921e-717b25581a46 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:59.069789 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64270bac-068f-4ab6-921e-717b25581a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:59.070159 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64270bac-068f-4ab6-921e-717b25581a46 None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:59.071604 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64270bac-068f-4ab6-921e-717b25581a46 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:59.072077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64270bac-068f-4ab6-921e-717b25581a46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:59.073849 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64270bac-068f-4ab6-921e-717b25581a46 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:59.074537 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 158/305] 10.222.0.16 () {58 vars in 1334 bytes} [Fri Jun 24 10:39:58 2022] PUT /identity/v3/system/users/852158c4756241bb8cdb92c4f8f864b4/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:39:59.075985 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3640b1-16a9-4fe9-9b14-5eec2425f006 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:59.076275 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3640b1-16a9-4fe9-9b14-5eec2425f006 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:59.076555 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3640b1-16a9-4fe9-9b14-5eec2425f006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:59.094453 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-7e3640b1-16a9-4fe9-9b14-5eec2425f006 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:59.095723 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-7e3640b1-16a9-4fe9-9b14-5eec2425f006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:59.100769 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 148/306] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 10:39:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:59.100769 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa4b58-53a8-45ea-8b09-33278413da69 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:59.100769 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa4b58-53a8-45ea-8b09-33278413da69 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:59.100769 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa4b58-53a8-45ea-8b09-33278413da69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:59.118846 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-fdfa4b58-53a8-45ea-8b09-33278413da69 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:59.120184 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-fdfa4b58-53a8-45ea-8b09-33278413da69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:59.183016 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 159/307] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:59.184891 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3640b1-16a9-4fe9-9b14-5eec2425f006 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:59.200520 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 149/308] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:59.207753 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa4b58-53a8-45ea-8b09-33278413da69 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:59.292941 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:59.309775 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3640b1-16a9-4fe9-9b14-5eec2425f006 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:59.319672 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa4b58-53a8-45ea-8b09-33278413da69 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:59.325735 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:59.348893 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523a19c-df8c-4701-a271-668db17f93ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:59.349790 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523a19c-df8c-4701-a271-668db17f93ed None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:59.350073 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523a19c-df8c-4701-a271-668db17f93ed None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:59.350353 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523a19c-df8c-4701-a271-668db17f93ed None admin] PATH_INFO: `/v3/users/3e18fd1927104c0ebf429ed6e6b8d411` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:59.355401 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0380b-d894-401d-87e0-048e5b46eb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:59.356218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0380b-d894-401d-87e0-048e5b46eb21 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:59.356504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0380b-d894-401d-87e0-048e5b46eb21 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:59.357116 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0380b-d894-401d-87e0-048e5b46eb21 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:59.358309 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0380b-d894-401d-87e0-048e5b46eb21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:59.359796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0380b-d894-401d-87e0-048e5b46eb21 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:59.361607 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 150/309] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:39:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:39:59.365127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523a19c-df8c-4701-a271-668db17f93ed None admin] RBAC: Authorizing `identity:get_user(user_id=3e18fd1927104c0ebf429ed6e6b8d411)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:59.366584 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523a19c-df8c-4701-a271-668db17f93ed None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:59.366683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0380b-d894-401d-87e0-048e5b46eb21 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:59.372903 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 160/310] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:39:59 2022] GET /identity/v3/users/3e18fd1927104c0ebf429ed6e6b8d411 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:59.372903 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523a19c-df8c-4701-a271-668db17f93ed None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:59.477495 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0380b-d894-401d-87e0-048e5b46eb21 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:59.478749 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523a19c-df8c-4701-a271-668db17f93ed None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:59.512643 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7614772-d66a-4683-9723-0b123546d155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:59.513507 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7614772-d66a-4683-9723-0b123546d155 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:59.513855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7614772-d66a-4683-9723-0b123546d155 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:59.514067 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7614772-d66a-4683-9723-0b123546d155 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:59.516795 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d2538-c33a-4f2c-a3ba-a37a5d7f750c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:59.517474 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d2538-c33a-4f2c-a3ba-a37a5d7f750c None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:59.517759 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d2538-c33a-4f2c-a3ba-a37a5d7f750c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:59.518039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d2538-c33a-4f2c-a3ba-a37a5d7f750c None admin] PATH_INFO: `/v3/groups` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:59.518736 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d2538-c33a-4f2c-a3ba-a37a5d7f750c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:59.520216 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d2538-c33a-4f2c-a3ba-a37a5d7f750c None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:59.525355 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7614772-d66a-4683-9723-0b123546d155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:39:59.533206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-d7614772-d66a-4683-9723-0b123546d155 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:39:59.533206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:39:59.533206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:39:59.533206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:39:59.533206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:39:59.533206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:39:59.533206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:39:59.533206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:39:59.533206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:39:59.533206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:39:59.533206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:39:59.533206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:39:59.533206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:39:59.533206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:39:59.533206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:39:59.533206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:39:59.534095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:39:59.534095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:39:59.534095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:39:59.534095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:39:59.534095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:39:59.534095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:39:59.534095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:39:59.534095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:39:59.534095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:39:59.534095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:39:59.534095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:39:59.534095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:39:59.534095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:39:59.534095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:39:59.534095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:39:59.534095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:39:59.534941 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:39:59.534941 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:39:59.534941 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:39:59.534941 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:39:59.534941 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:39:59.534941 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:39:59.534941 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:39:59.534941 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:39:59.534941 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:39:59.534941 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:39:59.534941 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:39:59.534941 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:39:59.534941 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 151/311] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:39:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:39:59.536089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7614772-d66a-4683-9723-0b123546d155 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:59.539207 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:59.540475 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 161/312] 10.222.0.16 () {60 vars in 1134 bytes} [Fri Jun 24 10:39:59 2022] POST /identity/v3/groups => generated 229 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:39:59.541544 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d2538-c33a-4f2c-a3ba-a37a5d7f750c None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:59.580399 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:59.674825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d2538-c33a-4f2c-a3ba-a37a5d7f750c None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:59.691506 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7614772-d66a-4683-9723-0b123546d155 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:59.728544 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b926d1-a6dc-4510-a520-4a3510bcb279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:59.729241 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b926d1-a6dc-4510-a520-4a3510bcb279 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:59.729527 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b926d1-a6dc-4510-a520-4a3510bcb279 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:59.729805 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b926d1-a6dc-4510-a520-4a3510bcb279 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:59.730720 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b926d1-a6dc-4510-a520-4a3510bcb279 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:59.730919 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b926d1-a6dc-4510-a520-4a3510bcb279 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:59.732295 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b926d1-a6dc-4510-a520-4a3510bcb279 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:59.740005 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6bbad7-a6be-47cb-a916-87b847bc5c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:59.740682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6bbad7-a6be-47cb-a916-87b847bc5c6f None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:59.740966 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6bbad7-a6be-47cb-a916-87b847bc5c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:59.741243 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6bbad7-a6be-47cb-a916-87b847bc5c6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:59.742595 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 162/313] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 10:39:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:59.742741 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6bbad7-a6be-47cb-a916-87b847bc5c6f None admin] RBAC: Adding query filter params (role.id=32aef7aad733481291827ac4c11ac6dd, user.id=3e18fd1927104c0ebf429ed6e6b8d411, scope.system=all) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:59.742741 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6bbad7-a6be-47cb-a916-87b847bc5c6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:59.745491 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6bbad7-a6be-47cb-a916-87b847bc5c6f None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:59.747902 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b926d1-a6dc-4510-a520-4a3510bcb279 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:59.750031 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 152/314] 10.222.0.16 () {56 vars in 1308 bytes} [Fri Jun 24 10:39:59 2022] GET /identity/v3/role_assignments?user.id=3e18fd1927104c0ebf429ed6e6b8d411&scope.system=all&role.id=32aef7aad733481291827ac4c11ac6dd => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:59.859369 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:59.868496 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b926d1-a6dc-4510-a520-4a3510bcb279 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:59.908930 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5dc488-309d-4b9b-820a-01dccef749aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:59.909835 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dc488-309d-4b9b-820a-01dccef749aa None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:59.910116 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dc488-309d-4b9b-820a-01dccef749aa None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:59.910391 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dc488-309d-4b9b-820a-01dccef749aa None admin] PATH_INFO: `/v3/users/d51bc959781a4ef49d9bff84a5abaf18` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:59.911688 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5dc488-309d-4b9b-820a-01dccef749aa None admin] RBAC: Authorizing `identity:get_user(user_id=d51bc959781a4ef49d9bff84a5abaf18)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:59.913158 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5dc488-309d-4b9b-820a-01dccef749aa None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:59.915917 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 163/315] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:39:59 2022] GET /identity/v3/users/d51bc959781a4ef49d9bff84a5abaf18 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:59.920908 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6bbad7-a6be-47cb-a916-87b847bc5c6f None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:59.992976 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:00.031136 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6bbad7-a6be-47cb-a916-87b847bc5c6f None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:00.069719 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd17ff-827a-4620-b0fd-fb70f184f025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:00.070381 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd17ff-827a-4620-b0fd-fb70f184f025 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:00.070662 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd17ff-827a-4620-b0fd-fb70f184f025 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:00.071344 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd17ff-827a-4620-b0fd-fb70f184f025 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:00.145579 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd17ff-827a-4620-b0fd-fb70f184f025 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:00.147004 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd17ff-827a-4620-b0fd-fb70f184f025 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:00.218482 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:00.259282 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 153/316] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:39:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:00.268292 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5dc488-309d-4b9b-820a-01dccef749aa None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:00.373146 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5dc488-309d-4b9b-820a-01dccef749aa None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:00.407613 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21058d-5b9b-46dc-9b4d-a38b6248f2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:00.408824 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21058d-5b9b-46dc-9b4d-a38b6248f2b8 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:00.409321 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21058d-5b9b-46dc-9b4d-a38b6248f2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:00.409790 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21058d-5b9b-46dc-9b4d-a38b6248f2b8 None admin] PATH_INFO: `/v3/projects/d72a8e31265a4e11b5e71c627e803005` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:00.411264 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21058d-5b9b-46dc-9b4d-a38b6248f2b8 None admin] RBAC: Authorizing `identity:get_project(project_id=d72a8e31265a4e11b5e71c627e803005)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:00.412919 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21058d-5b9b-46dc-9b4d-a38b6248f2b8 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:00.419240 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 164/317] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:40:00 2022] GET /identity/v3/projects/d72a8e31265a4e11b5e71c627e803005 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:00.421379 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd17ff-827a-4620-b0fd-fb70f184f025 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:00.523198 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd17ff-827a-4620-b0fd-fb70f184f025 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:00.558721 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa455a43-c46f-40a8-aa0b-85f17ef5bcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:00.559425 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa455a43-c46f-40a8-aa0b-85f17ef5bcf9 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:00.559712 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa455a43-c46f-40a8-aa0b-85f17ef5bcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:00.559988 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa455a43-c46f-40a8-aa0b-85f17ef5bcf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:00.560829 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa455a43-c46f-40a8-aa0b-85f17ef5bcf9 None admin] RBAC: Adding query filter params (role.id=32aef7aad733481291827ac4c11ac6dd, scope.project.id=d72a8e31265a4e11b5e71c627e803005, user.id=d51bc959781a4ef49d9bff84a5abaf18) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:00.561145 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa455a43-c46f-40a8-aa0b-85f17ef5bcf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:00.562598 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa455a43-c46f-40a8-aa0b-85f17ef5bcf9 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:00.569468 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 154/318] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:40:00 2022] GET /identity/v3/role_assignments?user.id=d51bc959781a4ef49d9bff84a5abaf18&scope.project.id=d72a8e31265a4e11b5e71c627e803005&role.id=32aef7aad733481291827ac4c11ac6dd => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:01.144139 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87633239-72a5-4c19-a072-ae02f208ef3f None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:01.144689 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87633239-72a5-4c19-a072-ae02f208ef3f None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:01.144689 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87633239-72a5-4c19-a072-ae02f208ef3f None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:01.146011 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 165/319] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:01.151870 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932101b-6008-4cbe-b11d-bba462c62c85 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:01.152130 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932101b-6008-4cbe-b11d-bba462c62c85 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:01.152432 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932101b-6008-4cbe-b11d-bba462c62c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:01.170247 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-f932101b-6008-4cbe-b11d-bba462c62c85 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:01.171500 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-f932101b-6008-4cbe-b11d-bba462c62c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:01.197809 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:01.243520 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 155/320] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:01.266923 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87633239-72a5-4c19-a072-ae02f208ef3f None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:01.299666 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:01.373998 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87633239-72a5-4c19-a072-ae02f208ef3f None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:01.408732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7a766-5855-4b41-985c-82d0c337498a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:01.409476 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7a766-5855-4b41-985c-82d0c337498a None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:01.409760 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7a766-5855-4b41-985c-82d0c337498a None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:01.410043 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7a766-5855-4b41-985c-82d0c337498a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:01.421050 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7a766-5855-4b41-985c-82d0c337498a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:01.428748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-69c7a766-5855-4b41-985c-82d0c337498a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:40:01.428748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:01.428748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:01.428748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:01.428748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:01.428748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:01.428748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:01.428748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:01.428748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:01.428748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:01.428748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:01.428748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:01.428748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:01.428748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:01.428748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:01.428748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:01.429619 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:01.429619 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:01.429619 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:01.429619 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:01.429619 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:01.429619 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:01.429619 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:01.429619 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:01.429619 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:01.429619 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:01.429619 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:01.429619 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:01.429619 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:01.429619 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:01.429619 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:01.429619 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:01.430511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:01.430511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:01.430511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:01.430511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:01.430511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:01.430511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:01.430511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:01.430511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:01.430511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:01.430511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:01.430511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:40:01.430511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:01.434937 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 166/321] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:40:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:01.436363 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932101b-6008-4cbe-b11d-bba462c62c85 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:01.539198 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932101b-6008-4cbe-b11d-bba462c62c85 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:01.573949 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c29131-8dc4-4b51-b93f-a44afb10e2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:01.574630 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c29131-8dc4-4b51-b93f-a44afb10e2e5 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:01.574915 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c29131-8dc4-4b51-b93f-a44afb10e2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:01.575214 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c29131-8dc4-4b51-b93f-a44afb10e2e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:01.575980 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c29131-8dc4-4b51-b93f-a44afb10e2e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:01.576288 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c29131-8dc4-4b51-b93f-a44afb10e2e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:01.577673 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c29131-8dc4-4b51-b93f-a44afb10e2e5 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:01.586364 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 156/322] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 10:40:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:01.592006 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7a766-5855-4b41-985c-82d0c337498a None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:01.658680 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5bc03-1eb2-424d-90ae-9509c0af4b68 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:01.659052 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5bc03-1eb2-424d-90ae-9509c0af4b68 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:01.659308 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5bc03-1eb2-424d-90ae-9509c0af4b68 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:01.660785 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 157/323] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:01.665606 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d94027-d3d8-417d-a5e5-c6f000a87fa0 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:01.665929 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d94027-d3d8-417d-a5e5-c6f000a87fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:01.666169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d94027-d3d8-417d-a5e5-c6f000a87fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:01.682705 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-a3d94027-d3d8-417d-a5e5-c6f000a87fa0 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:01.683915 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-a3d94027-d3d8-417d-a5e5-c6f000a87fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:01.695039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:01.701973 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:01.708954 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7a766-5855-4b41-985c-82d0c337498a None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:01.743866 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace919e3-d703-45d9-bd5d-612c24a636a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:01.744757 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace919e3-d703-45d9-bd5d-612c24a636a4 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:01.745045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace919e3-d703-45d9-bd5d-612c24a636a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:01.745324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace919e3-d703-45d9-bd5d-612c24a636a4 None admin] PATH_INFO: `/v3/users/852158c4756241bb8cdb92c4f8f864b4` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:01.746579 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace919e3-d703-45d9-bd5d-612c24a636a4 None admin] RBAC: Authorizing `identity:get_user(user_id=852158c4756241bb8cdb92c4f8f864b4)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:01.748095 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace919e3-d703-45d9-bd5d-612c24a636a4 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:01.753731 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 158/324] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:40:01.754557 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 167/325] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:40:01 2022] GET /identity/v3/users/852158c4756241bb8cdb92c4f8f864b4 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:01.755814 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d94027-d3d8-417d-a5e5-c6f000a87fa0 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:01.776558 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace919e3-d703-45d9-bd5d-612c24a636a4 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:01.868576 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d94027-d3d8-417d-a5e5-c6f000a87fa0 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:01.880458 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace919e3-d703-45d9-bd5d-612c24a636a4 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:01.904654 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05094ce3-97c3-4781-8106-bfcf98ce778e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:01.905316 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05094ce3-97c3-4781-8106-bfcf98ce778e None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:01.905616 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05094ce3-97c3-4781-8106-bfcf98ce778e None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:01.905891 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05094ce3-97c3-4781-8106-bfcf98ce778e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:01.906727 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05094ce3-97c3-4781-8106-bfcf98ce778e None admin] RBAC: Adding query filter params (role.id=4827ddfe1a0e476294ecf7f1d122cc32, user.id=852158c4756241bb8cdb92c4f8f864b4, scope.system=all) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:01.907037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05094ce3-97c3-4781-8106-bfcf98ce778e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:01.908509 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05094ce3-97c3-4781-8106-bfcf98ce778e None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:01.913710 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808e8c1-e771-421b-9a6e-694cacc1e885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:01.914474 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808e8c1-e771-421b-9a6e-694cacc1e885 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:01.914763 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808e8c1-e771-421b-9a6e-694cacc1e885 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:01.915103 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808e8c1-e771-421b-9a6e-694cacc1e885 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:01.916320 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4808e8c1-e771-421b-9a6e-694cacc1e885 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:01.917747 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4808e8c1-e771-421b-9a6e-694cacc1e885 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:01.919407 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 168/326] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:40:01.920057 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 159/327] 10.222.0.16 () {56 vars in 1308 bytes} [Fri Jun 24 10:40:01 2022] GET /identity/v3/role_assignments?user.id=852158c4756241bb8cdb92c4f8f864b4&scope.system=all&role.id=4827ddfe1a0e476294ecf7f1d122cc32 => generated 510 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:40:01.920593 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ec625-551f-4916-b800-10fc44ec1cc2 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:01.920880 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ec625-551f-4916-b800-10fc44ec1cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:01.921157 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ec625-551f-4916-b800-10fc44ec1cc2 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:01.922529 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 169/328] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:01.928312 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05094ce3-97c3-4781-8106-bfcf98ce778e None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:01.928790 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370acbfc-9d5a-465f-9771-f29dae2883a9 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:01.929058 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370acbfc-9d5a-465f-9771-f29dae2883a9 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:01.929340 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370acbfc-9d5a-465f-9771-f29dae2883a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:01.944662 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:01.947519 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-370acbfc-9d5a-465f-9771-f29dae2883a9 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:01.948844 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-370acbfc-9d5a-465f-9771-f29dae2883a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:01.971815 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:02.024184 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 170/329] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:02.047070 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370acbfc-9d5a-465f-9771-f29dae2883a9 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:02.053937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05094ce3-97c3-4781-8106-bfcf98ce778e None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:02.093843 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba0d76-2707-47f1-93b4-9dcaaff2506d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:02.094672 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba0d76-2707-47f1-93b4-9dcaaff2506d None admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:02.094965 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba0d76-2707-47f1-93b4-9dcaaff2506d None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:02.098140 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba0d76-2707-47f1-93b4-9dcaaff2506d None admin] PATH_INFO: `/v3/groups` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:02.098140 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba0d76-2707-47f1-93b4-9dcaaff2506d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:02.098140 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba0d76-2707-47f1-93b4-9dcaaff2506d None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:02.115666 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 160/330] 10.222.0.16 () {60 vars in 1134 bytes} [Fri Jun 24 10:40:01 2022] POST /identity/v3/groups => generated 226 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:40:02.166324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370acbfc-9d5a-465f-9771-f29dae2883a9 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:02.205108 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ca6fd-250b-475d-92fd-8d0f185a4f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:02.205934 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ca6fd-250b-475d-92fd-8d0f185a4f4d None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:02.206221 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ca6fd-250b-475d-92fd-8d0f185a4f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:02.206498 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ca6fd-250b-475d-92fd-8d0f185a4f4d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:02.218663 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ca6fd-250b-475d-92fd-8d0f185a4f4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:02.226523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-481ca6fd-250b-475d-92fd-8d0f185a4f4d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:40:02.226523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:02.226523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:02.226523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:02.226523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:02.226523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:02.226523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:02.226523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:02.226523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:02.226523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:02.226523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:02.226523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:02.226523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:02.226523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:02.226523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:02.226523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:02.227669 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:02.227669 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:02.227669 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:02.227669 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:02.227669 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:02.227669 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:02.227669 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:02.227669 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:02.227669 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:02.227669 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:02.227669 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:02.227669 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:02.227669 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:02.227669 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:02.227669 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:02.227669 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:02.229118 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:02.229118 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:02.229118 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:02.229118 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:02.229118 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:02.229118 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:02.229118 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:02.229118 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:02.229118 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:02.229118 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:02.229118 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:40:02.229118 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:02.229118 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 171/331] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:40:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:40:02.234182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba0d76-2707-47f1-93b4-9dcaaff2506d None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:02.310660 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:02.348506 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba0d76-2707-47f1-93b4-9dcaaff2506d None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:02.384309 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b231457-0af1-4b3f-bfc0-c0b5cff94954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:02.385000 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b231457-0af1-4b3f-bfc0-c0b5cff94954 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:02.385294 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b231457-0af1-4b3f-bfc0-c0b5cff94954 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:02.385574 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b231457-0af1-4b3f-bfc0-c0b5cff94954 None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:02.386338 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b231457-0af1-4b3f-bfc0-c0b5cff94954 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:02.386645 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b231457-0af1-4b3f-bfc0-c0b5cff94954 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:02.388087 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b231457-0af1-4b3f-bfc0-c0b5cff94954 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:02.397129 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 161/332] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 10:40:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:02.403375 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ca6fd-250b-475d-92fd-8d0f185a4f4d None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:02.425800 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:02.520919 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ca6fd-250b-475d-92fd-8d0f185a4f4d None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:02.561375 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbafcc4-8262-4a7b-8619-94d84ea7a11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:02.562522 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbafcc4-8262-4a7b-8619-94d84ea7a11c None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:02.562940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbafcc4-8262-4a7b-8619-94d84ea7a11c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:02.563372 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbafcc4-8262-4a7b-8619-94d84ea7a11c None admin] PATH_INFO: `/v3/users/3e18fd1927104c0ebf429ed6e6b8d411` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:02.565079 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbafcc4-8262-4a7b-8619-94d84ea7a11c None admin] RBAC: Authorizing `identity:get_user(user_id=3e18fd1927104c0ebf429ed6e6b8d411)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:02.566677 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbafcc4-8262-4a7b-8619-94d84ea7a11c None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:02.568776 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 172/333] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:40:02 2022] GET /identity/v3/users/3e18fd1927104c0ebf429ed6e6b8d411 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:02.574962 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b231457-0af1-4b3f-bfc0-c0b5cff94954 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:02.688697 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b231457-0af1-4b3f-bfc0-c0b5cff94954 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:02.721186 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:02.726517 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28392db5-4e52-489b-a1df-a52f6241eaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:02.728523 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28392db5-4e52-489b-a1df-a52f6241eaa3 None admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:02.729021 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28392db5-4e52-489b-a1df-a52f6241eaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:02.729489 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28392db5-4e52-489b-a1df-a52f6241eaa3 None admin] PATH_INFO: `/v3/system/users/3e18fd1927104c0ebf429ed6e6b8d411/roles/32aef7aad733481291827ac4c11ac6dd` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:02.731416 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28392db5-4e52-489b-a1df-a52f6241eaa3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3e18fd1927104c0ebf429ed6e6b8d411, role_id=32aef7aad733481291827ac4c11ac6dd)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:02.733131 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28392db5-4e52-489b-a1df-a52f6241eaa3 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:02.749938 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 162/334] 10.222.0.16 () {58 vars in 1334 bytes} [Fri Jun 24 10:40:02 2022] PUT /identity/v3/system/users/3e18fd1927104c0ebf429ed6e6b8d411/roles/32aef7aad733481291827ac4c11ac6dd => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:40:04.691375 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d09ca-789b-457c-a019-15265152d2b8 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:04.691914 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d09ca-789b-457c-a019-15265152d2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:04.691914 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d09ca-789b-457c-a019-15265152d2b8 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:04.693516 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 173/335] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:04.700708 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e28389-65d8-4409-ba9d-1f2f6a7d8bb4 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:04.701576 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e28389-65d8-4409-ba9d-1f2f6a7d8bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:04.703356 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e28389-65d8-4409-ba9d-1f2f6a7d8bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:04.728355 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-13e28389-65d8-4409-ba9d-1f2f6a7d8bb4 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:04.729895 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-13e28389-65d8-4409-ba9d-1f2f6a7d8bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:04.813468 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 163/336] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:04.861183 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d09ca-789b-457c-a019-15265152d2b8 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:04.976149 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:04.988400 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c8f71-ace9-4f20-81a5-47cbeecaf254 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:04.988698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c8f71-ace9-4f20-81a5-47cbeecaf254 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:04.988958 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c8f71-ace9-4f20-81a5-47cbeecaf254 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:04.991459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 164/337] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:04.998600 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d09ca-789b-457c-a019-15265152d2b8 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:05.001803 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6950b0c-5da3-4762-a1e7-e7eae5aa4c0d None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:05.002100 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6950b0c-5da3-4762-a1e7-e7eae5aa4c0d None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:05.002374 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6950b0c-5da3-4762-a1e7-e7eae5aa4c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:05.028973 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-a6950b0c-5da3-4762-a1e7-e7eae5aa4c0d None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:05.030247 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-a6950b0c-5da3-4762-a1e7-e7eae5aa4c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:05.045193 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe2d6d-8ce0-4891-b25b-4d68739b26c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:05.046037 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe2d6d-8ce0-4891-b25b-4d68739b26c1 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:05.046325 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe2d6d-8ce0-4891-b25b-4d68739b26c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:05.046604 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe2d6d-8ce0-4891-b25b-4d68739b26c1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:05.068194 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe2d6d-8ce0-4891-b25b-4d68739b26c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:05.076940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-a6fe2d6d-8ce0-4891-b25b-4d68739b26c1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:40:05.076940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:05.076940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:05.076940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:05.076940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:05.076940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:05.076940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:05.076940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:05.076940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:05.076940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:05.076940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:05.076940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:05.076940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:05.076940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:05.076940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:05.076940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:05.077835 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:05.077835 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:05.077835 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:05.077835 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:05.077835 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:05.077835 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:05.077835 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:05.077835 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:05.077835 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:05.077835 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:05.077835 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:05.077835 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:05.077835 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:05.077835 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:05.077835 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:05.077835 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:05.078654 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:05.078654 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:05.078654 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:05.078654 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:05.078654 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:05.078654 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:05.078654 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:05.078654 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:05.078654 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:05.078654 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:05.078654 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:40:05.078654 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:05.085662 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 174/338] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 10:40:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:05.091911 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe2d6d-8ce0-4891-b25b-4d68739b26c1 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:05.156886 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 165/339] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:05.204031 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe2d6d-8ce0-4891-b25b-4d68739b26c1 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:05.216726 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6950b0c-5da3-4762-a1e7-e7eae5aa4c0d None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:05.259971 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0f297-efb9-4b64-8912-6f6a04f20917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:05.261028 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0f297-efb9-4b64-8912-6f6a04f20917 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:05.261514 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0f297-efb9-4b64-8912-6f6a04f20917 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:05.262012 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0f297-efb9-4b64-8912-6f6a04f20917 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:05.262969 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0f297-efb9-4b64-8912-6f6a04f20917 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:05.263496 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0f297-efb9-4b64-8912-6f6a04f20917 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:05.265126 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0f297-efb9-4b64-8912-6f6a04f20917 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:05.276982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 175/340] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:40:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:05.282408 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0f297-efb9-4b64-8912-6f6a04f20917 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:05.297507 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:05.303524 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:05.372680 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6950b0c-5da3-4762-a1e7-e7eae5aa4c0d None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:05.432422 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4272242-a6ba-409d-82b9-677518810987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:05.433596 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4272242-a6ba-409d-82b9-677518810987 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:05.434061 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4272242-a6ba-409d-82b9-677518810987 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:05.434503 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4272242-a6ba-409d-82b9-677518810987 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:05.452326 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4272242-a6ba-409d-82b9-677518810987 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:05.466263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-a4272242-a6ba-409d-82b9-677518810987 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:40:05.466263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:05.466263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:05.466263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:05.466263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:05.466263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:05.466263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:05.466263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:05.466263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:05.466263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:05.466263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:05.466263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:05.466263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:05.466263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:05.466263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:05.466263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:05.467258 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:05.467258 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:05.467258 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:05.467258 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:05.467258 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:05.467258 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:05.467258 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:05.467258 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:05.467258 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:05.467258 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:05.467258 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:05.467258 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:05.467258 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:05.467258 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:05.467258 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:05.467258 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:05.468331 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:05.468331 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:05.468331 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:05.468331 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:05.468331 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:05.468331 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:05.468331 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:05.468331 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:05.468331 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:05.468331 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:05.468331 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:40:05.468331 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:05.470904 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 166/341] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:40:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:05.479095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4272242-a6ba-409d-82b9-677518810987 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:05.498068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0f297-efb9-4b64-8912-6f6a04f20917 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:05.592818 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4272242-a6ba-409d-82b9-677518810987 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:05.593079 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a47be5-0e79-463f-941c-06b2d1ed4647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:05.593815 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a47be5-0e79-463f-941c-06b2d1ed4647 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:05.594112 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a47be5-0e79-463f-941c-06b2d1ed4647 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:05.594391 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a47be5-0e79-463f-941c-06b2d1ed4647 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:05.612490 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:05.649830 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5f206-057a-4ce4-a377-318222c9a4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:05.650708 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5f206-057a-4ce4-a377-318222c9a4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:05.650998 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5f206-057a-4ce4-a377-318222c9a4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:05.651309 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5f206-057a-4ce4-a377-318222c9a4c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:05.652075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c5f206-057a-4ce4-a377-318222c9a4c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:05.652386 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c5f206-057a-4ce4-a377-318222c9a4c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:05.653805 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c5f206-057a-4ce4-a377-318222c9a4c7 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:05.668313 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 167/342] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 10:40:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:40:05.674804 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5f206-057a-4ce4-a377-318222c9a4c7 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:05.755626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a47be5-0e79-463f-941c-06b2d1ed4647 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:05.757108 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a47be5-0e79-463f-941c-06b2d1ed4647 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:05.771492 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:05.857552 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5f206-057a-4ce4-a377-318222c9a4c7 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:05.910401 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa2f0a-f44c-417e-9513-f39ba403468d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:05.911068 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa2f0a-f44c-417e-9513-f39ba403468d None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:05.911379 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa2f0a-f44c-417e-9513-f39ba403468d None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:05.911656 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa2f0a-f44c-417e-9513-f39ba403468d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:05.974627 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:05.986372 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 176/343] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:40:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 704 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:05.994692 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda703f-cba5-40a8-be3e-2a393cc3d279 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:05.994692 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda703f-cba5-40a8-be3e-2a393cc3d279 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:05.994692 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda703f-cba5-40a8-be3e-2a393cc3d279 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:05.996294 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 177/344] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:05.997397 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c1644-4abd-4adf-8c43-2507a8a4db6b None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:05.997683 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c1644-4abd-4adf-8c43-2507a8a4db6b None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:05.997956 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c1644-4abd-4adf-8c43-2507a8a4db6b None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:05.999204 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 178/345] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:05.999834 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c1644-4abd-4adf-8c43-2507a8a4db6b None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:06.010931 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa2f0a-f44c-417e-9513-f39ba403468d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:06.013396 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa2f0a-f44c-417e-9513-f39ba403468d None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:06.144144 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 168/346] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:40:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 10:40:06.145270 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56c90b-c2b0-463d-9bfa-05dd484b20c6 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:06.145550 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56c90b-c2b0-463d-9bfa-05dd484b20c6 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:06.145827 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56c90b-c2b0-463d-9bfa-05dd484b20c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:06.151282 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c1644-4abd-4adf-8c43-2507a8a4db6b None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:06.162483 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:06.169439 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-0d56c90b-c2b0-463d-9bfa-05dd484b20c6 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:06.170948 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-0d56c90b-c2b0-463d-9bfa-05dd484b20c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:06.195573 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d814054-a6c6-4fea-8c5c-52ed3465fe88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:06.197374 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d814054-a6c6-4fea-8c5c-52ed3465fe88 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:06.197821 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d814054-a6c6-4fea-8c5c-52ed3465fe88 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:06.198263 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d814054-a6c6-4fea-8c5c-52ed3465fe88 None admin] PATH_INFO: `/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:06.201532 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d814054-a6c6-4fea-8c5c-52ed3465fe88 None admin] RBAC: Authorizing `identity:get_project(project_id=2ac825c0a6b546859d4dafd68f22a7ca)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:06.203197 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d814054-a6c6-4fea-8c5c-52ed3465fe88 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:06.205112 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 179/347] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:40:05 2022] GET /identity/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:06.206549 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f4ca3-4447-49a1-b934-e7a625103b57 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:06.207007 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f4ca3-4447-49a1-b934-e7a625103b57 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:06.207496 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f4ca3-4447-49a1-b934-e7a625103b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:06.230523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-122f4ca3-4447-49a1-b934-e7a625103b57 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:06.231786 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-122f4ca3-4447-49a1-b934-e7a625103b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:06.251453 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 169/348] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:06.253213 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d9db3-f57f-45c8-96ac-59aebc7c415b None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:06.253498 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d9db3-f57f-45c8-96ac-59aebc7c415b None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:06.253772 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d9db3-f57f-45c8-96ac-59aebc7c415b None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:06.259182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 170/349] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:06.259182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d9db3-f57f-45c8-96ac-59aebc7c415b None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:06.270162 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:06.324628 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 180/350] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:06.325866 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f4ca3-4447-49a1-b934-e7a625103b57 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:06.395271 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d9db3-f57f-45c8-96ac-59aebc7c415b None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:06.433760 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5484b1c-2cc2-4d72-8ba9-782853e9f909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:06.434657 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5484b1c-2cc2-4d72-8ba9-782853e9f909 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:06.434944 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5484b1c-2cc2-4d72-8ba9-782853e9f909 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:06.435270 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5484b1c-2cc2-4d72-8ba9-782853e9f909 None admin] PATH_INFO: `/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:06.436476 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5484b1c-2cc2-4d72-8ba9-782853e9f909 None admin] RBAC: Authorizing `identity:get_project(project_id=2ac825c0a6b546859d4dafd68f22a7ca)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:06.437940 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5484b1c-2cc2-4d72-8ba9-782853e9f909 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:06.440095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 171/351] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:40:06 2022] GET /identity/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:06.441400 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fc085-0808-4fe9-b61a-5ce01c9d5288 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:06.441697 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fc085-0808-4fe9-b61a-5ce01c9d5288 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:06.441978 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fc085-0808-4fe9-b61a-5ce01c9d5288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:06.451744 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f4ca3-4447-49a1-b934-e7a625103b57 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:06.454162 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:06.461651 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-d85fc085-0808-4fe9-b61a-5ce01c9d5288 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:06.462849 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-d85fc085-0808-4fe9-b61a-5ce01c9d5288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:06.498134 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0b4ab-999f-488e-9f33-08971cc72fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:06.499022 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0b4ab-999f-488e-9f33-08971cc72fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:06.499360 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0b4ab-999f-488e-9f33-08971cc72fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:06.499641 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0b4ab-999f-488e-9f33-08971cc72fc5 None admin] PATH_INFO: `/v3/groups/79d30be0437e4a87b27484ad6a45fd74` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:06.507398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d0b4ab-999f-488e-9f33-08971cc72fc5 None admin] RBAC: Authorizing `identity:get_group(group_id=79d30be0437e4a87b27484ad6a45fd74)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:06.508921 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d0b4ab-999f-488e-9f33-08971cc72fc5 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:06.517129 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 181/352] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jun 24 10:40:06 2022] GET /identity/v3/groups/79d30be0437e4a87b27484ad6a45fd74 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:06.517129 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0b4ab-999f-488e-9f33-08971cc72fc5 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:06.539823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 172/353] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:06.541327 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb271f30-c43d-4e4d-8d08-c291779d7569 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:06.541628 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb271f30-c43d-4e4d-8d08-c291779d7569 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:06.541909 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb271f30-c43d-4e4d-8d08-c291779d7569 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:06.543232 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 173/354] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:06.548006 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb271f30-c43d-4e4d-8d08-c291779d7569 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:06.557316 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:06.631591 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0b4ab-999f-488e-9f33-08971cc72fc5 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:06.680195 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb515a6-2ff8-4ab1-9700-e486eb1465a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:06.681184 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb515a6-2ff8-4ab1-9700-e486eb1465a8 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:06.681471 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb515a6-2ff8-4ab1-9700-e486eb1465a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:06.681749 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb515a6-2ff8-4ab1-9700-e486eb1465a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:06.683722 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb271f30-c43d-4e4d-8d08-c291779d7569 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:06.695842 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb515a6-2ff8-4ab1-9700-e486eb1465a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:06.703718 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-0fb515a6-2ff8-4ab1-9700-e486eb1465a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:40:06.703718 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:06.703718 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:06.703718 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:06.703718 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:06.703718 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:06.703718 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:06.703718 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:06.703718 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:06.703718 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:06.703718 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:06.703718 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:06.703718 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:06.703718 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:06.703718 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:06.703718 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:06.704637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:06.704637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:06.704637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:06.704637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:06.704637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:06.704637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:06.704637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:06.704637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:06.704637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:06.704637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:06.704637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:06.704637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:06.704637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:06.704637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:06.704637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:06.704637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:06.705433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:06.705433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:06.705433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:06.705433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:06.705433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:06.705433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:06.705433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:06.705433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:06.705433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:06.705433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:06.705433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:40:06.705433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:06.705433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 182/355] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:40:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:06.706084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb515a6-2ff8-4ab1-9700-e486eb1465a8 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:06.737371 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a3a9d-2c65-4465-9c8e-30e65a2464b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:06.738275 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a3a9d-2c65-4465-9c8e-30e65a2464b4 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:06.738451 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:06.738547 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a3a9d-2c65-4465-9c8e-30e65a2464b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:06.738965 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a3a9d-2c65-4465-9c8e-30e65a2464b4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:06.752722 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a3a9d-2c65-4465-9c8e-30e65a2464b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:06.762294 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-810a3a9d-2c65-4465-9c8e-30e65a2464b4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:40:06.762294 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:06.762294 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:06.762294 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:06.762294 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:06.762294 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:06.762294 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:06.762294 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:06.762294 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:06.762294 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:06.762294 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:06.762294 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:06.762294 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:06.762294 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:06.762294 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:06.762294 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:06.763440 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:06.763440 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:06.763440 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:06.763440 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:06.763440 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:06.763440 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:06.763440 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:06.763440 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:06.763440 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:06.763440 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:06.763440 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:06.763440 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:06.763440 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:06.763440 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:06.763440 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:06.763440 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:06.764345 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:06.764345 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:06.764345 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:06.764345 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:06.764345 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:06.764345 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:06.764345 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:06.764345 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:06.764345 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:06.764345 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:06.764345 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:40:06.764345 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:06.764345 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 174/356] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 10:40:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:06.765112 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a3a9d-2c65-4465-9c8e-30e65a2464b4 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:06.830926 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb515a6-2ff8-4ab1-9700-e486eb1465a8 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:06.845035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:06.872312 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578342be-2873-4944-973f-ddfc77675ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:06.873199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578342be-2873-4944-973f-ddfc77675ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:06.873485 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578342be-2873-4944-973f-ddfc77675ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:06.873766 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578342be-2873-4944-973f-ddfc77675ff0 None admin] PATH_INFO: `/v3/groups/79d30be0437e4a87b27484ad6a45fd74` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:06.875071 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578342be-2873-4944-973f-ddfc77675ff0 None admin] RBAC: Authorizing `identity:get_group(group_id=79d30be0437e4a87b27484ad6a45fd74)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:06.876553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578342be-2873-4944-973f-ddfc77675ff0 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:06.878602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 183/357] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jun 24 10:40:06 2022] GET /identity/v3/groups/79d30be0437e4a87b27484ad6a45fd74 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:06.880116 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460736d8-458f-421e-a345-251f68a3b88d None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:06.880230 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460736d8-458f-421e-a345-251f68a3b88d None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:06.880458 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460736d8-458f-421e-a345-251f68a3b88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:06.893357 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a3a9d-2c65-4465-9c8e-30e65a2464b4 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:06.901300 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-460736d8-458f-421e-a345-251f68a3b88d None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:06.902515 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-460736d8-458f-421e-a345-251f68a3b88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:06.936945 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5b210-4c67-405c-94cf-4a8339f73807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:06.937538 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5b210-4c67-405c-94cf-4a8339f73807 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:06.937826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5b210-4c67-405c-94cf-4a8339f73807 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:06.938107 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5b210-4c67-405c-94cf-4a8339f73807 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:06.938957 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5b210-4c67-405c-94cf-4a8339f73807 None admin] RBAC: Adding query filter params (group.id=79d30be0437e4a87b27484ad6a45fd74, role.id=19b4d737ab92430caeb4cd548049bcfc, scope.project.id=2ac825c0a6b546859d4dafd68f22a7ca) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:06.939774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5b210-4c67-405c-94cf-4a8339f73807 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:06.941355 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5b210-4c67-405c-94cf-4a8339f73807 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:06.948210 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 175/358] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Jun 24 10:40:06 2022] GET /identity/v3/role_assignments?group.id=79d30be0437e4a87b27484ad6a45fd74&scope.project.id=2ac825c0a6b546859d4dafd68f22a7ca&role.id=19b4d737ab92430caeb4cd548049bcfc => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:06.956229 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5b210-4c67-405c-94cf-4a8339f73807 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:06.994392 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 184/359] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:06.995545 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460736d8-458f-421e-a345-251f68a3b88d None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:07.045436 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:07.101522 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5b210-4c67-405c-94cf-4a8339f73807 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:07.136872 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:07.145614 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd16d6-d849-4df1-942f-d1054edae7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:07.146358 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460736d8-458f-421e-a345-251f68a3b88d None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:07.146467 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd16d6-d849-4df1-942f-d1054edae7e2 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:07.146700 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd16d6-d849-4df1-942f-d1054edae7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:07.146972 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd16d6-d849-4df1-942f-d1054edae7e2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:07.158506 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd16d6-d849-4df1-942f-d1054edae7e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:07.167009 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-b2dd16d6-d849-4df1-942f-d1054edae7e2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:40:07.167009 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:07.167009 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:07.167009 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:07.167009 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:07.167009 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:07.167009 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:07.167009 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:07.167009 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:07.167009 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:07.167009 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:07.167009 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:07.167009 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:07.167009 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:07.167009 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:07.167009 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:07.168028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:07.168028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:07.168028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:07.168028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:07.168028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:07.168028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:07.168028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:07.168028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:07.168028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:07.168028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:07.168028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:07.168028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:07.168028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:07.168028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:07.168028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:07.168028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:07.168924 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:07.168924 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:07.168924 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:07.168924 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:07.168924 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:07.168924 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:07.168924 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:07.168924 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:07.168924 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:07.168924 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:07.168924 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:40:07.168924 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:07.169563 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 176/360] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:40:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:07.170240 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd16d6-d849-4df1-942f-d1054edae7e2 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:07.195842 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba08110-6c75-4888-a29c-95ff5d101f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:07.198888 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba08110-6c75-4888-a29c-95ff5d101f84 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:07.198888 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba08110-6c75-4888-a29c-95ff5d101f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:07.198888 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba08110-6c75-4888-a29c-95ff5d101f84 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:07.199177 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba08110-6c75-4888-a29c-95ff5d101f84 None admin] RBAC: Adding query filter params (name=member) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:07.200101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba08110-6c75-4888-a29c-95ff5d101f84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:07.201508 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba08110-6c75-4888-a29c-95ff5d101f84 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:07.210336 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 185/361] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 10:40:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:07.211656 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba08110-6c75-4888-a29c-95ff5d101f84 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:07.321186 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd16d6-d849-4df1-942f-d1054edae7e2 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:07.327930 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:07.342460 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba08110-6c75-4888-a29c-95ff5d101f84 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:07.359498 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecc2fd-8e16-4395-b5d1-4715cec32d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:07.360190 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecc2fd-8e16-4395-b5d1-4715cec32d54 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:07.360718 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecc2fd-8e16-4395-b5d1-4715cec32d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:07.360718 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecc2fd-8e16-4395-b5d1-4715cec32d54 None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:07.361579 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ecc2fd-8e16-4395-b5d1-4715cec32d54 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:07.361851 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ecc2fd-8e16-4395-b5d1-4715cec32d54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:07.363287 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ecc2fd-8e16-4395-b5d1-4715cec32d54 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:07.374541 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 177/362] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:40:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:07.375049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecc2fd-8e16-4395-b5d1-4715cec32d54 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:07.387741 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f94b2e-5f3c-48a9-9e0a-2a442ebe4edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:07.388788 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f94b2e-5f3c-48a9-9e0a-2a442ebe4edc None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:07.389090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f94b2e-5f3c-48a9-9e0a-2a442ebe4edc None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:07.389362 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f94b2e-5f3c-48a9-9e0a-2a442ebe4edc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:07.390677 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f94b2e-5f3c-48a9-9e0a-2a442ebe4edc None admin] RBAC: Adding query filter params (group.id=79d30be0437e4a87b27484ad6a45fd74, role.id=4827ddfe1a0e476294ecf7f1d122cc32, scope.project.id=2ac825c0a6b546859d4dafd68f22a7ca) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:07.391139 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f94b2e-5f3c-48a9-9e0a-2a442ebe4edc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:07.392803 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f94b2e-5f3c-48a9-9e0a-2a442ebe4edc None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:07.400237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 186/363] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Jun 24 10:40:07 2022] GET /identity/v3/role_assignments?group.id=79d30be0437e4a87b27484ad6a45fd74&scope.project.id=2ac825c0a6b546859d4dafd68f22a7ca&role.id=4827ddfe1a0e476294ecf7f1d122cc32 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:07.401157 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f94b2e-5f3c-48a9-9e0a-2a442ebe4edc None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:07.441791 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:07.500935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecc2fd-8e16-4395-b5d1-4715cec32d54 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:07.541101 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99a2dd-30b8-4be4-bb1e-8eb823652a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:07.542338 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99a2dd-30b8-4be4-bb1e-8eb823652a71 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:07.542825 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99a2dd-30b8-4be4-bb1e-8eb823652a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:07.543343 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99a2dd-30b8-4be4-bb1e-8eb823652a71 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:07.558694 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f94b2e-5f3c-48a9-9e0a-2a442ebe4edc None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:07.560848 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99a2dd-30b8-4be4-bb1e-8eb823652a71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:07.575410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-ba99a2dd-30b8-4be4-bb1e-8eb823652a71 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:40:07.575410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:07.575410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:07.575410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:07.575410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:07.575410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:07.575410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:07.575410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:07.575410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:07.575410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:07.575410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:07.575410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:07.575410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:07.575410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:07.575410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:07.575410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:07.576897 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:07.576897 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:07.576897 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:07.576897 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:07.576897 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:07.576897 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:07.576897 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:07.576897 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:07.576897 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:07.576897 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:07.576897 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:07.576897 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:07.576897 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:07.576897 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:07.576897 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:07.576897 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:07.578218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:07.578218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:07.578218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:07.578218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:07.578218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:07.578218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:07.578218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:07.578218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:07.578218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:07.578218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:07.578218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:40:07.578218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:07.582488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 178/364] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:40:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:07.584135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99a2dd-30b8-4be4-bb1e-8eb823652a71 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:07.605154 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87943f-fafd-453d-b0f8-ad5f84dd6859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:07.605859 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87943f-fafd-453d-b0f8-ad5f84dd6859 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:07.606141 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87943f-fafd-453d-b0f8-ad5f84dd6859 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:07.606419 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87943f-fafd-453d-b0f8-ad5f84dd6859 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:07.607239 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87943f-fafd-453d-b0f8-ad5f84dd6859 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:07.607549 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87943f-fafd-453d-b0f8-ad5f84dd6859 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:07.608961 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87943f-fafd-453d-b0f8-ad5f84dd6859 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:07.620523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 187/365] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 10:40:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:07.624827 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87943f-fafd-453d-b0f8-ad5f84dd6859 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:07.641627 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:07.736921 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99a2dd-30b8-4be4-bb1e-8eb823652a71 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:07.747372 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87943f-fafd-453d-b0f8-ad5f84dd6859 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:07.751620 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:07.776353 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797dc539-11e9-4491-8cac-39f32bb76231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:07.777415 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797dc539-11e9-4491-8cac-39f32bb76231 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:07.777915 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797dc539-11e9-4491-8cac-39f32bb76231 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:07.778390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797dc539-11e9-4491-8cac-39f32bb76231 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:07.785898 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734b0f2-e669-4b82-ad9b-ce99da706625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:07.786556 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734b0f2-e669-4b82-ad9b-ce99da706625 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:07.786835 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734b0f2-e669-4b82-ad9b-ce99da706625 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:07.787109 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734b0f2-e669-4b82-ad9b-ce99da706625 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:07.875184 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797dc539-11e9-4491-8cac-39f32bb76231 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:07.876751 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797dc539-11e9-4491-8cac-39f32bb76231 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:07.893107 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734b0f2-e669-4b82-ad9b-ce99da706625 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:07.895261 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734b0f2-e669-4b82-ad9b-ce99da706625 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:07.910808 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:07.992500 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 179/366] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:40:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:07.992500 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797dc539-11e9-4491-8cac-39f32bb76231 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:08.026932 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 188/367] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:40:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:08.028075 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734b0f2-e669-4b82-ad9b-ce99da706625 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:08.031489 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:08.145750 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797dc539-11e9-4491-8cac-39f32bb76231 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:08.167180 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734b0f2-e669-4b82-ad9b-ce99da706625 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:08.191055 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cad5c0-8df0-4ac0-9257-33c0bca7b76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:08.191789 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cad5c0-8df0-4ac0-9257-33c0bca7b76b None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:08.192254 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cad5c0-8df0-4ac0-9257-33c0bca7b76b None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:08.192536 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cad5c0-8df0-4ac0-9257-33c0bca7b76b None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:08.193736 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cad5c0-8df0-4ac0-9257-33c0bca7b76b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:08.194324 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cad5c0-8df0-4ac0-9257-33c0bca7b76b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:08.196035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cad5c0-8df0-4ac0-9257-33c0bca7b76b None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:08.204208 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9e4f2-a658-4de9-894c-9f44f4baad46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:08.205307 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9e4f2-a658-4de9-894c-9f44f4baad46 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:08.205697 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9e4f2-a658-4de9-894c-9f44f4baad46 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:08.206075 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9e4f2-a658-4de9-894c-9f44f4baad46 None admin] PATH_INFO: `/v3/users/3e18fd1927104c0ebf429ed6e6b8d411` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:08.207498 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e9e4f2-a658-4de9-894c-9f44f4baad46 None admin] RBAC: Authorizing `identity:get_user(user_id=3e18fd1927104c0ebf429ed6e6b8d411)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:08.209031 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e9e4f2-a658-4de9-894c-9f44f4baad46 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:08.211586 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:08.212288 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 180/369] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:40:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:08.213649 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cad5c0-8df0-4ac0-9257-33c0bca7b76b None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:08.215381 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 189/369] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:40:08 2022] GET /identity/v3/users/3e18fd1927104c0ebf429ed6e6b8d411 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:08.216444 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9e4f2-a658-4de9-894c-9f44f4baad46 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:08.299981 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:08.329550 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cad5c0-8df0-4ac0-9257-33c0bca7b76b None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:08.356589 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9e4f2-a658-4de9-894c-9f44f4baad46 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:08.365278 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc1102-63d0-4ad5-a0cc-24a4c213f2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:08.366275 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc1102-63d0-4ad5-a0cc-24a4c213f2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:08.366626 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc1102-63d0-4ad5-a0cc-24a4c213f2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:08.366974 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc1102-63d0-4ad5-a0cc-24a4c213f2a9 None admin] PATH_INFO: `/v3/projects/d72a8e31265a4e11b5e71c627e803005` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:08.368310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc1102-63d0-4ad5-a0cc-24a4c213f2a9 None admin] RBAC: Authorizing `identity:get_project(project_id=d72a8e31265a4e11b5e71c627e803005)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:08.369833 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc1102-63d0-4ad5-a0cc-24a4c213f2a9 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:08.371958 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 181/370] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:40:08 2022] GET /identity/v3/projects/d72a8e31265a4e11b5e71c627e803005 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:08.372911 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc1102-63d0-4ad5-a0cc-24a4c213f2a9 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:08.393879 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ad7d3-336d-4e9b-a277-97a2553eaf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:08.394793 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ad7d3-336d-4e9b-a277-97a2553eaf89 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:08.395197 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ad7d3-336d-4e9b-a277-97a2553eaf89 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:08.395484 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ad7d3-336d-4e9b-a277-97a2553eaf89 None admin] PATH_INFO: `/v3/projects/d72a8e31265a4e11b5e71c627e803005` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:08.396677 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ad7d3-336d-4e9b-a277-97a2553eaf89 None admin] RBAC: Authorizing `identity:get_project(project_id=d72a8e31265a4e11b5e71c627e803005)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:08.398237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ad7d3-336d-4e9b-a277-97a2553eaf89 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:08.400462 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 190/371] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:40:08 2022] GET /identity/v3/projects/d72a8e31265a4e11b5e71c627e803005 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:08.401342 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ad7d3-336d-4e9b-a277-97a2553eaf89 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:08.454909 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:08.481264 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc1102-63d0-4ad5-a0cc-24a4c213f2a9 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:08.509360 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ad7d3-336d-4e9b-a277-97a2553eaf89 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:08.516507 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492c42b-5422-4475-b518-ece49a2c0bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:08.517225 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492c42b-5422-4475-b518-ece49a2c0bbe None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:08.517510 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492c42b-5422-4475-b518-ece49a2c0bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:08.517789 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492c42b-5422-4475-b518-ece49a2c0bbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:08.530844 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:08.548865 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553839e-d480-48c0-b286-b247d4d9ad08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:08.549886 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553839e-d480-48c0-b286-b247d4d9ad08 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:08.550378 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553839e-d480-48c0-b286-b247d4d9ad08 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:08.550899 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553839e-d480-48c0-b286-b247d4d9ad08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:08.552033 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553839e-d480-48c0-b286-b247d4d9ad08 None admin] RBAC: Adding query filter params (role.id=32aef7aad733481291827ac4c11ac6dd, user.id=3e18fd1927104c0ebf429ed6e6b8d411, scope.system=all) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:08.552516 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553839e-d480-48c0-b286-b247d4d9ad08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:08.554128 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553839e-d480-48c0-b286-b247d4d9ad08 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:08.568107 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 191/372] 10.222.0.16 () {56 vars in 1308 bytes} [Fri Jun 24 10:40:08 2022] GET /identity/v3/role_assignments?user.id=3e18fd1927104c0ebf429ed6e6b8d411&scope.system=all&role.id=32aef7aad733481291827ac4c11ac6dd => generated 510 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:08.569225 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553839e-d480-48c0-b286-b247d4d9ad08 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:08.618668 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492c42b-5422-4475-b518-ece49a2c0bbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:08.620201 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492c42b-5422-4475-b518-ece49a2c0bbe None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:08.684987 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553839e-d480-48c0-b286-b247d4d9ad08 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:08.696338 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:08.725000 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29b0a0-4ac8-4fa9-8b89-c1abc1e2364c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:08.726462 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29b0a0-4ac8-4fa9-8b89-c1abc1e2364c None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:08.727215 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29b0a0-4ac8-4fa9-8b89-c1abc1e2364c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:08.727662 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29b0a0-4ac8-4fa9-8b89-c1abc1e2364c None admin] PATH_INFO: `/v3/groups/79d30be0437e4a87b27484ad6a45fd74` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:08.729417 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29b0a0-4ac8-4fa9-8b89-c1abc1e2364c None admin] RBAC: Authorizing `identity:get_group(group_id=79d30be0437e4a87b27484ad6a45fd74)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:08.731136 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29b0a0-4ac8-4fa9-8b89-c1abc1e2364c None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:08.733750 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 192/373] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jun 24 10:40:08 2022] GET /identity/v3/groups/79d30be0437e4a87b27484ad6a45fd74 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:08.734915 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29b0a0-4ac8-4fa9-8b89-c1abc1e2364c None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:08.803265 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 182/374] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:40:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:08.803265 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492c42b-5422-4475-b518-ece49a2c0bbe None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:08.849750 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:08.852264 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29b0a0-4ac8-4fa9-8b89-c1abc1e2364c None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:08.892796 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7390b5-ca6b-4a8c-9081-676b65a95766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:08.894108 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7390b5-ca6b-4a8c-9081-676b65a95766 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:08.894990 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7390b5-ca6b-4a8c-9081-676b65a95766 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:08.895467 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7390b5-ca6b-4a8c-9081-676b65a95766 None admin] PATH_INFO: `/v3/groups/79d30be0437e4a87b27484ad6a45fd74` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:08.896969 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7390b5-ca6b-4a8c-9081-676b65a95766 None admin] RBAC: Authorizing `identity:get_group(group_id=79d30be0437e4a87b27484ad6a45fd74)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:08.898757 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7390b5-ca6b-4a8c-9081-676b65a95766 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:08.900714 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 193/375] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jun 24 10:40:08 2022] GET /identity/v3/groups/79d30be0437e4a87b27484ad6a45fd74 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:08.901756 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7390b5-ca6b-4a8c-9081-676b65a95766 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:08.913221 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492c42b-5422-4475-b518-ece49a2c0bbe None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:08.949143 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e6002-f6c8-4936-92c4-f4eb23f152bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:08.949817 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e6002-f6c8-4936-92c4-f4eb23f152bd None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:08.950099 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e6002-f6c8-4936-92c4-f4eb23f152bd None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:08.950374 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e6002-f6c8-4936-92c4-f4eb23f152bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:08.951239 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e6002-f6c8-4936-92c4-f4eb23f152bd None admin] RBAC: Adding query filter params (group.id=79d30be0437e4a87b27484ad6a45fd74, role.id=4827ddfe1a0e476294ecf7f1d122cc32, scope.project.id=d72a8e31265a4e11b5e71c627e803005) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:08.951554 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e6002-f6c8-4936-92c4-f4eb23f152bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:08.953006 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e6002-f6c8-4936-92c4-f4eb23f152bd None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:08.958048 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:08.958999 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 183/376] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Jun 24 10:40:08 2022] GET /identity/v3/role_assignments?group.id=79d30be0437e4a87b27484ad6a45fd74&scope.project.id=d72a8e31265a4e11b5e71c627e803005&role.id=4827ddfe1a0e476294ecf7f1d122cc32 => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:08.959840 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e6002-f6c8-4936-92c4-f4eb23f152bd None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:09.022305 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7390b5-ca6b-4a8c-9081-676b65a95766 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:09.061908 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199689b9-9e59-425a-bf4e-c5aab84e2f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:09.063247 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199689b9-9e59-425a-bf4e-c5aab84e2f37 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:09.063728 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199689b9-9e59-425a-bf4e-c5aab84e2f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:09.064545 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199689b9-9e59-425a-bf4e-c5aab84e2f37 None admin] PATH_INFO: `/v3/projects/f0f99060cebb41e8ac55ca6f1eeb4b0d` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:09.066015 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199689b9-9e59-425a-bf4e-c5aab84e2f37 None admin] RBAC: Authorizing `identity:get_project(project_id=f0f99060cebb41e8ac55ca6f1eeb4b0d)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:09.067914 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199689b9-9e59-425a-bf4e-c5aab84e2f37 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:09.070449 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 194/377] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:40:08 2022] GET /identity/v3/projects/f0f99060cebb41e8ac55ca6f1eeb4b0d => generated 344 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:09.076379 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199689b9-9e59-425a-bf4e-c5aab84e2f37 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:09.181418 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e6002-f6c8-4936-92c4-f4eb23f152bd None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:09.197033 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:09.199334 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199689b9-9e59-425a-bf4e-c5aab84e2f37 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:09.224442 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:09.248125 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb577971-0d22-4295-8b1e-f63476c53703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:09.250155 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb577971-0d22-4295-8b1e-f63476c53703 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:09.250546 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb577971-0d22-4295-8b1e-f63476c53703 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:09.250926 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb577971-0d22-4295-8b1e-f63476c53703 None admin] PATH_INFO: `/v3/groups/71f0610076f24ebcb90b01464ff751fa` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:09.260151 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb577971-0d22-4295-8b1e-f63476c53703 None admin] RBAC: Authorizing `identity:get_group(group_id=71f0610076f24ebcb90b01464ff751fa)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:09.261728 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb577971-0d22-4295-8b1e-f63476c53703 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:09.263516 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f8b7e-61c6-4288-9e04-85391fabf771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:09.264177 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 195/378] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jun 24 10:40:09 2022] GET /identity/v3/groups/71f0610076f24ebcb90b01464ff751fa => generated 229 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:09.264300 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f8b7e-61c6-4288-9e04-85391fabf771 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:09.264638 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f8b7e-61c6-4288-9e04-85391fabf771 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:09.264981 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f8b7e-61c6-4288-9e04-85391fabf771 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:09.265521 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ec292-353b-464c-a8c0-e2421cf78cb0 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:09.265820 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ec292-353b-464c-a8c0-e2421cf78cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:09.266103 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ec292-353b-464c-a8c0-e2421cf78cb0 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:09.266198 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f8b7e-61c6-4288-9e04-85391fabf771 None admin] RBAC: Adding query filter params (group.id=79d30be0437e4a87b27484ad6a45fd74, role.id=19b4d737ab92430caeb4cd548049bcfc, scope.project.id=d72a8e31265a4e11b5e71c627e803005) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:09.266506 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f8b7e-61c6-4288-9e04-85391fabf771 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:09.267482 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 196/379] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:09.268410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f8b7e-61c6-4288-9e04-85391fabf771 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:09.271527 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ec292-353b-464c-a8c0-e2421cf78cb0 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:09.277088 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 184/380] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Jun 24 10:40:08 2022] GET /identity/v3/role_assignments?group.id=79d30be0437e4a87b27484ad6a45fd74&scope.project.id=d72a8e31265a4e11b5e71c627e803005&role.id=19b4d737ab92430caeb4cd548049bcfc => generated 260 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:09.278228 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eebbbe-7e10-48e1-a6a5-e226922f12d8 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:09.278520 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eebbbe-7e10-48e1-a6a5-e226922f12d8 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:09.278803 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eebbbe-7e10-48e1-a6a5-e226922f12d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:09.320719 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-f5eebbbe-7e10-48e1-a6a5-e226922f12d8 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:09.322192 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-f5eebbbe-7e10-48e1-a6a5-e226922f12d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:09.410979 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ec292-353b-464c-a8c0-e2421cf78cb0 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:09.455596 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34351fbf-7e60-4030-a697-8c74b935012a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:09.455596 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34351fbf-7e60-4030-a697-8c74b935012a None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:09.455596 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34351fbf-7e60-4030-a697-8c74b935012a None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:09.455596 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34351fbf-7e60-4030-a697-8c74b935012a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:09.456351 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34351fbf-7e60-4030-a697-8c74b935012a None admin] RBAC: Adding query filter params (group.id=71f0610076f24ebcb90b01464ff751fa, role.id=4867b69c45554ce18e23167c05a02175, scope.project.id=f0f99060cebb41e8ac55ca6f1eeb4b0d) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:09.456666 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34351fbf-7e60-4030-a697-8c74b935012a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:09.458124 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34351fbf-7e60-4030-a697-8c74b935012a None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:09.467588 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 197/381] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Jun 24 10:40:09 2022] GET /identity/v3/role_assignments?group.id=71f0610076f24ebcb90b01464ff751fa&scope.project.id=f0f99060cebb41e8ac55ca6f1eeb4b0d&role.id=4867b69c45554ce18e23167c05a02175 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:40:09.499339 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 185/382] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:09.517476 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34351fbf-7e60-4030-a697-8c74b935012a None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:09.573343 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:09.642784 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34351fbf-7e60-4030-a697-8c74b935012a None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:09.682604 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053222c6-ad65-4131-b7b0-86c00ea254e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:09.687424 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053222c6-ad65-4131-b7b0-86c00ea254e5 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:09.687724 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053222c6-ad65-4131-b7b0-86c00ea254e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:09.688071 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053222c6-ad65-4131-b7b0-86c00ea254e5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:09.703754 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053222c6-ad65-4131-b7b0-86c00ea254e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:09.712337 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-053222c6-ad65-4131-b7b0-86c00ea254e5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:40:09.712337 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:09.712337 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:09.712337 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:09.712337 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:09.712337 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:09.712337 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:09.712337 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:09.712337 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:09.712337 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:09.712337 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:09.712337 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:09.712337 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:09.712337 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:09.712337 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:09.712337 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:09.713258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:09.713258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:09.713258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:09.713258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:09.713258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:09.713258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:09.713258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:09.713258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:09.713258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:09.713258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:09.713258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:09.713258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:09.713258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:09.713258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:09.713258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:09.713258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:09.714091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:09.714091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:09.714091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:09.714091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:09.714091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:09.714091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:09.714091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:09.714091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:09.714091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:09.714091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:09.714091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:40:09.714091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:09.714091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 198/383] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 10:40:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:09.719884 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eebbbe-7e10-48e1-a6a5-e226922f12d8 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:09.825176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:09.828076 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eebbbe-7e10-48e1-a6a5-e226922f12d8 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:09.865694 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7badf41-6b1e-46c6-bdae-a3659363e30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:09.866388 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7badf41-6b1e-46c6-bdae-a3659363e30e None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:09.866673 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7badf41-6b1e-46c6-bdae-a3659363e30e None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:09.866946 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7badf41-6b1e-46c6-bdae-a3659363e30e None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:09.867838 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7badf41-6b1e-46c6-bdae-a3659363e30e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:09.868301 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7badf41-6b1e-46c6-bdae-a3659363e30e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:09.869800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7badf41-6b1e-46c6-bdae-a3659363e30e None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:09.879050 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 186/384] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:40:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:09.884600 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053222c6-ad65-4131-b7b0-86c00ea254e5 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:10.033459 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:10.036609 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053222c6-ad65-4131-b7b0-86c00ea254e5 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:10.038083 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695d15c-bca2-4b17-9d2c-06c892b33eb1 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:10.038792 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695d15c-bca2-4b17-9d2c-06c892b33eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:10.040210 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695d15c-bca2-4b17-9d2c-06c892b33eb1 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:10.043072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 187/385] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:40:10.053193 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fd13d-37ba-4873-8c9d-e63a804a2c30 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:10.053680 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fd13d-37ba-4873-8c9d-e63a804a2c30 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:10.054116 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fd13d-37ba-4873-8c9d-e63a804a2c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:10.077792 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418040fe-9af4-48eb-8010-560f77d58f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:10.078578 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418040fe-9af4-48eb-8010-560f77d58f38 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:10.079537 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418040fe-9af4-48eb-8010-560f77d58f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:10.082467 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418040fe-9af4-48eb-8010-560f77d58f38 None admin] PATH_INFO: `/v3/groups/79d30be0437e4a87b27484ad6a45fd74` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:10.083955 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418040fe-9af4-48eb-8010-560f77d58f38 None admin] RBAC: Authorizing `identity:get_group(group_id=79d30be0437e4a87b27484ad6a45fd74)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:10.085579 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418040fe-9af4-48eb-8010-560f77d58f38 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:10.089244 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 199/386] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jun 24 10:40:09 2022] GET /identity/v3/groups/79d30be0437e4a87b27484ad6a45fd74 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:10.098125 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-049fd13d-37ba-4873-8c9d-e63a804a2c30 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:10.098125 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-049fd13d-37ba-4873-8c9d-e63a804a2c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:10.101430 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418040fe-9af4-48eb-8010-560f77d58f38 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:10.240119 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418040fe-9af4-48eb-8010-560f77d58f38 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:10.264886 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 188/387] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:40:10.276359 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aebd1b5-7d08-418c-a9f1-50023368ef47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:10.277246 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebd1b5-7d08-418c-a9f1-50023368ef47 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:10.277533 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebd1b5-7d08-418c-a9f1-50023368ef47 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:10.277814 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebd1b5-7d08-418c-a9f1-50023368ef47 None admin] PATH_INFO: `/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:10.279015 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aebd1b5-7d08-418c-a9f1-50023368ef47 None admin] RBAC: Authorizing `identity:get_project(project_id=2ac825c0a6b546859d4dafd68f22a7ca)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:10.280514 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aebd1b5-7d08-418c-a9f1-50023368ef47 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:10.286925 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 200/388] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:40:10 2022] GET /identity/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:10.288379 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fd13d-37ba-4873-8c9d-e63a804a2c30 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:10.297076 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aebd1b5-7d08-418c-a9f1-50023368ef47 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:10.346226 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:10.450635 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aebd1b5-7d08-418c-a9f1-50023368ef47 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:10.457256 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:10.473073 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fd13d-37ba-4873-8c9d-e63a804a2c30 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:10.524097 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04bbc2-33c9-452d-b005-5b09a1f6f747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:10.525268 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04bbc2-33c9-452d-b005-5b09a1f6f747 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:10.525774 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04bbc2-33c9-452d-b005-5b09a1f6f747 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:10.526253 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04bbc2-33c9-452d-b005-5b09a1f6f747 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:10.542286 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982c6e2-2f31-41c8-b2b1-07a0583081c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:10.543546 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982c6e2-2f31-41c8-b2b1-07a0583081c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:10.544098 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982c6e2-2f31-41c8-b2b1-07a0583081c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:10.544580 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982c6e2-2f31-41c8-b2b1-07a0583081c0 None admin] PATH_INFO: `/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca/groups/79d30be0437e4a87b27484ad6a45fd74/roles/19b4d737ab92430caeb4cd548049bcfc` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:10.546289 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04bbc2-33c9-452d-b005-5b09a1f6f747 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:10.547330 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f982c6e2-2f31-41c8-b2b1-07a0583081c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ac825c0a6b546859d4dafd68f22a7ca, group_id=79d30be0437e4a87b27484ad6a45fd74, role_id=19b4d737ab92430caeb4cd548049bcfc)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:10.548991 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f982c6e2-2f31-41c8-b2b1-07a0583081c0 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:10.554436 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-cc04bbc2-33c9-452d-b005-5b09a1f6f747 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:40:10.554436 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:10.554436 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:10.554436 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:10.554436 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:10.554436 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:10.554436 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:10.554436 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:10.554436 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:10.554436 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:10.554436 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:10.554436 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:10.554436 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:10.554436 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:10.554436 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:10.554436 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:10.555492 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:10.555492 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:10.555492 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:10.555492 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:10.555492 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:10.555492 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:10.555492 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:10.555492 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:10.555492 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:10.555492 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:10.555492 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:10.555492 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:10.555492 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:10.555492 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:10.555492 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:10.555492 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:10.556272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:10.556272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:10.556272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:10.556272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:10.556272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:10.556272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:10.556272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:10.556272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:10.556272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:10.556272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:10.556272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:40:10.556272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:10.562334 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 201/389] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:40:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:40:10.563505 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04bbc2-33c9-452d-b005-5b09a1f6f747 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:10.572751 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 189/390] 10.222.0.16 () {58 vars in 1442 bytes} [Fri Jun 24 10:40:10 2022] PUT /identity/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca/groups/79d30be0437e4a87b27484ad6a45fd74/roles/19b4d737ab92430caeb4cd548049bcfc => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:40:10.716497 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:10.723079 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04bbc2-33c9-452d-b005-5b09a1f6f747 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:10.775760 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ec23f-34b9-49b6-8f7f-cc819a69ec1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:10.776467 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ec23f-34b9-49b6-8f7f-cc819a69ec1d None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:10.776752 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ec23f-34b9-49b6-8f7f-cc819a69ec1d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:10.777031 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ec23f-34b9-49b6-8f7f-cc819a69ec1d None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:10.777889 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ec23f-34b9-49b6-8f7f-cc819a69ec1d None admin] RBAC: Adding query filter params (name=member) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:10.778198 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ec23f-34b9-49b6-8f7f-cc819a69ec1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:10.779720 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ec23f-34b9-49b6-8f7f-cc819a69ec1d None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:10.789517 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 202/391] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 10:40:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:40:10.795323 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982c6e2-2f31-41c8-b2b1-07a0583081c0 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:10.900580 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982c6e2-2f31-41c8-b2b1-07a0583081c0 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:10.936390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32a198-d532-476a-b03f-bd518af34eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:10.937243 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32a198-d532-476a-b03f-bd518af34eba None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:10.937528 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32a198-d532-476a-b03f-bd518af34eba None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:10.937805 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32a198-d532-476a-b03f-bd518af34eba None admin] PATH_INFO: `/v3/groups/79d30be0437e4a87b27484ad6a45fd74` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:10.938994 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32a198-d532-476a-b03f-bd518af34eba None admin] RBAC: Authorizing `identity:get_group(group_id=79d30be0437e4a87b27484ad6a45fd74)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:10.940927 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32a198-d532-476a-b03f-bd518af34eba None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:10.942920 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 190/392] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jun 24 10:40:10 2022] GET /identity/v3/groups/79d30be0437e4a87b27484ad6a45fd74 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:10.948587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ec23f-34b9-49b6-8f7f-cc819a69ec1d None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:11.068127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ec23f-34b9-49b6-8f7f-cc819a69ec1d None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:11.110824 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836ad66-6903-4b6c-b547-1fb8b22bf841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:11.112128 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836ad66-6903-4b6c-b547-1fb8b22bf841 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:11.112621 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836ad66-6903-4b6c-b547-1fb8b22bf841 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:11.113092 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836ad66-6903-4b6c-b547-1fb8b22bf841 None admin] PATH_INFO: `/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:11.114501 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836ad66-6903-4b6c-b547-1fb8b22bf841 None admin] RBAC: Authorizing `identity:get_project(project_id=2ac825c0a6b546859d4dafd68f22a7ca)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:11.116172 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836ad66-6903-4b6c-b547-1fb8b22bf841 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:11.118127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 203/393] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:40:10 2022] GET /identity/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:11.124220 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32a198-d532-476a-b03f-bd518af34eba None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:11.194235 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:11.309347 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32a198-d532-476a-b03f-bd518af34eba None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:11.353314 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bce2e7-2b92-4895-a2a9-4c5896b1b32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:11.354223 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bce2e7-2b92-4895-a2a9-4c5896b1b32b None admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:11.354504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bce2e7-2b92-4895-a2a9-4c5896b1b32b None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:11.354780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bce2e7-2b92-4895-a2a9-4c5896b1b32b None admin] PATH_INFO: `/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca/groups/79d30be0437e4a87b27484ad6a45fd74/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:11.356779 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bce2e7-2b92-4895-a2a9-4c5896b1b32b None admin] RBAC: Authorizing `identity:create_grant(project_id=2ac825c0a6b546859d4dafd68f22a7ca, group_id=79d30be0437e4a87b27484ad6a45fd74, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:11.358280 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bce2e7-2b92-4895-a2a9-4c5896b1b32b None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:11.381096 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 191/394] 10.222.0.16 () {58 vars in 1442 bytes} [Fri Jun 24 10:40:11 2022] PUT /identity/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca/groups/79d30be0437e4a87b27484ad6a45fd74/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:40:11.558189 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b43d5-fa6c-4268-adfe-067c6379c441 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:11.558499 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b43d5-fa6c-4268-adfe-067c6379c441 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:11.558659 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b43d5-fa6c-4268-adfe-067c6379c441 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:11.560429 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 204/395] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:11.566779 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7310d-b118-4355-9bc9-d5ec1100f122 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:11.567063 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7310d-b118-4355-9bc9-d5ec1100f122 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:11.567376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7310d-b118-4355-9bc9-d5ec1100f122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:11.592616 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-d5c7310d-b118-4355-9bc9-d5ec1100f122 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:11.593833 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-d5c7310d-b118-4355-9bc9-d5ec1100f122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:11.684079 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 192/396] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:11.708214 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b43d5-fa6c-4268-adfe-067c6379c441 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:11.740188 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:11.801043 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d7f4c-aaab-4588-b9ac-18846e4b52d8 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:11.801688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d7f4c-aaab-4588-b9ac-18846e4b52d8 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:11.802190 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d7f4c-aaab-4588-b9ac-18846e4b52d8 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:11.804208 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 193/397] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:11.809994 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762aac7d-78c9-4ddf-b35d-5df8e0c6a965 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:11.810552 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762aac7d-78c9-4ddf-b35d-5df8e0c6a965 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:11.811027 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762aac7d-78c9-4ddf-b35d-5df8e0c6a965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:11.829207 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-762aac7d-78c9-4ddf-b35d-5df8e0c6a965 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:11.830722 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-762aac7d-78c9-4ddf-b35d-5df8e0c6a965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:11.835010 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:11.851526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b43d5-fa6c-4268-adfe-067c6379c441 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:11.897250 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac5184-5151-4650-9f56-c23376ad357a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:11.898538 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac5184-5151-4650-9f56-c23376ad357a None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:11.899017 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac5184-5151-4650-9f56-c23376ad357a None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:11.899526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac5184-5151-4650-9f56-c23376ad357a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:11.910722 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac5184-5151-4650-9f56-c23376ad357a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:11.919080 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-98ac5184-5151-4650-9f56-c23376ad357a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:40:11.919080 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:11.919080 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:11.919080 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:11.919080 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:11.919080 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:11.919080 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:11.919080 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:11.919080 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:11.919080 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:11.919080 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:11.919080 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:11.919080 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:11.919080 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:11.919080 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:11.919080 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:11.920003 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:11.920003 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:11.920003 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:11.920003 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:11.920003 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:11.920003 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:11.920003 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:11.920003 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:11.920003 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:11.920003 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:11.920003 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:11.920003 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:11.920003 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:11.920003 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:11.920003 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:11.920003 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:11.920805 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:11.920805 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:11.920805 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:11.920805 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:11.920805 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:11.920805 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:11.920805 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:11.920805 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:11.920805 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:11.920805 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:11.920805 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:40:11.920805 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:11.923515 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 205/398] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:40:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:11.929505 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac5184-5151-4650-9f56-c23376ad357a None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:11.946395 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 194/399] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:40:11.951186 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8df4e0-3467-4b8b-9816-b8234cf0010d None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:11.951186 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8df4e0-3467-4b8b-9816-b8234cf0010d None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:11.951186 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8df4e0-3467-4b8b-9816-b8234cf0010d None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:11.951186 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 195/400] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:11.959540 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecc410-eed0-4548-9b67-f6df25d6635b None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:11.959824 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecc410-eed0-4548-9b67-f6df25d6635b None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:11.960101 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecc410-eed0-4548-9b67-f6df25d6635b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:11.983935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-5aecc410-eed0-4548-9b67-f6df25d6635b None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:11.985126 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-5aecc410-eed0-4548-9b67-f6df25d6635b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:12.035627 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:12.052688 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac5184-5151-4650-9f56-c23376ad357a None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:12.073386 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 196/401] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 24 10:40:12.074350 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aecc410-eed0-4548-9b67-f6df25d6635b None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:12.112361 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44a2d8-418a-45e6-9702-a94758a17708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:12.113157 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44a2d8-418a-45e6-9702-a94758a17708 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:12.113611 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44a2d8-418a-45e6-9702-a94758a17708 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:12.113982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44a2d8-418a-45e6-9702-a94758a17708 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:12.115065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f44a2d8-418a-45e6-9702-a94758a17708 None admin] RBAC: Adding query filter params (name=member) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:12.115545 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f44a2d8-418a-45e6-9702-a94758a17708 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:12.116987 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f44a2d8-418a-45e6-9702-a94758a17708 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:12.127809 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 206/402] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 10:40:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:12.129010 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44a2d8-418a-45e6-9702-a94758a17708 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:12.156988 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:12.195714 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aecc410-eed0-4548-9b67-f6df25d6635b None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:12.235980 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407543aa-d8ae-4067-8d57-681a650ad748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:12.236666 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407543aa-d8ae-4067-8d57-681a650ad748 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:12.236954 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407543aa-d8ae-4067-8d57-681a650ad748 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:12.237286 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407543aa-d8ae-4067-8d57-681a650ad748 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:12.248972 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407543aa-d8ae-4067-8d57-681a650ad748 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:12.257349 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-407543aa-d8ae-4067-8d57-681a650ad748 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:40:12.257349 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:12.257349 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:12.257349 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:12.257349 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:12.257349 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:12.257349 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:12.257349 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:12.257349 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:12.257349 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:12.257349 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:12.257349 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:12.257349 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:12.257349 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:12.257349 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:12.257349 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:12.258633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:12.258633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:12.258633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:12.258633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:12.258633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:12.258633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:12.258633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:12.258633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:12.258633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:12.258633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:12.258633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:12.258633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:12.258633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:12.258633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:12.258633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:12.258633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:12.259526 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:12.259526 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:12.259526 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:12.259526 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:12.259526 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:12.259526 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:12.259526 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:12.259526 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:12.259526 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:12.259526 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:12.259526 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:40:12.259526 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:12.259526 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 197/403] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 10:40:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:12.260181 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407543aa-d8ae-4067-8d57-681a650ad748 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:12.266543 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44a2d8-418a-45e6-9702-a94758a17708 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:12.315254 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a381ee-1886-48bb-85b9-f3136d4782c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:12.316708 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a381ee-1886-48bb-85b9-f3136d4782c5 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:12.317552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a381ee-1886-48bb-85b9-f3136d4782c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:12.318047 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a381ee-1886-48bb-85b9-f3136d4782c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:12.332681 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a381ee-1886-48bb-85b9-f3136d4782c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:12.344027 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-36a381ee-1886-48bb-85b9-f3136d4782c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:40:12.344027 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:12.344027 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:12.344027 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:12.344027 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:12.344027 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:12.344027 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:12.344027 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:12.344027 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:12.344027 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:12.344027 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:12.344027 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:12.344027 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:12.344027 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:12.344027 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:12.344027 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:12.345008 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:12.345008 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:12.345008 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:12.345008 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:12.345008 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:12.345008 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:12.345008 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:12.345008 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:12.345008 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:12.345008 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:12.345008 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:12.345008 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:12.345008 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:12.345008 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:12.345008 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:12.345008 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:12.345780 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:12.345780 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:12.345780 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:12.345780 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:12.345780 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:12.345780 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:12.345780 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:12.345780 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:12.345780 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:12.345780 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:12.345780 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:40:12.345780 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:12.353448 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 207/404] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:40:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:12.353448 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a381ee-1886-48bb-85b9-f3136d4782c5 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:12.369580 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:12.378832 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407543aa-d8ae-4067-8d57-681a650ad748 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:12.410873 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:12.418280 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe25540-cb89-4905-a90d-83f5c7d977ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:12.419356 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe25540-cb89-4905-a90d-83f5c7d977ab None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:12.419747 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe25540-cb89-4905-a90d-83f5c7d977ab None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:12.420214 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe25540-cb89-4905-a90d-83f5c7d977ab None admin] PATH_INFO: `/v3/groups/79d30be0437e4a87b27484ad6a45fd74` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:12.421703 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe25540-cb89-4905-a90d-83f5c7d977ab None admin] RBAC: Authorizing `identity:get_group(group_id=79d30be0437e4a87b27484ad6a45fd74)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:12.423346 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe25540-cb89-4905-a90d-83f5c7d977ab None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:12.425684 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 198/405] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jun 24 10:40:12 2022] GET /identity/v3/groups/79d30be0437e4a87b27484ad6a45fd74 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:12.426715 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe25540-cb89-4905-a90d-83f5c7d977ab None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:12.511071 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a381ee-1886-48bb-85b9-f3136d4782c5 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:12.541086 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe25540-cb89-4905-a90d-83f5c7d977ab None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:12.559203 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27073f-5a2c-4d56-ab3e-587ae464a1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:12.560488 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27073f-5a2c-4d56-ab3e-587ae464a1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:12.560948 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27073f-5a2c-4d56-ab3e-587ae464a1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:12.561385 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27073f-5a2c-4d56-ab3e-587ae464a1e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:12.562285 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27073f-5a2c-4d56-ab3e-587ae464a1e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:12.562748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27073f-5a2c-4d56-ab3e-587ae464a1e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:12.565474 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27073f-5a2c-4d56-ab3e-587ae464a1e1 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:12.577309 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 208/406] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:40:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:12.578324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27073f-5a2c-4d56-ab3e-587ae464a1e1 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:12.578937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121bb00-5811-4244-9bdb-cb171b1a4a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:12.579773 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121bb00-5811-4244-9bdb-cb171b1a4a7b None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:12.580315 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121bb00-5811-4244-9bdb-cb171b1a4a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:12.580692 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121bb00-5811-4244-9bdb-cb171b1a4a7b None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:12.581569 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2121bb00-5811-4244-9bdb-cb171b1a4a7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:12.582315 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2121bb00-5811-4244-9bdb-cb171b1a4a7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:12.583939 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2121bb00-5811-4244-9bdb-cb171b1a4a7b None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:12.598014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 199/407] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:40:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:12.598014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121bb00-5811-4244-9bdb-cb171b1a4a7b None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:12.671126 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:12.674647 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:12.707887 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27073f-5a2c-4d56-ab3e-587ae464a1e1 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:12.727366 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121bb00-5811-4244-9bdb-cb171b1a4a7b None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:12.756717 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3070ef9-7b0f-496a-a15a-7e00a016943d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:12.758213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3070ef9-7b0f-496a-a15a-7e00a016943d None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:12.758860 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3070ef9-7b0f-496a-a15a-7e00a016943d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:12.759314 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3070ef9-7b0f-496a-a15a-7e00a016943d None admin] PATH_INFO: `/v3/projects/d72a8e31265a4e11b5e71c627e803005` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:12.761225 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3070ef9-7b0f-496a-a15a-7e00a016943d None admin] RBAC: Authorizing `identity:get_project(project_id=d72a8e31265a4e11b5e71c627e803005)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:12.762818 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3070ef9-7b0f-496a-a15a-7e00a016943d None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:12.764726 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 209/408] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:40:12 2022] GET /identity/v3/projects/d72a8e31265a4e11b5e71c627e803005 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:12.764835 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245236b-2e90-4b19-a56d-08e2abf8f05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:12.765759 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3070ef9-7b0f-496a-a15a-7e00a016943d None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:12.766065 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245236b-2e90-4b19-a56d-08e2abf8f05f None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:12.766442 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245236b-2e90-4b19-a56d-08e2abf8f05f None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:12.766816 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245236b-2e90-4b19-a56d-08e2abf8f05f None admin] PATH_INFO: `/v3/groups/79d30be0437e4a87b27484ad6a45fd74` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:12.769891 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3245236b-2e90-4b19-a56d-08e2abf8f05f None admin] RBAC: Authorizing `identity:get_group(group_id=79d30be0437e4a87b27484ad6a45fd74)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:12.771954 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3245236b-2e90-4b19-a56d-08e2abf8f05f None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:12.774106 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 200/409] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jun 24 10:40:12 2022] GET /identity/v3/groups/79d30be0437e4a87b27484ad6a45fd74 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:12.775121 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245236b-2e90-4b19-a56d-08e2abf8f05f None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:12.892926 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3070ef9-7b0f-496a-a15a-7e00a016943d None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:12.917744 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245236b-2e90-4b19-a56d-08e2abf8f05f None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:12.930702 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd24503-c092-4df2-bceb-2697f45de2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:12.931056 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd24503-c092-4df2-bceb-2697f45de2dc None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:12.931472 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd24503-c092-4df2-bceb-2697f45de2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:12.931842 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd24503-c092-4df2-bceb-2697f45de2dc None admin] PATH_INFO: `/v3/groups/71f0610076f24ebcb90b01464ff751fa` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:12.933135 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd24503-c092-4df2-bceb-2697f45de2dc None admin] RBAC: Authorizing `identity:get_group(group_id=71f0610076f24ebcb90b01464ff751fa)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:12.934685 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd24503-c092-4df2-bceb-2697f45de2dc None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:12.936693 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 210/410] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jun 24 10:40:12 2022] GET /identity/v3/groups/71f0610076f24ebcb90b01464ff751fa => generated 229 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:12.937436 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd24503-c092-4df2-bceb-2697f45de2dc None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:12.947429 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:12.953443 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:12.966155 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f50f1d-dfb4-42bb-8916-8c1b3733015e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:12.967288 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f50f1d-dfb4-42bb-8916-8c1b3733015e None admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:12.967709 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f50f1d-dfb4-42bb-8916-8c1b3733015e None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:12.968119 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f50f1d-dfb4-42bb-8916-8c1b3733015e None admin] PATH_INFO: `/v3/projects/d72a8e31265a4e11b5e71c627e803005/groups/79d30be0437e4a87b27484ad6a45fd74/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:12.971044 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f50f1d-dfb4-42bb-8916-8c1b3733015e None admin] RBAC: Authorizing `identity:create_grant(project_id=d72a8e31265a4e11b5e71c627e803005, group_id=79d30be0437e4a87b27484ad6a45fd74, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:12.973470 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f50f1d-dfb4-42bb-8916-8c1b3733015e None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:12.995280 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 201/411] 10.222.0.16 () {58 vars in 1442 bytes} [Fri Jun 24 10:40:12 2022] PUT /identity/v3/projects/d72a8e31265a4e11b5e71c627e803005/groups/79d30be0437e4a87b27484ad6a45fd74/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:40:12.996390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f50f1d-dfb4-42bb-8916-8c1b3733015e None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:13.063873 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd24503-c092-4df2-bceb-2697f45de2dc None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:13.104810 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928283e-31ed-4ab8-ad56-3b9a76a1e0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:13.106185 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928283e-31ed-4ab8-ad56-3b9a76a1e0aa None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:13.106547 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928283e-31ed-4ab8-ad56-3b9a76a1e0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:13.106927 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928283e-31ed-4ab8-ad56-3b9a76a1e0aa None admin] PATH_INFO: `/v3/projects/d72a8e31265a4e11b5e71c627e803005` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:13.108506 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928283e-31ed-4ab8-ad56-3b9a76a1e0aa None admin] RBAC: Authorizing `identity:get_project(project_id=d72a8e31265a4e11b5e71c627e803005)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:13.110087 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928283e-31ed-4ab8-ad56-3b9a76a1e0aa None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:13.115331 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 211/412] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:40:12 2022] GET /identity/v3/projects/d72a8e31265a4e11b5e71c627e803005 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:13.118531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928283e-31ed-4ab8-ad56-3b9a76a1e0aa None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:13.145977 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f50f1d-dfb4-42bb-8916-8c1b3733015e None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:13.186624 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882fcc5-857e-4616-a47d-8d72fbecfc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:13.188280 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882fcc5-857e-4616-a47d-8d72fbecfc5b None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:13.188724 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882fcc5-857e-4616-a47d-8d72fbecfc5b None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:13.189510 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882fcc5-857e-4616-a47d-8d72fbecfc5b None admin] PATH_INFO: `/v3/projects/f0f99060cebb41e8ac55ca6f1eeb4b0d` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:13.191101 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882fcc5-857e-4616-a47d-8d72fbecfc5b None admin] RBAC: Authorizing `identity:get_project(project_id=f0f99060cebb41e8ac55ca6f1eeb4b0d)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:13.193193 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882fcc5-857e-4616-a47d-8d72fbecfc5b None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:13.196016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 202/413] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:40:12 2022] GET /identity/v3/projects/f0f99060cebb41e8ac55ca6f1eeb4b0d => generated 344 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:13.198033 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2fa023-a2e5-49cf-ae0b-5dc06dd41e7c None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:13.198479 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2fa023-a2e5-49cf-ae0b-5dc06dd41e7c None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:13.198896 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2fa023-a2e5-49cf-ae0b-5dc06dd41e7c None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:13.201157 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 203/414] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:13.202130 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2fa023-a2e5-49cf-ae0b-5dc06dd41e7c None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:13.212020 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:13.248989 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928283e-31ed-4ab8-ad56-3b9a76a1e0aa None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:13.279087 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:13.296840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb200d-1f74-4422-a6b8-fb15311a1207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:13.297866 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb200d-1f74-4422-a6b8-fb15311a1207 None admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:13.298210 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb200d-1f74-4422-a6b8-fb15311a1207 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:13.298552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb200d-1f74-4422-a6b8-fb15311a1207 None admin] PATH_INFO: `/v3/projects/d72a8e31265a4e11b5e71c627e803005/groups/79d30be0437e4a87b27484ad6a45fd74/roles/19b4d737ab92430caeb4cd548049bcfc` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:13.300897 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb200d-1f74-4422-a6b8-fb15311a1207 None admin] RBAC: Authorizing `identity:create_grant(project_id=d72a8e31265a4e11b5e71c627e803005, group_id=79d30be0437e4a87b27484ad6a45fd74, role_id=19b4d737ab92430caeb4cd548049bcfc)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:13.302944 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb200d-1f74-4422-a6b8-fb15311a1207 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:13.327718 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 212/415] 10.222.0.16 () {58 vars in 1442 bytes} [Fri Jun 24 10:40:13 2022] PUT /identity/v3/projects/d72a8e31265a4e11b5e71c627e803005/groups/79d30be0437e4a87b27484ad6a45fd74/roles/19b4d737ab92430caeb4cd548049bcfc => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:40:13.330225 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b23f1-4493-495e-87b1-abe980463e10 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:13.330767 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b23f1-4493-495e-87b1-abe980463e10 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:13.331920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b23f1-4493-495e-87b1-abe980463e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:13.349320 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2fa023-a2e5-49cf-ae0b-5dc06dd41e7c None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:13.365464 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-034b23f1-4493-495e-87b1-abe980463e10 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:13.368185 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-034b23f1-4493-495e-87b1-abe980463e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:13.418585 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eae887-badb-4374-910c-1c0cd9c19daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:13.419951 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eae887-badb-4374-910c-1c0cd9c19daf None admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:13.420420 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eae887-badb-4374-910c-1c0cd9c19daf None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:13.420900 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eae887-badb-4374-910c-1c0cd9c19daf None admin] PATH_INFO: `/v3/projects/f0f99060cebb41e8ac55ca6f1eeb4b0d/groups/71f0610076f24ebcb90b01464ff751fa/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:13.424913 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eae887-badb-4374-910c-1c0cd9c19daf None admin] RBAC: Authorizing `identity:create_grant(project_id=f0f99060cebb41e8ac55ca6f1eeb4b0d, group_id=71f0610076f24ebcb90b01464ff751fa, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:13.427507 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eae887-badb-4374-910c-1c0cd9c19daf None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:13.456119 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 204/416] 10.222.0.16 () {58 vars in 1442 bytes} [Fri Jun 24 10:40:13 2022] PUT /identity/v3/projects/f0f99060cebb41e8ac55ca6f1eeb4b0d/groups/71f0610076f24ebcb90b01464ff751fa/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:40:13.485036 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 213/417] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:13.527505 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eae887-badb-4374-910c-1c0cd9c19daf None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:13.668328 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eae887-badb-4374-910c-1c0cd9c19daf None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:13.691224 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:13.707390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c030dae-a8c6-45c4-b0ae-66b8b4e168cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:13.708238 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c030dae-a8c6-45c4-b0ae-66b8b4e168cb None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:13.708525 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c030dae-a8c6-45c4-b0ae-66b8b4e168cb None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:13.708805 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c030dae-a8c6-45c4-b0ae-66b8b4e168cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:13.720070 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c030dae-a8c6-45c4-b0ae-66b8b4e168cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:13.728726 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-8c030dae-a8c6-45c4-b0ae-66b8b4e168cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:40:13.728726 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:13.728726 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:13.728726 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:13.728726 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:13.728726 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:13.728726 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:13.728726 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:13.728726 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:13.728726 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:13.728726 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:13.728726 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:13.728726 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:13.728726 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:13.728726 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:13.728726 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:13.729625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:13.729625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:13.729625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:13.729625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:13.729625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:13.729625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:13.729625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:13.729625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:13.729625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:13.729625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:13.729625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:13.729625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:13.729625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:13.729625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:13.729625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:13.729625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:13.730430 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:13.730430 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:13.730430 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:13.730430 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:13.730430 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:13.730430 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:13.730430 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:13.730430 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:13.730430 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:13.730430 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:13.730430 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:40:13.730430 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:13.734933 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 205/418] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 10:40:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:13.736739 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b23f1-4493-495e-87b1-abe980463e10 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:13.808481 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:13.863484 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b23f1-4493-495e-87b1-abe980463e10 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:13.906660 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba81878-52cf-476c-a6d2-7ca713ece2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:13.908750 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba81878-52cf-476c-a6d2-7ca713ece2f9 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:13.909031 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba81878-52cf-476c-a6d2-7ca713ece2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:13.909303 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba81878-52cf-476c-a6d2-7ca713ece2f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:13.910060 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba81878-52cf-476c-a6d2-7ca713ece2f9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:13.910366 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba81878-52cf-476c-a6d2-7ca713ece2f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:13.911776 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba81878-52cf-476c-a6d2-7ca713ece2f9 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:13.925418 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 214/419] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:40:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:13.931276 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c030dae-a8c6-45c4-b0ae-66b8b4e168cb None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:14.021859 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58914fab-c368-42f7-8ca8-7dc9902712ce None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:14.022047 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58914fab-c368-42f7-8ca8-7dc9902712ce None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:14.022462 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58914fab-c368-42f7-8ca8-7dc9902712ce None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:14.024653 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 215/420] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:14.029684 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25e9d6-2dfa-40bc-88d8-6cb00878bd51 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:14.030004 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25e9d6-2dfa-40bc-88d8-6cb00878bd51 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:14.030350 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25e9d6-2dfa-40bc-88d8-6cb00878bd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:14.046994 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-cf25e9d6-2dfa-40bc-88d8-6cb00878bd51 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:14.048357 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-cf25e9d6-2dfa-40bc-88d8-6cb00878bd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:14.055775 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c030dae-a8c6-45c4-b0ae-66b8b4e168cb None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:14.092989 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3d283-d0fd-4dba-8f90-bdaa130fc206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:14.093960 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3d283-d0fd-4dba-8f90-bdaa130fc206 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:14.094442 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3d283-d0fd-4dba-8f90-bdaa130fc206 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:14.094899 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3d283-d0fd-4dba-8f90-bdaa130fc206 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:14.144252 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:14.169598 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e3d283-d0fd-4dba-8f90-bdaa130fc206 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:14.171433 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e3d283-d0fd-4dba-8f90-bdaa130fc206 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:14.228877 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 216/421] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:40:14.264190 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25e9d6-2dfa-40bc-88d8-6cb00878bd51 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:14.283083 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 206/422] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:40:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:14.286302 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3d283-d0fd-4dba-8f90-bdaa130fc206 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:14.327612 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:14.385721 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25e9d6-2dfa-40bc-88d8-6cb00878bd51 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:14.412847 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:14.454368 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3d283-d0fd-4dba-8f90-bdaa130fc206 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:14.457583 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7d7d7-5da5-47dd-81c9-d38afe2fb81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:14.458439 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7d7d7-5da5-47dd-81c9-d38afe2fb81c None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:14.458726 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7d7d7-5da5-47dd-81c9-d38afe2fb81c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:14.458996 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7d7d7-5da5-47dd-81c9-d38afe2fb81c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:14.482543 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7d7d7-5da5-47dd-81c9-d38afe2fb81c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:14.490812 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-b8c7d7d7-5da5-47dd-81c9-d38afe2fb81c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:40:14.490812 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:14.490812 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:14.490812 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:14.490812 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:14.490812 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:14.490812 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:14.490812 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:14.490812 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:14.490812 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:14.490812 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:14.490812 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:14.490812 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:14.490812 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:14.490812 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:14.490812 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:14.491730 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:14.491730 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:14.491730 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:14.491730 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:14.491730 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:14.491730 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:14.491730 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:14.491730 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:14.491730 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:14.491730 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:14.491730 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:14.491730 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:14.491730 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:14.491730 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:14.491730 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:14.491730 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:14.492576 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:14.492576 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:14.492576 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:14.492576 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:14.492576 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:14.492576 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:14.492576 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:14.492576 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:14.492576 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:14.492576 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:14.492576 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:40:14.492576 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:14.501420 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c3733-4247-41fd-b90d-fa7529eff1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:14.501420 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c3733-4247-41fd-b90d-fa7529eff1af None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:14.501420 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c3733-4247-41fd-b90d-fa7529eff1af None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:14.501420 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c3733-4247-41fd-b90d-fa7529eff1af None admin] PATH_INFO: `/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:14.504927 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 217/423] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:40:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:40:14.505633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c3733-4247-41fd-b90d-fa7529eff1af None admin] RBAC: Authorizing `identity:get_project(project_id=2ac825c0a6b546859d4dafd68f22a7ca)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:14.507103 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c3733-4247-41fd-b90d-fa7529eff1af None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:14.510008 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7d7d7-5da5-47dd-81c9-d38afe2fb81c None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:14.514646 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 207/424] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:40:14 2022] GET /identity/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:14.514820 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c3733-4247-41fd-b90d-fa7529eff1af None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:14.679688 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7d7d7-5da5-47dd-81c9-d38afe2fb81c None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:14.682874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c3733-4247-41fd-b90d-fa7529eff1af None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:14.718247 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:14.735904 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4416cd0-c5b6-4451-bbb8-b6b1f4e2a8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:14.736795 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4416cd0-c5b6-4451-bbb8-b6b1f4e2a8d4 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:14.737090 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4416cd0-c5b6-4451-bbb8-b6b1f4e2a8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:14.738083 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4416cd0-c5b6-4451-bbb8-b6b1f4e2a8d4 None admin] PATH_INFO: `/v3/groups/79d30be0437e4a87b27484ad6a45fd74` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:14.739960 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4416cd0-c5b6-4451-bbb8-b6b1f4e2a8d4 None admin] RBAC: Authorizing `identity:get_group(group_id=79d30be0437e4a87b27484ad6a45fd74)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:14.741628 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4416cd0-c5b6-4451-bbb8-b6b1f4e2a8d4 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:14.743498 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 208/425] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jun 24 10:40:14 2022] GET /identity/v3/groups/79d30be0437e4a87b27484ad6a45fd74 => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:14.750474 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4416cd0-c5b6-4451-bbb8-b6b1f4e2a8d4 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:14.752165 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5305a31-bd80-4a39-b252-d544e18c77c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:14.752847 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5305a31-bd80-4a39-b252-d544e18c77c2 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:14.753127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5305a31-bd80-4a39-b252-d544e18c77c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:14.753403 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5305a31-bd80-4a39-b252-d544e18c77c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:14.754167 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5305a31-bd80-4a39-b252-d544e18c77c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:14.754477 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5305a31-bd80-4a39-b252-d544e18c77c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:14.755870 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5305a31-bd80-4a39-b252-d544e18c77c2 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:14.776989 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 218/426] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 10:40:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:14.782096 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5305a31-bd80-4a39-b252-d544e18c77c2 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:14.795531 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:14.900286 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4416cd0-c5b6-4451-bbb8-b6b1f4e2a8d4 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:14.938298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce28f7-f797-434b-a4ec-6bd00f04feb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:14.938879 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce28f7-f797-434b-a4ec-6bd00f04feb4 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:14.939854 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce28f7-f797-434b-a4ec-6bd00f04feb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:14.940941 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce28f7-f797-434b-a4ec-6bd00f04feb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:14.942150 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce28f7-f797-434b-a4ec-6bd00f04feb4 None admin] RBAC: Adding query filter params (group.id=79d30be0437e4a87b27484ad6a45fd74, role.id=19b4d737ab92430caeb4cd548049bcfc, scope.project.id=2ac825c0a6b546859d4dafd68f22a7ca) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:14.942669 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce28f7-f797-434b-a4ec-6bd00f04feb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:14.944499 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce28f7-f797-434b-a4ec-6bd00f04feb4 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:14.957009 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 209/427] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Jun 24 10:40:14 2022] GET /identity/v3/role_assignments?group.id=79d30be0437e4a87b27484ad6a45fd74&scope.project.id=2ac825c0a6b546859d4dafd68f22a7ca&role.id=19b4d737ab92430caeb4cd548049bcfc => generated 611 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:14.979425 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5305a31-bd80-4a39-b252-d544e18c77c2 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:15.014560 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4aee9b-9c49-4867-8a2b-97838dd7db9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:15.015252 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4aee9b-9c49-4867-8a2b-97838dd7db9b None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:15.015535 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4aee9b-9c49-4867-8a2b-97838dd7db9b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:15.015812 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4aee9b-9c49-4867-8a2b-97838dd7db9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:15.065289 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:15.088922 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4aee9b-9c49-4867-8a2b-97838dd7db9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:15.090669 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4aee9b-9c49-4867-8a2b-97838dd7db9b None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:15.196700 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 219/428] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:40:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:15.202441 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce28f7-f797-434b-a4ec-6bd00f04feb4 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:15.295672 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:15.324571 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce28f7-f797-434b-a4ec-6bd00f04feb4 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:15.356519 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f8fe5-441f-4a94-9f82-e0a6d87d1b56 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:15.357037 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f8fe5-441f-4a94-9f82-e0a6d87d1b56 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:15.357128 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f8fe5-441f-4a94-9f82-e0a6d87d1b56 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:15.359227 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 220/429] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:40:15.365307 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba2cc1-39c6-4bbc-8c9d-8b2c4c933d32 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:15.365663 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba2cc1-39c6-4bbc-8c9d-8b2c4c933d32 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:15.366010 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba2cc1-39c6-4bbc-8c9d-8b2c4c933d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:15.370898 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65c8eb-24e6-42b7-a1ee-b3b5f0d4e64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:15.372209 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65c8eb-24e6-42b7-a1ee-b3b5f0d4e64c None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:15.372661 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65c8eb-24e6-42b7-a1ee-b3b5f0d4e64c None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:15.373964 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65c8eb-24e6-42b7-a1ee-b3b5f0d4e64c None admin] PATH_INFO: `/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:15.375424 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd65c8eb-24e6-42b7-a1ee-b3b5f0d4e64c None admin] RBAC: Authorizing `identity:get_project(project_id=2ac825c0a6b546859d4dafd68f22a7ca)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:15.377040 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd65c8eb-24e6-42b7-a1ee-b3b5f0d4e64c None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:15.379663 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 210/430] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:40:15 2022] GET /identity/v3/projects/2ac825c0a6b546859d4dafd68f22a7ca => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:15.385221 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65c8eb-24e6-42b7-a1ee-b3b5f0d4e64c None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:15.387572 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-1cba2cc1-39c6-4bbc-8c9d-8b2c4c933d32 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:15.389050 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1cba2cc1-39c6-4bbc-8c9d-8b2c4c933d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:15.479385 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 221/431] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:40:15.489078 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65c8eb-24e6-42b7-a1ee-b3b5f0d4e64c None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:15.505078 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba2cc1-39c6-4bbc-8c9d-8b2c4c933d32 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:15.524187 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db79a6-1121-45f3-95ed-42dda65570d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:15.525375 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db79a6-1121-45f3-95ed-42dda65570d9 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:15.525863 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db79a6-1121-45f3-95ed-42dda65570d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:15.526323 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db79a6-1121-45f3-95ed-42dda65570d9 None admin] PATH_INFO: `/v3/groups/79d30be0437e4a87b27484ad6a45fd74` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:15.527724 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db79a6-1121-45f3-95ed-42dda65570d9 None admin] RBAC: Authorizing `identity:get_group(group_id=79d30be0437e4a87b27484ad6a45fd74)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:15.529364 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db79a6-1121-45f3-95ed-42dda65570d9 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:15.531484 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 211/432] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jun 24 10:40:15 2022] GET /identity/v3/groups/79d30be0437e4a87b27484ad6a45fd74 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:40:15.536475 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:15.537617 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db79a6-1121-45f3-95ed-42dda65570d9 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:15.553331 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:15.634563 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba2cc1-39c6-4bbc-8c9d-8b2c4c933d32 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:15.649344 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db79a6-1121-45f3-95ed-42dda65570d9 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:15.678756 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c3e1b-5a73-405e-9279-20861b8ebfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:15.679949 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c3e1b-5a73-405e-9279-20861b8ebfe5 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:15.680260 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c3e1b-5a73-405e-9279-20861b8ebfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:15.680559 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c3e1b-5a73-405e-9279-20861b8ebfe5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:15.690149 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931ee25-9dc0-4f7b-95cd-81d4c3bc3724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:15.691067 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931ee25-9dc0-4f7b-95cd-81d4c3bc3724 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:15.691548 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931ee25-9dc0-4f7b-95cd-81d4c3bc3724 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:15.692021 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931ee25-9dc0-4f7b-95cd-81d4c3bc3724 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:15.693176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2931ee25-9dc0-4f7b-95cd-81d4c3bc3724 None admin] RBAC: Adding query filter params (group.id=79d30be0437e4a87b27484ad6a45fd74, role.id=4827ddfe1a0e476294ecf7f1d122cc32, scope.project.id=2ac825c0a6b546859d4dafd68f22a7ca) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:15.693704 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2931ee25-9dc0-4f7b-95cd-81d4c3bc3724 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:15.694022 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c3e1b-5a73-405e-9279-20861b8ebfe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:15.695635 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2931ee25-9dc0-4f7b-95cd-81d4c3bc3724 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:15.707170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-ba3c3e1b-5a73-405e-9279-20861b8ebfe5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:40:15.707170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:15.707170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:15.707170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:15.707170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:15.707170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:15.707170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:15.707170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:15.707170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:15.707170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:15.707170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:15.707170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:15.707170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:15.707170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:15.707170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:15.707170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:15.708142 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:15.708142 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:15.708142 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:15.708142 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:15.708142 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:15.708142 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:15.708142 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:15.708142 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:15.708142 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:15.708142 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:15.708142 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:15.708142 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:15.708142 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:15.708142 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:15.708142 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:15.708142 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:15.708920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:15.708920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:15.708920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:15.708920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:15.708920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:15.708920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:15.708920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:15.708920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:15.708920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:15.708920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:15.708920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:40:15.708920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:15.709520 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 222/433] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:40:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:40:15.710558 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 212/434] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Jun 24 10:40:15 2022] GET /identity/v3/role_assignments?group.id=79d30be0437e4a87b27484ad6a45fd74&scope.project.id=2ac825c0a6b546859d4dafd68f22a7ca&role.id=4827ddfe1a0e476294ecf7f1d122cc32 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:40:15.711233 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c3e1b-5a73-405e-9279-20861b8ebfe5 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:15.786357 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:15.824025 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c3e1b-5a73-405e-9279-20861b8ebfe5 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:15.862160 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b337a0-cd66-4fd9-89b7-52901a4945cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:15.863453 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b337a0-cd66-4fd9-89b7-52901a4945cd None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:15.863453 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b337a0-cd66-4fd9-89b7-52901a4945cd None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:15.863453 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b337a0-cd66-4fd9-89b7-52901a4945cd None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:15.864198 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b337a0-cd66-4fd9-89b7-52901a4945cd None admin] RBAC: Adding query filter params (name=member) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:15.864529 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b337a0-cd66-4fd9-89b7-52901a4945cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:15.865900 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b337a0-cd66-4fd9-89b7-52901a4945cd None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:15.875457 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 223/435] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 10:40:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:15.880956 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931ee25-9dc0-4f7b-95cd-81d4c3bc3724 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:15.887465 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd007a-b6b8-4dba-85e5-29a07cd02085 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:15.887761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd007a-b6b8-4dba-85e5-29a07cd02085 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:15.888050 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd007a-b6b8-4dba-85e5-29a07cd02085 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:15.889700 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 224/436] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:15.894524 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3a70c-7144-475f-9818-f1f6d2c65a29 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:15.894819 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3a70c-7144-475f-9818-f1f6d2c65a29 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:15.895109 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3a70c-7144-475f-9818-f1f6d2c65a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:15.912489 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-25d3a70c-7144-475f-9818-f1f6d2c65a29 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:15.913699 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-25d3a70c-7144-475f-9818-f1f6d2c65a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:15.983849 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:16.012383 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 225/437] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:40:16.016992 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931ee25-9dc0-4f7b-95cd-81d4c3bc3724 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:16.035569 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3a70c-7144-475f-9818-f1f6d2c65a29 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:16.058418 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33be8d-6311-450b-9278-4892cc0b288d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:16.059018 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33be8d-6311-450b-9278-4892cc0b288d None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:16.059339 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33be8d-6311-450b-9278-4892cc0b288d None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:16.059611 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33be8d-6311-450b-9278-4892cc0b288d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:16.100732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:16.149595 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e33be8d-6311-450b-9278-4892cc0b288d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:16.151062 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e33be8d-6311-450b-9278-4892cc0b288d None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:16.157903 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3a70c-7144-475f-9818-f1f6d2c65a29 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:16.207626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb95f4-7af1-4ac2-8bc4-7d23e46bb693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:16.208820 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb95f4-7af1-4ac2-8bc4-7d23e46bb693 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:16.209097 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb95f4-7af1-4ac2-8bc4-7d23e46bb693 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:16.209690 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb95f4-7af1-4ac2-8bc4-7d23e46bb693 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:16.221344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fb95f4-7af1-4ac2-8bc4-7d23e46bb693 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:16.229765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-91fb95f4-7af1-4ac2-8bc4-7d23e46bb693 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:40:16.229765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:16.229765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:16.229765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:16.229765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:16.229765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:16.229765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:16.229765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:16.229765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:16.229765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:16.229765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:16.229765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:16.229765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:16.229765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:16.229765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:16.229765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:16.230674 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:16.230674 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:16.230674 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:16.230674 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:16.230674 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:16.230674 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:16.230674 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:16.230674 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:16.230674 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:16.230674 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:16.230674 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:16.230674 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:16.230674 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:16.230674 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:16.230674 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:16.230674 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:16.231890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:16.231890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:16.231890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:16.231890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:16.231890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:16.231890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:16.231890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:16.231890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:16.231890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:16.231890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:16.231890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:40:16.231890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:16.231890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 226/438] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 10:40:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:40:16.232542 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfba066-e23f-4201-a1e7-5873f9fc66f8 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:16.232542 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfba066-e23f-4201-a1e7-5873f9fc66f8 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:16.233107 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfba066-e23f-4201-a1e7-5873f9fc66f8 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:16.235308 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 227/439] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:16.239230 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfba066-e23f-4201-a1e7-5873f9fc66f8 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:16.252797 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:16.285889 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 213/440] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:40:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:16.287424 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4ab79-8724-4a45-966e-f9385d71575e None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:16.287824 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4ab79-8724-4a45-966e-f9385d71575e None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:16.288182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4ab79-8724-4a45-966e-f9385d71575e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:16.307095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-36a4ab79-8724-4a45-966e-f9385d71575e None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:16.308393 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-36a4ab79-8724-4a45-966e-f9385d71575e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:16.358328 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfba066-e23f-4201-a1e7-5873f9fc66f8 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:16.377988 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:16.381877 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 214/441] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:16.383426 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4ab79-8724-4a45-966e-f9385d71575e None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:16.397770 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb5f5f-7945-468b-80b5-a14be0c4ab25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:16.398691 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb5f5f-7945-468b-80b5-a14be0c4ab25 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:16.398980 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb5f5f-7945-468b-80b5-a14be0c4ab25 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:16.399417 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb5f5f-7945-468b-80b5-a14be0c4ab25 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:16.400224 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb5f5f-7945-468b-80b5-a14be0c4ab25 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:16.400534 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb5f5f-7945-468b-80b5-a14be0c4ab25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:16.402352 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb5f5f-7945-468b-80b5-a14be0c4ab25 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:16.411011 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 228/442] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:40:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:40:16.411907 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb5f5f-7945-468b-80b5-a14be0c4ab25 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:16.489101 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4ab79-8724-4a45-966e-f9385d71575e None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:16.496159 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:16.512664 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb5f5f-7945-468b-80b5-a14be0c4ab25 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:16.524527 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14992d52-d0b9-45ab-af04-c8ea01aac9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:16.525424 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14992d52-d0b9-45ab-af04-c8ea01aac9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:16.525709 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14992d52-d0b9-45ab-af04-c8ea01aac9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:16.525989 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14992d52-d0b9-45ab-af04-c8ea01aac9d5 None admin] PATH_INFO: `/v3/projects/d72a8e31265a4e11b5e71c627e803005` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:16.527215 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14992d52-d0b9-45ab-af04-c8ea01aac9d5 None admin] RBAC: Authorizing `identity:get_project(project_id=d72a8e31265a4e11b5e71c627e803005)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:16.528682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14992d52-d0b9-45ab-af04-c8ea01aac9d5 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:16.530388 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 215/443] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:40:16 2022] GET /identity/v3/projects/d72a8e31265a4e11b5e71c627e803005 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:16.531170 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14992d52-d0b9-45ab-af04-c8ea01aac9d5 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:16.549495 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d8482-fc92-4e0a-aaff-23ad4f766fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:16.550305 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d8482-fc92-4e0a-aaff-23ad4f766fde None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:16.550590 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d8482-fc92-4e0a-aaff-23ad4f766fde None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:16.550865 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d8482-fc92-4e0a-aaff-23ad4f766fde None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:16.560936 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d8482-fc92-4e0a-aaff-23ad4f766fde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:16.568892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-8b5d8482-fc92-4e0a-aaff-23ad4f766fde None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:40:16.568892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:16.568892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:16.568892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:16.568892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:16.568892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:16.568892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:16.568892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:16.568892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:16.568892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:16.568892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:16.568892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:16.568892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:16.568892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:16.568892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:16.568892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:16.570042 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:16.570042 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:16.570042 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:16.570042 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:16.570042 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:16.570042 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:16.570042 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:16.570042 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:16.570042 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:16.570042 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:16.570042 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:16.570042 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:16.570042 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:16.570042 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:16.570042 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:16.570042 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:16.571061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:16.571061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:16.571061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:16.571061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:16.571061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:16.571061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:16.571061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:16.571061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:16.571061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:16.571061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:16.571061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:40:16.571061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:16.575400 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 229/444] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:40:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:16.576086 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d8482-fc92-4e0a-aaff-23ad4f766fde None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:16.619899 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:16.636903 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14992d52-d0b9-45ab-af04-c8ea01aac9d5 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:16.673903 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a00fb-2354-45ba-9107-b9a992600cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:16.674570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a00fb-2354-45ba-9107-b9a992600cbc None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:16.674860 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a00fb-2354-45ba-9107-b9a992600cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:16.675135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a00fb-2354-45ba-9107-b9a992600cbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:16.686069 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d8482-fc92-4e0a-aaff-23ad4f766fde None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:16.717607 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:16.720250 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c37b5-fa3c-45e5-8917-63ca06493747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:16.721142 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c37b5-fa3c-45e5-8917-63ca06493747 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:16.721426 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c37b5-fa3c-45e5-8917-63ca06493747 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:16.721694 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c37b5-fa3c-45e5-8917-63ca06493747 None admin] PATH_INFO: `/v3/groups/79d30be0437e4a87b27484ad6a45fd74` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:16.722900 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c37b5-fa3c-45e5-8917-63ca06493747 None admin] RBAC: Authorizing `identity:get_group(group_id=79d30be0437e4a87b27484ad6a45fd74)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:16.724386 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c37b5-fa3c-45e5-8917-63ca06493747 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:16.726281 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 230/445] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jun 24 10:40:16 2022] GET /identity/v3/groups/79d30be0437e4a87b27484ad6a45fd74 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:16.726932 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c37b5-fa3c-45e5-8917-63ca06493747 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:16.747030 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a00fb-2354-45ba-9107-b9a992600cbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:16.748516 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a00fb-2354-45ba-9107-b9a992600cbc None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:16.839903 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c37b5-fa3c-45e5-8917-63ca06493747 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:16.851516 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:16.861421 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 216/446] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:40:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:16.861421 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a00fb-2354-45ba-9107-b9a992600cbc None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:16.876845 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c839f32-d879-402f-91b7-7e997b290061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:16.877437 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c839f32-d879-402f-91b7-7e997b290061 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:16.877712 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c839f32-d879-402f-91b7-7e997b290061 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:16.877983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c839f32-d879-402f-91b7-7e997b290061 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:16.878722 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c839f32-d879-402f-91b7-7e997b290061 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:16.879032 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c839f32-d879-402f-91b7-7e997b290061 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:16.880428 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c839f32-d879-402f-91b7-7e997b290061 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:16.890256 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 231/447] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:40:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:16.891108 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c839f32-d879-402f-91b7-7e997b290061 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:16.948366 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:16.976548 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a00fb-2354-45ba-9107-b9a992600cbc None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:17.003482 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c839f32-d879-402f-91b7-7e997b290061 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:17.015551 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d4f99-2e74-4aa2-b28f-340b72ae778c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:17.016500 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d4f99-2e74-4aa2-b28f-340b72ae778c None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:17.016780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d4f99-2e74-4aa2-b28f-340b72ae778c None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:17.017045 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d4f99-2e74-4aa2-b28f-340b72ae778c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:17.017889 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d4f99-2e74-4aa2-b28f-340b72ae778c None admin] RBAC: Adding query filter params (group.id=79d30be0437e4a87b27484ad6a45fd74, role.id=4827ddfe1a0e476294ecf7f1d122cc32, scope.project.id=d72a8e31265a4e11b5e71c627e803005) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:17.018203 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d4f99-2e74-4aa2-b28f-340b72ae778c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:17.019681 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d4f99-2e74-4aa2-b28f-340b72ae778c None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:17.026444 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 217/448] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Jun 24 10:40:16 2022] GET /identity/v3/role_assignments?group.id=79d30be0437e4a87b27484ad6a45fd74&scope.project.id=d72a8e31265a4e11b5e71c627e803005&role.id=4827ddfe1a0e476294ecf7f1d122cc32 => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:17.027200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d4f99-2e74-4aa2-b28f-340b72ae778c None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:17.054208 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed6c3b-db14-48a0-8c83-de7206e3b1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:17.055523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed6c3b-db14-48a0-8c83-de7206e3b1e9 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:17.055817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed6c3b-db14-48a0-8c83-de7206e3b1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:17.056102 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed6c3b-db14-48a0-8c83-de7206e3b1e9 None admin] PATH_INFO: `/v3/projects/d72a8e31265a4e11b5e71c627e803005` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:17.057419 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed6c3b-db14-48a0-8c83-de7206e3b1e9 None admin] RBAC: Authorizing `identity:get_project(project_id=d72a8e31265a4e11b5e71c627e803005)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:17.058961 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed6c3b-db14-48a0-8c83-de7206e3b1e9 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:17.060770 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 232/449] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:40:16 2022] GET /identity/v3/projects/d72a8e31265a4e11b5e71c627e803005 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:17.066894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed6c3b-db14-48a0-8c83-de7206e3b1e9 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:17.116350 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:17.155469 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d4f99-2e74-4aa2-b28f-340b72ae778c None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:17.189304 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed6c3b-db14-48a0-8c83-de7206e3b1e9 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:17.195331 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772dcaa6-1136-4fa0-bad1-6371a5123c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:17.196018 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772dcaa6-1136-4fa0-bad1-6371a5123c93 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:17.196301 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772dcaa6-1136-4fa0-bad1-6371a5123c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:17.196581 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772dcaa6-1136-4fa0-bad1-6371a5123c93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:17.208493 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:17.238472 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e52b51-612d-486e-a883-79ba1affe1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:17.238713 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e52b51-612d-486e-a883-79ba1affe1e4 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:17.239060 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e52b51-612d-486e-a883-79ba1affe1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:17.239359 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e52b51-612d-486e-a883-79ba1affe1e4 None admin] PATH_INFO: `/v3/groups/79d30be0437e4a87b27484ad6a45fd74` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:17.240623 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e52b51-612d-486e-a883-79ba1affe1e4 None admin] RBAC: Authorizing `identity:get_group(group_id=79d30be0437e4a87b27484ad6a45fd74)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:17.242207 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e52b51-612d-486e-a883-79ba1affe1e4 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:17.248417 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 233/450] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jun 24 10:40:17 2022] GET /identity/v3/groups/79d30be0437e4a87b27484ad6a45fd74 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:17.250737 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e52b51-612d-486e-a883-79ba1affe1e4 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:17.295571 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772dcaa6-1136-4fa0-bad1-6371a5123c93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:17.297145 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772dcaa6-1136-4fa0-bad1-6371a5123c93 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:17.377566 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e52b51-612d-486e-a883-79ba1affe1e4 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:17.390071 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:17.422674 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb7d6f-861c-4b7d-af65-2c9a01656b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:17.423453 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb7d6f-861c-4b7d-af65-2c9a01656b85 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:17.423561 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb7d6f-861c-4b7d-af65-2c9a01656b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:17.423838 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb7d6f-861c-4b7d-af65-2c9a01656b85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:17.424781 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb7d6f-861c-4b7d-af65-2c9a01656b85 None admin] RBAC: Adding query filter params (group.id=79d30be0437e4a87b27484ad6a45fd74, role.id=19b4d737ab92430caeb4cd548049bcfc, scope.project.id=d72a8e31265a4e11b5e71c627e803005) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:17.424995 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb7d6f-861c-4b7d-af65-2c9a01656b85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:17.426569 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb7d6f-861c-4b7d-af65-2c9a01656b85 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:17.429736 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 218/451] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:40:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:17.434898 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 234/452] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Jun 24 10:40:17 2022] GET /identity/v3/role_assignments?group.id=79d30be0437e4a87b27484ad6a45fd74&scope.project.id=d72a8e31265a4e11b5e71c627e803005&role.id=19b4d737ab92430caeb4cd548049bcfc => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:40:17.436213 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772dcaa6-1136-4fa0-bad1-6371a5123c93 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:17.482669 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:17.553500 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772dcaa6-1136-4fa0-bad1-6371a5123c93 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:17.593053 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7261022-aa94-4d2c-8726-42c5ed3fa11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:17.593971 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7261022-aa94-4d2c-8726-42c5ed3fa11d None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:17.594264 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7261022-aa94-4d2c-8726-42c5ed3fa11d None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:17.594546 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7261022-aa94-4d2c-8726-42c5ed3fa11d None admin] PATH_INFO: `/v3/projects/f0f99060cebb41e8ac55ca6f1eeb4b0d` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:17.595819 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7261022-aa94-4d2c-8726-42c5ed3fa11d None admin] RBAC: Authorizing `identity:get_project(project_id=f0f99060cebb41e8ac55ca6f1eeb4b0d)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:17.597281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7261022-aa94-4d2c-8726-42c5ed3fa11d None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:17.599014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 219/453] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:40:17 2022] GET /identity/v3/projects/f0f99060cebb41e8ac55ca6f1eeb4b0d => generated 344 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:17.605036 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb7d6f-861c-4b7d-af65-2c9a01656b85 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:17.733882 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb7d6f-861c-4b7d-af65-2c9a01656b85 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:17.768573 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91608dc3-145d-4316-99c2-fa59ae9acc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:17.769447 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91608dc3-145d-4316-99c2-fa59ae9acc61 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:17.769727 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91608dc3-145d-4316-99c2-fa59ae9acc61 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:17.769999 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91608dc3-145d-4316-99c2-fa59ae9acc61 None admin] PATH_INFO: `/v3/groups/71f0610076f24ebcb90b01464ff751fa` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:17.771202 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91608dc3-145d-4316-99c2-fa59ae9acc61 None admin] RBAC: Authorizing `identity:get_group(group_id=71f0610076f24ebcb90b01464ff751fa)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:17.772652 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91608dc3-145d-4316-99c2-fa59ae9acc61 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:17.774550 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 235/454] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jun 24 10:40:17 2022] GET /identity/v3/groups/71f0610076f24ebcb90b01464ff751fa => generated 229 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:17.780468 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7261022-aa94-4d2c-8726-42c5ed3fa11d None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:17.888619 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7261022-aa94-4d2c-8726-42c5ed3fa11d None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:17.895758 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:17.924235 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276112b7-56f6-40b4-aa5c-5fc70e47c862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:17.924894 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276112b7-56f6-40b4-aa5c-5fc70e47c862 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:17.925171 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276112b7-56f6-40b4-aa5c-5fc70e47c862 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:17.925453 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276112b7-56f6-40b4-aa5c-5fc70e47c862 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:17.926288 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276112b7-56f6-40b4-aa5c-5fc70e47c862 None admin] RBAC: Adding query filter params (group.id=71f0610076f24ebcb90b01464ff751fa, role.id=4867b69c45554ce18e23167c05a02175, scope.project.id=f0f99060cebb41e8ac55ca6f1eeb4b0d) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:17.926598 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276112b7-56f6-40b4-aa5c-5fc70e47c862 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:17.928071 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276112b7-56f6-40b4-aa5c-5fc70e47c862 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:17.934189 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 220/455] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Jun 24 10:40:17 2022] GET /identity/v3/role_assignments?group.id=71f0610076f24ebcb90b01464ff751fa&scope.project.id=f0f99060cebb41e8ac55ca6f1eeb4b0d&role.id=4867b69c45554ce18e23167c05a02175 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:20.430127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fedab6-8626-43cd-88e9-cd313a45de90 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:20.430658 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fedab6-8626-43cd-88e9-cd313a45de90 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:20.430736 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fedab6-8626-43cd-88e9-cd313a45de90 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:20.432314 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 236/456] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:20.437714 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ee511-e124-4237-9609-104b75aa9d5c None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:20.438534 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ee511-e124-4237-9609-104b75aa9d5c None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:20.439432 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ee511-e124-4237-9609-104b75aa9d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:20.458939 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-f54ee511-e124-4237-9609-104b75aa9d5c None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:20.460597 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-f54ee511-e124-4237-9609-104b75aa9d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:20.527565 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 221/457] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:20.552237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fedab6-8626-43cd-88e9-cd313a45de90 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:20.596696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:20.612982 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a06ef-4871-4d48-a925-910155716ee7 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:20.613597 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a06ef-4871-4d48-a925-910155716ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:20.614093 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a06ef-4871-4d48-a925-910155716ee7 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:20.615956 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 222/458] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:20.630093 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf68593-3d7a-4e30-92f7-17823161bd41 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:20.630676 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf68593-3d7a-4e30-92f7-17823161bd41 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:20.631170 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf68593-3d7a-4e30-92f7-17823161bd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:20.666368 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-0bf68593-3d7a-4e30-92f7-17823161bd41 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:20.667601 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-0bf68593-3d7a-4e30-92f7-17823161bd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:20.685565 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fedab6-8626-43cd-88e9-cd313a45de90 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:20.727629 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4fb0e-c33f-4699-ba90-a4357738fd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:20.728444 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4fb0e-c33f-4699-ba90-a4357738fd0f None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:20.728736 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4fb0e-c33f-4699-ba90-a4357738fd0f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:20.729014 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4fb0e-c33f-4699-ba90-a4357738fd0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:20.740238 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4fb0e-c33f-4699-ba90-a4357738fd0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:20.741737 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4fb0e-c33f-4699-ba90-a4357738fd0f None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:20.759894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-a0c4fb0e-c33f-4699-ba90-a4357738fd0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:20.759894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:20.759894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:20.759894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:20.759894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:20.759894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:20.759894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:20.759894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:20.759894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:20.759894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:20.759894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:20.759894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:20.759894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:20.759894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:20.759894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:20.760799 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:20.760799 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:20.760799 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:20.760799 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:20.760799 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:20.760799 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:20.760799 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:20.760799 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:20.760799 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:20.760799 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:20.760799 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:20.760799 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:20.760799 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:20.760799 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:20.760799 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:20.760799 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:20.760799 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:20.761646 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:20.761646 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:20.761646 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:20.761646 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:20.761646 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 237/459] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:20.763210 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13c439-6967-4db9-8f87-45e70fe7094d None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:20.763210 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13c439-6967-4db9-8f87-45e70fe7094d None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:20.763525 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13c439-6967-4db9-8f87-45e70fe7094d None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:20.765125 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 238/460] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:20.770069 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13c439-6967-4db9-8f87-45e70fe7094d None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:20.775246 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 223/461] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:40:20.776649 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da67846-66dd-4aa0-84fa-ef07edfea9a5 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:20.776941 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da67846-66dd-4aa0-84fa-ef07edfea9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:20.777225 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da67846-66dd-4aa0-84fa-ef07edfea9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:20.804684 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-7da67846-66dd-4aa0-84fa-ef07edfea9a5 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:20.806375 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-7da67846-66dd-4aa0-84fa-ef07edfea9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:20.837021 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:20.885165 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:20.894245 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 224/462] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:20.896077 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13c439-6967-4db9-8f87-45e70fe7094d None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:20.900533 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da67846-66dd-4aa0-84fa-ef07edfea9a5 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:20.947403 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6a195-dadb-43ac-b3d5-11bafbdf89eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:20.948147 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6a195-dadb-43ac-b3d5-11bafbdf89eb None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:20.948529 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6a195-dadb-43ac-b3d5-11bafbdf89eb None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:20.948906 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6a195-dadb-43ac-b3d5-11bafbdf89eb None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:20.949743 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6a195-dadb-43ac-b3d5-11bafbdf89eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:20.950153 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6a195-dadb-43ac-b3d5-11bafbdf89eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:20.951682 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6a195-dadb-43ac-b3d5-11bafbdf89eb None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:20.964470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 239/463] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:20.965516 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6a195-dadb-43ac-b3d5-11bafbdf89eb None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:21.028771 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da67846-66dd-4aa0-84fa-ef07edfea9a5 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:21.074144 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6b7f9-6205-4a8f-9004-95de8b1a3282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:21.075531 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6b7f9-6205-4a8f-9004-95de8b1a3282 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:21.076562 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6b7f9-6205-4a8f-9004-95de8b1a3282 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:21.077436 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6b7f9-6205-4a8f-9004-95de8b1a3282 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:21.079256 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6a195-dadb-43ac-b3d5-11bafbdf89eb None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:21.093105 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6b7f9-6205-4a8f-9004-95de8b1a3282 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:21.095294 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6b7f9-6205-4a8f-9004-95de8b1a3282 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:21.117732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1a6d0-2a33-4d1f-9a57-302a34590d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:21.118783 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1a6d0-2a33-4d1f-9a57-302a34590d63 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:21.119251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1a6d0-2a33-4d1f-9a57-302a34590d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:21.119670 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1a6d0-2a33-4d1f-9a57-302a34590d63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:21.120202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-1af6b7f9-6205-4a8f-9004-95de8b1a3282 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:21.120202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:21.120202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:21.120202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:21.120202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:21.120202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:21.120202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:21.120202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:21.120202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:21.120202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:21.120202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:21.120202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:21.120202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:21.120202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:21.120202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:21.121109 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:21.121109 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:21.121109 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:21.121109 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:21.121109 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:21.121109 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:21.121109 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:21.121109 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:21.121109 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:21.121109 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:21.121109 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:21.121109 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:21.121109 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:21.121109 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:21.121109 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:21.121109 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:21.121109 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:21.121960 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:21.121960 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:21.121960 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:21.121960 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:21.121960 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 225/464] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:21.123023 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6b7f9-6205-4a8f-9004-95de8b1a3282 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:21.134199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1a6d0-2a33-4d1f-9a57-302a34590d63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:21.136061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1a6d0-2a33-4d1f-9a57-302a34590d63 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:21.141757 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:21.158804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-d3f1a6d0-2a33-4d1f-9a57-302a34590d63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:21.158804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:21.158804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:21.158804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:21.158804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:21.158804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:21.158804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:21.158804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:21.158804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:21.158804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:21.158804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:21.158804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:21.158804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:21.158804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:21.158804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:21.159756 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:21.159756 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:21.159756 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:21.159756 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:21.159756 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:21.159756 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:21.159756 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:21.159756 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:21.159756 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:21.159756 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:21.159756 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:21.159756 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:21.159756 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:21.159756 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:21.159756 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:21.159756 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:21.159756 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:21.160597 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:21.160597 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:21.160597 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:21.160597 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:21.166163 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 240/465] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:21.167129 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1a6d0-2a33-4d1f-9a57-302a34590d63 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:21.171583 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:21.240484 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6b7f9-6205-4a8f-9004-95de8b1a3282 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:21.274188 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1a6d0-2a33-4d1f-9a57-302a34590d63 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:21.278182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82067a-c11b-4446-85af-ea202e90a848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:21.278864 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82067a-c11b-4446-85af-ea202e90a848 None admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:21.279157 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82067a-c11b-4446-85af-ea202e90a848 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:21.279445 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82067a-c11b-4446-85af-ea202e90a848 None admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:21.280190 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82067a-c11b-4446-85af-ea202e90a848 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:21.281681 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82067a-c11b-4446-85af-ea202e90a848 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:21.311189 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 226/466] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 10:40:21 2022] POST /identity/v3/users => generated 246 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:40:21.311189 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82067a-c11b-4446-85af-ea202e90a848 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:21.325316 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657881b-0b6f-4e3a-8708-61ea8861bcfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:21.326120 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657881b-0b6f-4e3a-8708-61ea8861bcfd None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:21.326496 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657881b-0b6f-4e3a-8708-61ea8861bcfd None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:21.326832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657881b-0b6f-4e3a-8708-61ea8861bcfd None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:21.327701 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657881b-0b6f-4e3a-8708-61ea8861bcfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:21.328185 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657881b-0b6f-4e3a-8708-61ea8861bcfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:21.329800 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657881b-0b6f-4e3a-8708-61ea8861bcfd None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:21.346317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 241/467] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:21.347879 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a187a4e-2c61-4cff-b73e-aba497fac499 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:21.348280 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a187a4e-2c61-4cff-b73e-aba497fac499 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:21.348667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a187a4e-2c61-4cff-b73e-aba497fac499 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:21.355353 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 242/468] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:21.357220 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121aba2-5263-45ae-9764-285e768a0990 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:21.357524 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121aba2-5263-45ae-9764-285e768a0990 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:21.357865 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121aba2-5263-45ae-9764-285e768a0990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:21.376561 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-a121aba2-5263-45ae-9764-285e768a0990 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:21.377805 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a121aba2-5263-45ae-9764-285e768a0990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:21.396720 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:21.448606 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:21.451691 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82067a-c11b-4446-85af-ea202e90a848 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:21.464979 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 243/469] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:21.464979 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121aba2-5263-45ae-9764-285e768a0990 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:21.517985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3aef33-3ba7-4510-99cf-6fce9e99ef93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:21.518742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3aef33-3ba7-4510-99cf-6fce9e99ef93 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:21.519131 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3aef33-3ba7-4510-99cf-6fce9e99ef93 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:21.519544 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3aef33-3ba7-4510-99cf-6fce9e99ef93 None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:21.520288 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3aef33-3ba7-4510-99cf-6fce9e99ef93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:21.520597 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3aef33-3ba7-4510-99cf-6fce9e99ef93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:21.522036 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3aef33-3ba7-4510-99cf-6fce9e99ef93 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:21.541822 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 227/470] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:21.542530 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3aef33-3ba7-4510-99cf-6fce9e99ef93 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:21.606610 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121aba2-5263-45ae-9764-285e768a0990 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:21.649446 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3868eb-7c3c-4d88-b2fc-c89bc73980ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:21.650498 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3868eb-7c3c-4d88-b2fc-c89bc73980ed None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:21.650971 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3868eb-7c3c-4d88-b2fc-c89bc73980ed None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:21.651459 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3868eb-7c3c-4d88-b2fc-c89bc73980ed None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:21.655183 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3868eb-7c3c-4d88-b2fc-c89bc73980ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:21.657533 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3868eb-7c3c-4d88-b2fc-c89bc73980ed None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:21.672059 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3aef33-3ba7-4510-99cf-6fce9e99ef93 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:21.694265 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 244/471] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 10:40:21 2022] POST /identity/v3/users => generated 248 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:40:21.695142 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3868eb-7c3c-4d88-b2fc-c89bc73980ed None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:21.709942 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:21.719127 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353dff1e-812f-4171-ad01-662c92da74c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:21.720396 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dff1e-812f-4171-ad01-662c92da74c6 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:21.720883 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dff1e-812f-4171-ad01-662c92da74c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:21.721359 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dff1e-812f-4171-ad01-662c92da74c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:21.733093 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353dff1e-812f-4171-ad01-662c92da74c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:21.735045 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353dff1e-812f-4171-ad01-662c92da74c6 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:21.754231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-353dff1e-812f-4171-ad01-662c92da74c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:21.754231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:21.754231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:21.754231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:21.754231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:21.754231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:21.754231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:21.754231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:21.754231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:21.754231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:21.754231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:21.754231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:21.754231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:21.754231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:21.754231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:21.755194 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:21.755194 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:21.755194 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:21.755194 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:21.755194 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:21.755194 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:21.755194 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:21.755194 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:21.755194 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:21.755194 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:21.755194 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:21.755194 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:21.755194 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:21.755194 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:21.755194 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:21.755194 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:21.755194 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:21.756036 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:21.756036 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:21.756036 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:21.756036 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:21.758504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 228/472] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:21.761759 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:21.764689 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353dff1e-812f-4171-ad01-662c92da74c6 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:21.829016 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3868eb-7c3c-4d88-b2fc-c89bc73980ed None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:21.870703 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cabaf-156b-44e4-a6ad-4ddc3de4bcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:21.871980 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cabaf-156b-44e4-a6ad-4ddc3de4bcca None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:21.872566 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cabaf-156b-44e4-a6ad-4ddc3de4bcca None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:21.872976 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cabaf-156b-44e4-a6ad-4ddc3de4bcca None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:21.873945 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cabaf-156b-44e4-a6ad-4ddc3de4bcca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:21.875622 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cabaf-156b-44e4-a6ad-4ddc3de4bcca None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:21.876292 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353dff1e-812f-4171-ad01-662c92da74c6 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:21.904868 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 245/473] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 10:40:21 2022] POST /identity/v3/users => generated 248 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:40:21.924701 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41366f-be52-46ac-b76f-7ce283e5b029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:21.925749 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41366f-be52-46ac-b76f-7ce283e5b029 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:21.926257 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41366f-be52-46ac-b76f-7ce283e5b029 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:21.926713 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41366f-be52-46ac-b76f-7ce283e5b029 None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:21.927780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41366f-be52-46ac-b76f-7ce283e5b029 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:21.928321 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41366f-be52-46ac-b76f-7ce283e5b029 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:21.930755 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41366f-be52-46ac-b76f-7ce283e5b029 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:21.947219 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 229/474] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:21.955913 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cabaf-156b-44e4-a6ad-4ddc3de4bcca None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:22.020741 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0422fe9-a12a-4725-ac49-9e5d6045a90c None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:22.021060 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0422fe9-a12a-4725-ac49-9e5d6045a90c None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:22.021314 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0422fe9-a12a-4725-ac49-9e5d6045a90c None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:22.022891 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 230/475] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:40:22.029606 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bdd47-ecf1-4f1c-97d9-7ed80b03f45c None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:22.029606 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bdd47-ecf1-4f1c-97d9-7ed80b03f45c None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:22.029606 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bdd47-ecf1-4f1c-97d9-7ed80b03f45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:22.049684 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-b57bdd47-ecf1-4f1c-97d9-7ed80b03f45c None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:22.049884 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-b57bdd47-ecf1-4f1c-97d9-7ed80b03f45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:22.106303 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:22.113117 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cabaf-156b-44e4-a6ad-4ddc3de4bcca None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:22.123962 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:22.147909 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 231/476] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 24 10:40:22.158640 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f5ad0-a1a7-47e5-b6cb-2f2c8d172617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:22.159349 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f5ad0-a1a7-47e5-b6cb-2f2c8d172617 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:22.159658 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f5ad0-a1a7-47e5-b6cb-2f2c8d172617 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:22.159908 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f5ad0-a1a7-47e5-b6cb-2f2c8d172617 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:22.160622 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f5ad0-a1a7-47e5-b6cb-2f2c8d172617 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:22.162068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f5ad0-a1a7-47e5-b6cb-2f2c8d172617 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:22.173468 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bdd47-ecf1-4f1c-97d9-7ed80b03f45c None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:22.190359 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 246/477] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 10:40:21 2022] POST /identity/v3/users => generated 249 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:40:22.306420 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bdd47-ecf1-4f1c-97d9-7ed80b03f45c None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:22.372729 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245da217-c04b-45b9-97cc-0c7b770a4e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:22.373620 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245da217-c04b-45b9-97cc-0c7b770a4e6f None admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:22.374024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245da217-c04b-45b9-97cc-0c7b770a4e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:22.374441 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245da217-c04b-45b9-97cc-0c7b770a4e6f None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:22.375540 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245da217-c04b-45b9-97cc-0c7b770a4e6f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:22.377554 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245da217-c04b-45b9-97cc-0c7b770a4e6f None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:22.391661 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.sql.core [None req-245da217-c04b-45b9-97cc-0c7b770a4e6f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 24 10:40:22.391661 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 24 10:40:22.391661 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [parameters: {'id': '448df0d793a74103b55099f03df7ce21', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 24 10:40:22.391661 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80173) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 10:40:22.409150 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-245da217-c04b-45b9-97cc-0c7b770a4e6f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 24 10:40:22.409150 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:22.409150 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 10:40:22.409150 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 10:40:22.409150 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 10:40:22.409150 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 10:40:22.409150 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 10:40:22.409150 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 10:40:22.409150 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 10:40:22.409150 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application conn.query(q) Jun 24 10:40:22.409150 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 10:40:22.409150 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 10:40:22.409150 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 10:40:22.409150 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application result.read() Jun 24 10:40:22.409150 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 10:40:22.410075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 10:40:22.410075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 10:40:22.410075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 10:40:22.410075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 10:40:22.410075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 10:40:22.410075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 10:40:22.410075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 10:40:22.410075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 24 10:40:22.410075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:22.410075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 10:40:22.410075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:22.410075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:22.410075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 10:40:22.410075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 10:40:22.410075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 24 10:40:22.410075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return ref.to_dict() Jun 24 10:40:22.410075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 10:40:22.410075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application next(self.gen) Jun 24 10:40:22.410984 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 10:40:22.410984 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application yield resource Jun 24 10:40:22.410984 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 10:40:22.410984 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application next(self.gen) Jun 24 10:40:22.410984 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 10:40:22.410984 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 10:40:22.410984 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 10:40:22.410984 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 10:40:22.410984 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 10:40:22.410984 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise self.value Jun 24 10:40:22.410984 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 10:40:22.410984 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 10:40:22.410984 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 10:40:22.410984 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application session.commit() Jun 24 10:40:22.410984 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 10:40:22.410984 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 10:40:22.410984 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 10:40:22.411867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 10:40:22.411867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 10:40:22.411867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self.session.flush() Jun 24 10:40:22.411867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 10:40:22.411867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 10:40:22.411867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 10:40:22.411867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 10:40:22.411867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 10:40:22.411867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application compat.raise_( Jun 24 10:40:22.411867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 10:40:22.411867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception Jun 24 10:40:22.411867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 10:40:22.411867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 10:40:22.411867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 10:40:22.411867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 10:40:22.411867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 10:40:22.411867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 10:40:22.412746 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 10:40:22.412746 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 10:40:22.412746 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 24 10:40:22.412746 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 24 10:40:22.412746 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 10:40:22.412746 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 10:40:22.412746 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 10:40:22.412746 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 10:40:22.412746 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 10:40:22.412746 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 10:40:22.412746 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 10:40:22.412746 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 10:40:22.412746 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 10:40:22.412746 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 10:40:22.412746 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 10:40:22.412746 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception Jun 24 10:40:22.413627 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 10:40:22.413627 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 10:40:22.413627 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 10:40:22.413627 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 10:40:22.413627 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 10:40:22.413627 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 10:40:22.413627 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 10:40:22.413627 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application conn.query(q) Jun 24 10:40:22.413627 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 10:40:22.413627 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 10:40:22.413627 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 10:40:22.413627 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application result.read() Jun 24 10:40:22.413627 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 10:40:22.413627 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 10:40:22.413627 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 10:40:22.413627 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 10:40:22.414410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 10:40:22.414410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 10:40:22.414410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 10:40:22.414410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 10:40:22.414410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 24 10:40:22.414410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 24 10:40:22.414410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [parameters: {'id': '448df0d793a74103b55099f03df7ce21', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 24 10:40:22.414410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 10:40:22.414410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:22.414410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:40:22.414410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:22.414410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:22.414410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:22.414410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:22.414410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:22.414410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:22.416893 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:22.416893 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:22.416893 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:22.416893 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:22.416893 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:22.416893 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:22.416893 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 24 10:40:22.416893 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 24 10:40:22.416893 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:22.416893 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:22.416893 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 24 10:40:22.416893 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 24 10:40:22.416893 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 10:40:22.416893 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 10:40:22.416893 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 24 10:40:22.416893 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:22.418776 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 232/478] 10.222.0.16 () {60 vars in 1131 bytes} [Fri Jun 24 10:40:22 2022] POST /identity/v3/roles => generated 144 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:40:22.421490 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f5ad0-a1a7-47e5-b6cb-2f2c8d172617 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:22.531630 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f5ad0-a1a7-47e5-b6cb-2f2c8d172617 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:22.568113 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72a0e0-adc8-410f-a2e2-ed511efcf9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:22.568945 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72a0e0-adc8-410f-a2e2-ed511efcf9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:22.569228 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72a0e0-adc8-410f-a2e2-ed511efcf9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:22.569502 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72a0e0-adc8-410f-a2e2-ed511efcf9f2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:22.580467 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc72a0e0-adc8-410f-a2e2-ed511efcf9f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:22.588940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-bc72a0e0-adc8-410f-a2e2-ed511efcf9f2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:40:22.588940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:22.588940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:22.588940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:22.588940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:22.588940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:22.588940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:22.588940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:22.588940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:22.588940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:22.588940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:22.588940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:22.588940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:22.588940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:22.588940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:22.588940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:22.589843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:22.589843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:22.589843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:22.589843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:22.589843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:22.589843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:22.589843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:22.589843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:22.589843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:22.589843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:22.589843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:22.589843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:22.589843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:22.589843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:22.589843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:22.589843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:22.590635 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:22.590635 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:22.590635 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:22.590635 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:22.590635 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:22.590635 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:22.590635 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:22.590635 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:22.590635 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:22.590635 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:22.590635 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:40:22.590635 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:22.590635 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 247/479] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 10:40:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:40:22.596080 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245da217-c04b-45b9-97cc-0c7b770a4e6f None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:22.635471 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:22.714932 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245da217-c04b-45b9-97cc-0c7b770a4e6f None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:22.750305 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6050c68-5f46-41f5-acc4-c4c86ba6b873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:22.750995 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6050c68-5f46-41f5-acc4-c4c86ba6b873 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:22.751315 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6050c68-5f46-41f5-acc4-c4c86ba6b873 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:22.751598 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6050c68-5f46-41f5-acc4-c4c86ba6b873 None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:22.752364 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6050c68-5f46-41f5-acc4-c4c86ba6b873 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:22.752675 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6050c68-5f46-41f5-acc4-c4c86ba6b873 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:22.754064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6050c68-5f46-41f5-acc4-c4c86ba6b873 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:22.762989 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 233/480] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:40:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:23.892187 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbb20f-1591-4e94-9948-34f268481fb4 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:23.892707 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbb20f-1591-4e94-9948-34f268481fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:23.892782 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbb20f-1591-4e94-9948-34f268481fb4 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:23.894344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 248/481] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:23.899898 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61284c5-4f72-48a1-8b53-1ed198c51da6 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:23.900349 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61284c5-4f72-48a1-8b53-1ed198c51da6 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:23.900551 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61284c5-4f72-48a1-8b53-1ed198c51da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:23.924269 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-c61284c5-4f72-48a1-8b53-1ed198c51da6 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:23.925405 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-c61284c5-4f72-48a1-8b53-1ed198c51da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:24.017840 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 234/482] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:40:24.066110 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbb20f-1591-4e94-9948-34f268481fb4 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:24.105023 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:24.213435 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbb20f-1591-4e94-9948-34f268481fb4 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:24.262573 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc78f7-d58f-4be3-a5c5-c0fe787f52c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:24.263409 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc78f7-d58f-4be3-a5c5-c0fe787f52c9 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:24.263691 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc78f7-d58f-4be3-a5c5-c0fe787f52c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:24.263966 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc78f7-d58f-4be3-a5c5-c0fe787f52c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:24.274622 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc78f7-d58f-4be3-a5c5-c0fe787f52c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:24.286863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-70cc78f7-d58f-4be3-a5c5-c0fe787f52c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:40:24.286863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:24.286863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:24.286863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:24.286863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:24.286863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:24.286863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:24.286863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:24.286863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:24.286863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:24.286863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:24.286863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:24.286863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:24.286863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:24.286863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:24.286863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:24.287997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:24.287997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:24.287997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:24.287997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:24.287997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:24.287997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:24.287997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:24.287997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:24.287997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:24.287997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:24.287997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:24.287997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:24.287997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:24.287997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:24.287997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:24.287997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:24.289093 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:24.289093 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:24.289093 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:24.289093 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:24.289093 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:24.289093 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:24.289093 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:24.289093 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:24.289093 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:24.289093 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:24.289093 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:40:24.289093 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:24.289093 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 249/483] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 10:40:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:24.294506 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61284c5-4f72-48a1-8b53-1ed198c51da6 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:24.326549 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a55a8b-d4ba-446a-b56f-c89cd6379ae0 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:24.326849 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a55a8b-d4ba-446a-b56f-c89cd6379ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:24.327110 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a55a8b-d4ba-446a-b56f-c89cd6379ae0 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:24.328749 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 250/484] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:40:24.334103 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b4ef0-6e37-46cc-a597-8cbeb20806ac None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:24.334393 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b4ef0-6e37-46cc-a597-8cbeb20806ac None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:24.334673 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b4ef0-6e37-46cc-a597-8cbeb20806ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:24.336748 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:24.353510 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-e29b4ef0-6e37-46cc-a597-8cbeb20806ac None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:24.354720 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e29b4ef0-6e37-46cc-a597-8cbeb20806ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:24.436523 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61284c5-4f72-48a1-8b53-1ed198c51da6 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:24.439792 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 251/485] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:40:24.469358 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b4ef0-6e37-46cc-a597-8cbeb20806ac None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:24.471770 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7d74b-937f-4155-85f8-39d6ee15929c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:24.472466 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7d74b-937f-4155-85f8-39d6ee15929c None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:24.472750 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7d74b-937f-4155-85f8-39d6ee15929c None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:24.473029 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7d74b-937f-4155-85f8-39d6ee15929c None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:24.473803 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7d74b-937f-4155-85f8-39d6ee15929c None admin] RBAC: Adding query filter params (name=service) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:24.474112 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7d74b-937f-4155-85f8-39d6ee15929c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:24.475592 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7d74b-937f-4155-85f8-39d6ee15929c None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:24.484630 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:24.484793 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 235/486] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 10:40:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:24.485990 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dd08c-76f9-4b06-8b54-4df937dfaf19 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:24.486266 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dd08c-76f9-4b06-8b54-4df937dfaf19 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:24.486550 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dd08c-76f9-4b06-8b54-4df937dfaf19 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:24.492584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 236/487] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:24.496488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dd08c-76f9-4b06-8b54-4df937dfaf19 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:24.579867 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b4ef0-6e37-46cc-a597-8cbeb20806ac None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:24.616735 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e2470f-66de-4b9f-b1e5-7ffe79737b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:24.617916 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2470f-66de-4b9f-b1e5-7ffe79737b2d None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:24.618395 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2470f-66de-4b9f-b1e5-7ffe79737b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:24.618901 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2470f-66de-4b9f-b1e5-7ffe79737b2d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:24.622661 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:24.630437 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e2470f-66de-4b9f-b1e5-7ffe79737b2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:24.635814 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dd08c-76f9-4b06-8b54-4df937dfaf19 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:24.640331 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-71e2470f-66de-4b9f-b1e5-7ffe79737b2d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:40:24.640331 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:24.640331 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:24.640331 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:24.640331 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:24.640331 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:24.640331 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:24.640331 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:24.640331 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:24.640331 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:24.640331 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:24.640331 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:24.640331 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:24.640331 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:24.640331 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:24.640331 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:24.641235 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:24.641235 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:24.641235 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:24.641235 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:24.641235 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:24.641235 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:24.641235 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:24.641235 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:24.641235 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:24.641235 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:24.641235 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:24.641235 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:24.641235 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:24.641235 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:24.641235 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:24.641235 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:24.642069 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:24.642069 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:24.642069 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:24.642069 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:24.642069 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:24.642069 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:24.642069 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:24.642069 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:24.642069 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:24.642069 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:24.642069 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:40:24.642069 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:24.649725 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 252/488] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 10:40:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:24.651697 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11dd072-609d-4f6a-9422-84b276fb7dd8 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:24.652262 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11dd072-609d-4f6a-9422-84b276fb7dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:24.652738 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11dd072-609d-4f6a-9422-84b276fb7dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:24.672049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-a11dd072-609d-4f6a-9422-84b276fb7dd8 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:24.673539 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a11dd072-609d-4f6a-9422-84b276fb7dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:24.675974 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948b884-4551-4d8d-96d1-60f757378fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:24.677587 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948b884-4551-4d8d-96d1-60f757378fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:24.677890 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948b884-4551-4d8d-96d1-60f757378fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:24.678174 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948b884-4551-4d8d-96d1-60f757378fb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:24.691408 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9948b884-4551-4d8d-96d1-60f757378fb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:24.693130 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9948b884-4551-4d8d-96d1-60f757378fb6 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:24.716095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-9948b884-4551-4d8d-96d1-60f757378fb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:24.716095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:24.716095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:24.716095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:24.716095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:24.716095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:24.716095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:24.716095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:24.716095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:24.716095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:24.716095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:24.716095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:24.716095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:24.716095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:24.716095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:24.717056 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:24.717056 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:24.717056 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:24.717056 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:24.717056 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:24.717056 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:24.717056 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:24.717056 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:24.717056 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:24.717056 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:24.717056 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:24.717056 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:24.717056 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:24.717056 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:24.717056 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:24.717056 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:24.717056 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:24.717912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:24.717912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:24.717912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:24.717912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:24.722468 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 237/489] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:24.723342 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948b884-4551-4d8d-96d1-60f757378fb6 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:24.751795 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 253/490] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:24.753068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11dd072-609d-4f6a-9422-84b276fb7dd8 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:24.755555 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:24.850356 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948b884-4551-4d8d-96d1-60f757378fb6 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:24.886513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320a830-9166-4001-902f-9039b2c1c328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:24.887721 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320a830-9166-4001-902f-9039b2c1c328 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:24.888205 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320a830-9166-4001-902f-9039b2c1c328 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:24.888703 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320a830-9166-4001-902f-9039b2c1c328 None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:24.889794 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320a830-9166-4001-902f-9039b2c1c328 None admin] RBAC: Adding query filter params (name=service) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:24.890294 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320a830-9166-4001-902f-9039b2c1c328 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:24.891908 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320a830-9166-4001-902f-9039b2c1c328 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:24.892619 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11dd072-609d-4f6a-9422-84b276fb7dd8 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:24.906929 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 238/491] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 10:40:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:24.908719 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320a830-9166-4001-902f-9039b2c1c328 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:24.911934 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:24.932962 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a89f4-719e-43a9-ba7e-911a52486f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:24.933643 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a89f4-719e-43a9-ba7e-911a52486f17 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:24.933931 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a89f4-719e-43a9-ba7e-911a52486f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:24.934211 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a89f4-719e-43a9-ba7e-911a52486f17 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:24.934955 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a89f4-719e-43a9-ba7e-911a52486f17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:24.935295 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a89f4-719e-43a9-ba7e-911a52486f17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:24.937123 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a89f4-719e-43a9-ba7e-911a52486f17 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:24.949987 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 254/492] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:24.950810 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a89f4-719e-43a9-ba7e-911a52486f17 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:25.018440 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:25.019507 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320a830-9166-4001-902f-9039b2c1c328 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:25.054418 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c46fd-3ba0-4da8-8d08-afad94b1a6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:25.055264 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c46fd-3ba0-4da8-8d08-afad94b1a6b5 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:25.055549 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c46fd-3ba0-4da8-8d08-afad94b1a6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:25.055832 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c46fd-3ba0-4da8-8d08-afad94b1a6b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:25.058665 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a89f4-719e-43a9-ba7e-911a52486f17 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:25.066494 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9c46fd-3ba0-4da8-8d08-afad94b1a6b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:25.074296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-7b9c46fd-3ba0-4da8-8d08-afad94b1a6b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:40:25.074296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:25.074296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:25.074296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:25.074296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:25.074296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:25.074296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:25.074296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:25.074296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:25.074296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:25.074296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:25.074296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:25.074296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:25.074296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:25.074296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:25.074296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:25.075216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:25.075216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:25.075216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:25.075216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:25.075216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:25.075216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:25.075216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:25.075216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:25.075216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:25.075216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:25.075216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:25.075216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:25.075216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:25.075216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:25.075216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:25.075216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:25.076060 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:25.076060 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:25.076060 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:25.076060 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:25.076060 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:25.076060 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:25.076060 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:25.076060 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:25.076060 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:25.076060 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:25.076060 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:40:25.076060 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:25.076060 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 239/493] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 10:40:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:25.077297 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54df8d-cc1e-4999-baca-a8b2654f284e None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:25.077582 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54df8d-cc1e-4999-baca-a8b2654f284e None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:25.077859 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54df8d-cc1e-4999-baca-a8b2654f284e None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:25.082849 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 240/494] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:25.082849 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54df8d-cc1e-4999-baca-a8b2654f284e None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:25.103743 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71dd48-4e44-4689-b4dc-e492eecc7712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:25.104998 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71dd48-4e44-4689-b4dc-e492eecc7712 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:25.105289 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71dd48-4e44-4689-b4dc-e492eecc7712 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:25.105567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71dd48-4e44-4689-b4dc-e492eecc7712 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:25.116323 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71dd48-4e44-4689-b4dc-e492eecc7712 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:25.117805 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71dd48-4e44-4689-b4dc-e492eecc7712 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:25.134778 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-7e71dd48-4e44-4689-b4dc-e492eecc7712 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:25.134778 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:25.134778 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:25.134778 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:25.134778 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:25.134778 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:25.134778 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:25.134778 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:25.134778 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:25.134778 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:25.134778 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:25.134778 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:25.134778 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:25.134778 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:25.134778 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:25.135706 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:25.135706 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:25.135706 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:25.135706 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:25.135706 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:25.135706 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:25.135706 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:25.135706 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:25.135706 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:25.135706 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:25.135706 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:25.135706 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:25.135706 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:25.135706 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:25.135706 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:25.135706 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:25.135706 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:25.136533 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:25.136533 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:25.136533 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:25.136533 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:25.136533 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 255/495] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:25.136807 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71dd48-4e44-4689-b4dc-e492eecc7712 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:25.153699 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:25.196727 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54df8d-cc1e-4999-baca-a8b2654f284e None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:25.232224 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c308f95-e658-40f5-8c48-8512fc4550b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:25.233038 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c308f95-e658-40f5-8c48-8512fc4550b7 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:25.233326 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c308f95-e658-40f5-8c48-8512fc4550b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:25.233604 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c308f95-e658-40f5-8c48-8512fc4550b7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:25.242262 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c308f95-e658-40f5-8c48-8512fc4550b7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:25.243760 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c308f95-e658-40f5-8c48-8512fc4550b7 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:25.244053 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71dd48-4e44-4689-b4dc-e492eecc7712 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:25.259288 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:25.260377 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-3c308f95-e658-40f5-8c48-8512fc4550b7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:40:25.260377 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:25.260377 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:25.260377 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:25.260377 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:25.260377 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:25.260377 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:25.260377 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:25.260377 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:25.260377 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:25.260377 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:25.260377 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:25.260377 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:40:25.260377 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:40:25.260377 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:40:25.260377 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:40:25.266257 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:25.266257 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:25.266257 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:40:25.266257 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:25.266257 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:40:25.266257 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:25.266257 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:25.266257 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:25.266257 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:25.266257 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:25.266257 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:25.266257 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:25.266257 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:25.266257 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:25.266257 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:25.266257 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:25.266257 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:25.266257 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:25.267453 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:25.267453 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:25.267453 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:40:25.267453 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:40:25.267453 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:40:25.267453 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:40:25.267453 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:40:25.267453 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:40:25.267453 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:40:25.267453 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:25.267453 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 241/496] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Jun 24 10:40:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:25.267453 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400930b3-ed57-4973-88cc-330b0178035d None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:25.267453 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400930b3-ed57-4973-88cc-330b0178035d None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:25.268284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400930b3-ed57-4973-88cc-330b0178035d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:25.281837 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-400930b3-ed57-4973-88cc-330b0178035d None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:25.282970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-400930b3-ed57-4973-88cc-330b0178035d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:25.290519 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0aa33-02b0-4a9e-a062-ea0410a597ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:25.291351 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0aa33-02b0-4a9e-a062-ea0410a597ba None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:25.291700 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0aa33-02b0-4a9e-a062-ea0410a597ba None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:25.292043 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0aa33-02b0-4a9e-a062-ea0410a597ba None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:25.292862 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f0aa33-02b0-4a9e-a062-ea0410a597ba None admin] RBAC: Adding query filter params (name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:25.293238 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f0aa33-02b0-4a9e-a062-ea0410a597ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:25.294675 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f0aa33-02b0-4a9e-a062-ea0410a597ba None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:25.308068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 256/497] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 10:40:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:25.308068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0aa33-02b0-4a9e-a062-ea0410a597ba None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:25.359479 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 242/498] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:25.359479 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400930b3-ed57-4973-88cc-330b0178035d None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:25.417763 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0aa33-02b0-4a9e-a062-ea0410a597ba None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:25.419161 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:25.456020 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a6644-f294-4f73-842d-a7ef6ed6ca7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:25.456838 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a6644-f294-4f73-842d-a7ef6ed6ca7a None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:25.457199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a6644-f294-4f73-842d-a7ef6ed6ca7a None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:25.457543 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a6644-f294-4f73-842d-a7ef6ed6ca7a None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:25.458386 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a6644-f294-4f73-842d-a7ef6ed6ca7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:25.458781 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a6644-f294-4f73-842d-a7ef6ed6ca7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:25.460384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a6644-f294-4f73-842d-a7ef6ed6ca7a None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:25.470581 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400930b3-ed57-4973-88cc-330b0178035d None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:25.477216 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 257/499] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:25.477216 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a6644-f294-4f73-842d-a7ef6ed6ca7a None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:25.529309 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:25.531825 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446cbd5-b963-46d5-8d15-0c1417617e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:25.532782 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446cbd5-b963-46d5-8d15-0c1417617e2e None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:25.533244 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446cbd5-b963-46d5-8d15-0c1417617e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:25.533729 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446cbd5-b963-46d5-8d15-0c1417617e2e None admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:25.534765 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446cbd5-b963-46d5-8d15-0c1417617e2e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:25.535576 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446cbd5-b963-46d5-8d15-0c1417617e2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:25.537882 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446cbd5-b963-46d5-8d15-0c1417617e2e None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:25.579254 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 243/500] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jun 24 10:40:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:25.580561 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446cbd5-b963-46d5-8d15-0c1417617e2e None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:25.607753 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a6644-f294-4f73-842d-a7ef6ed6ca7a None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:25.649109 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d1379-4bee-4fa6-a853-75e3b7ed11d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:25.650403 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d1379-4bee-4fa6-a853-75e3b7ed11d4 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:25.650683 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d1379-4bee-4fa6-a853-75e3b7ed11d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:25.650959 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d1379-4bee-4fa6-a853-75e3b7ed11d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:25.664477 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d1379-4bee-4fa6-a853-75e3b7ed11d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:25.665974 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d1379-4bee-4fa6-a853-75e3b7ed11d4 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:25.685274 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-5b6d1379-4bee-4fa6-a853-75e3b7ed11d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:25.685274 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:25.685274 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:25.685274 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:25.685274 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:25.685274 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:25.685274 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:25.685274 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:25.685274 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:25.685274 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:25.685274 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:25.685274 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:25.685274 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:25.685274 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:25.685274 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:25.686272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:25.686272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:25.686272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:25.686272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:25.686272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:25.686272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:25.686272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:25.686272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:25.686272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:25.686272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:25.686272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:25.686272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:25.686272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:25.686272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:25.686272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:25.686272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:25.686272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:25.687217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:25.687217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:25.687217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:25.687217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:25.687447 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 258/501] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:25.688336 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d1379-4bee-4fa6-a853-75e3b7ed11d4 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:25.693543 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446cbd5-b963-46d5-8d15-0c1417617e2e None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:25.704716 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:25.734239 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba24e3e-8763-453d-85f2-4dd16c51d6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:25.735737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba24e3e-8763-453d-85f2-4dd16c51d6f2 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:25.736028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba24e3e-8763-453d-85f2-4dd16c51d6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:25.736309 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba24e3e-8763-453d-85f2-4dd16c51d6f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:25.748600 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba24e3e-8763-453d-85f2-4dd16c51d6f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:25.756315 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-0ba24e3e-8763-453d-85f2-4dd16c51d6f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:40:25.756315 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:25.756315 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:25.756315 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:25.756315 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:25.756315 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:25.756315 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:25.756315 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:25.756315 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:25.756315 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:25.756315 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:25.756315 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:25.756315 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:25.756315 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:25.756315 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:25.756315 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:25.757488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:25.757488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:25.757488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:25.757488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:25.757488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:25.757488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:25.757488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:25.757488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:25.757488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:25.757488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:25.757488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:25.757488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:25.757488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:25.757488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:25.757488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:25.757488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:25.758431 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:25.758431 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:25.758431 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:25.758431 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:25.758431 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:25.758431 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:25.758431 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:25.758431 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:25.758431 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:25.758431 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:25.758431 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:40:25.758431 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:25.758431 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 244/502] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 10:40:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:25.759084 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075e3e6-14b6-41bf-a699-0f4bba6dd837 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:25.759329 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075e3e6-14b6-41bf-a699-0f4bba6dd837 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:25.759607 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075e3e6-14b6-41bf-a699-0f4bba6dd837 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:25.760866 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 245/503] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:25.761549 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075e3e6-14b6-41bf-a699-0f4bba6dd837 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:25.790224 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:25.806630 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d1379-4bee-4fa6-a853-75e3b7ed11d4 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:25.841526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb8894-b2ff-42a8-ac7b-033d911bf8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:25.842358 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb8894-b2ff-42a8-ac7b-033d911bf8dd None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:25.842644 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb8894-b2ff-42a8-ac7b-033d911bf8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:25.842921 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb8894-b2ff-42a8-ac7b-033d911bf8dd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:25.850066 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb8894-b2ff-42a8-ac7b-033d911bf8dd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:25.851624 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb8894-b2ff-42a8-ac7b-033d911bf8dd None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:25.867433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-6ffb8894-b2ff-42a8-ac7b-033d911bf8dd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 10:40:25.867433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:25.867433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:25.867433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:25.867433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:25.867433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:25.867433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:25.867433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:25.867433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:25.867433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:25.867433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:25.867433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:25.867433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:40:25.867433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:40:25.867433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:40:25.867433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:40:25.868333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:25.868333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:25.868333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:40:25.868333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:25.868333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:40:25.868333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:25.868333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:25.868333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:25.868333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:25.868333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:25.868333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:25.868333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:25.868333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:25.868333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:25.868333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:25.868333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:25.868333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:25.868333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:25.869245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:25.869245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:25.869245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:40:25.869245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:40:25.869245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:40:25.869245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:40:25.869245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:40:25.869245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:40:25.869245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 10:40:25.869245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:25.869751 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075e3e6-14b6-41bf-a699-0f4bba6dd837 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:25.869824 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 259/504] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:40:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:25.869824 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb8894-b2ff-42a8-ac7b-033d911bf8dd None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:25.903988 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51605c7e-c3cf-4941-b3ef-9bab96a9429e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:25.904659 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51605c7e-c3cf-4941-b3ef-9bab96a9429e None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:25.904936 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51605c7e-c3cf-4941-b3ef-9bab96a9429e None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:25.905201 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51605c7e-c3cf-4941-b3ef-9bab96a9429e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:25.944606 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:25.969400 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb8894-b2ff-42a8-ac7b-033d911bf8dd None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:25.972246 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51605c7e-c3cf-4941-b3ef-9bab96a9429e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:25.973736 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51605c7e-c3cf-4941-b3ef-9bab96a9429e None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:26.003696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442a607-4260-4c31-a79c-faac48543e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:26.004340 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442a607-4260-4c31-a79c-faac48543e40 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:26.004618 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442a607-4260-4c31-a79c-faac48543e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:26.004892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442a607-4260-4c31-a79c-faac48543e40 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:26.005607 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442a607-4260-4c31-a79c-faac48543e40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:26.005914 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442a607-4260-4c31-a79c-faac48543e40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:26.007351 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442a607-4260-4c31-a79c-faac48543e40 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:26.018322 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 260/505] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:26.019108 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442a607-4260-4c31-a79c-faac48543e40 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:26.029928 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:26.080200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 246/506] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:40:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:26.081437 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c7cde-f19a-433c-9a83-13ab6f420599 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:26.081733 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c7cde-f19a-433c-9a83-13ab6f420599 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:26.082014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c7cde-f19a-433c-9a83-13ab6f420599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:26.099504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-998c7cde-f19a-433c-9a83-13ab6f420599 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:26.100704 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-998c7cde-f19a-433c-9a83-13ab6f420599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:26.122605 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442a607-4260-4c31-a79c-faac48543e40 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:26.155997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624d465-39df-4f79-99ed-93e3476e6437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:26.156654 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624d465-39df-4f79-99ed-93e3476e6437 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:26.156938 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624d465-39df-4f79-99ed-93e3476e6437 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:26.157217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624d465-39df-4f79-99ed-93e3476e6437 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:26.157966 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624d465-39df-4f79-99ed-93e3476e6437 None admin] RBAC: Adding query filter params (name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:26.158276 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624d465-39df-4f79-99ed-93e3476e6437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:26.159686 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624d465-39df-4f79-99ed-93e3476e6437 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:26.162690 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:26.168002 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 261/507] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 10:40:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:26.168212 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 247/508] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:26.168629 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624d465-39df-4f79-99ed-93e3476e6437 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:26.169059 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c7cde-f19a-433c-9a83-13ab6f420599 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:26.238543 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:26.269905 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c7cde-f19a-433c-9a83-13ab6f420599 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:26.270078 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624d465-39df-4f79-99ed-93e3476e6437 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:26.305225 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479077a-d53a-4175-abda-b0a626fc00c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:26.305528 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254e17a-bc04-4f07-9c4c-fb7dde01af56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:26.306040 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479077a-d53a-4175-abda-b0a626fc00c1 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:26.306145 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254e17a-bc04-4f07-9c4c-fb7dde01af56 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:26.306318 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479077a-d53a-4175-abda-b0a626fc00c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:26.306417 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254e17a-bc04-4f07-9c4c-fb7dde01af56 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:26.306592 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479077a-d53a-4175-abda-b0a626fc00c1 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:26.306679 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254e17a-bc04-4f07-9c4c-fb7dde01af56 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:26.307472 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479077a-d53a-4175-abda-b0a626fc00c1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:26.307782 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479077a-d53a-4175-abda-b0a626fc00c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:26.309219 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479077a-d53a-4175-abda-b0a626fc00c1 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:26.314159 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3254e17a-bc04-4f07-9c4c-fb7dde01af56 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:26.315637 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3254e17a-bc04-4f07-9c4c-fb7dde01af56 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:26.330108 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-3254e17a-bc04-4f07-9c4c-fb7dde01af56 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 10:40:26.330108 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:26.330108 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:26.330108 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:26.330108 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:26.330108 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:26.330108 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:26.330108 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:26.330108 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:26.330108 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:26.330108 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:26.330108 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:26.330108 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:40:26.330108 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:40:26.330108 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:40:26.330108 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:40:26.331286 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:26.331286 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:26.331286 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:40:26.331286 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:26.331286 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:40:26.331286 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:26.331286 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:26.331286 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:26.331286 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:26.331286 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:26.331286 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:26.331286 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:26.331286 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:26.331286 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:26.331286 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:26.331286 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:26.331286 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:26.331286 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:26.332200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:26.332200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:26.332200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:40:26.332200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:40:26.332200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:40:26.332200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:40:26.332200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:40:26.332200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:40:26.332200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 10:40:26.332200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:26.332200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 248/509] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:40:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:26.332200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254e17a-bc04-4f07-9c4c-fb7dde01af56 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:26.347715 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 262/510] 10.222.0.16 () {56 vars in 1137 bytes} [Fri Jun 24 10:40:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:26.348551 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479077a-d53a-4175-abda-b0a626fc00c1 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:26.393310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:26.434659 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254e17a-bc04-4f07-9c4c-fb7dde01af56 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:26.451345 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479077a-d53a-4175-abda-b0a626fc00c1 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:26.471763 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7d834-8b72-42f1-8809-49ebc65f179e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:26.472575 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7d834-8b72-42f1-8809-49ebc65f179e None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:26.472858 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7d834-8b72-42f1-8809-49ebc65f179e None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:26.473132 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7d834-8b72-42f1-8809-49ebc65f179e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:26.478478 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:26.484598 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7d834-8b72-42f1-8809-49ebc65f179e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:26.486102 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7d834-8b72-42f1-8809-49ebc65f179e None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:26.487183 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45063142-7f17-46e0-9002-3275d355afe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:26.488002 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45063142-7f17-46e0-9002-3275d355afe3 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:26.488287 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45063142-7f17-46e0-9002-3275d355afe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:26.488561 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45063142-7f17-46e0-9002-3275d355afe3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:26.498696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45063142-7f17-46e0-9002-3275d355afe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:26.500182 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45063142-7f17-46e0-9002-3275d355afe3 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:26.504557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-a5b7d834-8b72-42f1-8809-49ebc65f179e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:26.504557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:26.504557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:26.504557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:26.504557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:26.504557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:26.504557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:26.504557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:26.504557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:26.504557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:26.504557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:26.504557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:26.504557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:26.504557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:26.504557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:26.505570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:26.505570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:26.505570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:26.505570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:26.505570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:26.505570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:26.505570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:26.505570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:26.505570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:26.505570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:26.505570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:26.505570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:26.505570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:26.505570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:26.505570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:26.505570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:26.505570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:26.506417 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:26.506417 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:26.506417 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:26.506417 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:26.506417 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 249/511] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:26.506676 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7d834-8b72-42f1-8809-49ebc65f179e None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:26.521255 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-45063142-7f17-46e0-9002-3275d355afe3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:26.521255 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:26.521255 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:26.521255 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:26.521255 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:26.521255 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:26.521255 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:26.521255 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:26.521255 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:26.521255 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:26.521255 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:26.521255 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:26.521255 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:26.521255 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:26.521255 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:26.522114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:26.522114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:26.522114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:26.522114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:26.522114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:26.522114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:26.522114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:26.522114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:26.522114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:26.522114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:26.522114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:26.522114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:26.522114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:26.522114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:26.522114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:26.522114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:26.522114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:26.522998 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:26.522998 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:26.522998 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:26.522998 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:26.522998 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 263/512] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:26.523555 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45063142-7f17-46e0-9002-3275d355afe3 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:26.615912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7d834-8b72-42f1-8809-49ebc65f179e None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:26.624390 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45063142-7f17-46e0-9002-3275d355afe3 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:26.629722 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:26.652211 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a97217-29ba-4157-b016-69da4535e1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:26.653034 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a97217-29ba-4157-b016-69da4535e1ac None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:26.653323 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a97217-29ba-4157-b016-69da4535e1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:26.653625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a97217-29ba-4157-b016-69da4535e1ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:26.659804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039637f-6d02-4d1c-b884-9fcca9221897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:26.660486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039637f-6d02-4d1c-b884-9fcca9221897 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:26.660769 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039637f-6d02-4d1c-b884-9fcca9221897 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:26.661052 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039637f-6d02-4d1c-b884-9fcca9221897 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:26.661900 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039637f-6d02-4d1c-b884-9fcca9221897 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:26.662216 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039637f-6d02-4d1c-b884-9fcca9221897 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:26.663757 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039637f-6d02-4d1c-b884-9fcca9221897 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:26.664169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a97217-29ba-4157-b016-69da4535e1ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:26.665638 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a97217-29ba-4157-b016-69da4535e1ac None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:26.681024 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 264/513] 10.222.0.16 () {56 vars in 1137 bytes} [Fri Jun 24 10:40:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:26.681832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039637f-6d02-4d1c-b884-9fcca9221897 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:26.684222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-c2a97217-29ba-4157-b016-69da4535e1ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:26.684222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:26.684222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:26.684222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:26.684222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:26.684222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:26.684222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:26.684222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:26.684222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:26.684222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:26.684222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:26.684222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:26.684222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:26.684222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:26.684222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:26.685040 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:26.685040 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:26.685040 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:26.685040 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:26.685040 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:26.685040 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:26.685040 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:26.685040 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:26.685040 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:26.685040 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:26.685040 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:26.685040 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:26.685040 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:26.685040 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:26.685040 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:26.685040 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:26.685040 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:26.685871 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:26.685871 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:26.685871 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:26.685871 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:26.685871 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 250/514] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:26.686588 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a97217-29ba-4157-b016-69da4535e1ac None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:26.722677 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:26.784892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039637f-6d02-4d1c-b884-9fcca9221897 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:26.793066 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a97217-29ba-4157-b016-69da4535e1ac None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:26.824006 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff60fc-aa18-4983-a400-ee9368a739bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:26.825021 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff60fc-aa18-4983-a400-ee9368a739bd None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:26.825447 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff60fc-aa18-4983-a400-ee9368a739bd None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:26.825936 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff60fc-aa18-4983-a400-ee9368a739bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:26.829236 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb8f3f-bffd-4eb8-9429-6a0b4da341ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:26.829916 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb8f3f-bffd-4eb8-9429-6a0b4da341ff None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:26.830201 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb8f3f-bffd-4eb8-9429-6a0b4da341ff None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:26.830481 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb8f3f-bffd-4eb8-9429-6a0b4da341ff None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:26.831253 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb8f3f-bffd-4eb8-9429-6a0b4da341ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:26.831585 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb8f3f-bffd-4eb8-9429-6a0b4da341ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:26.832970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb8f3f-bffd-4eb8-9429-6a0b4da341ff None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:26.845036 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 251/515] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:26.845845 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb8f3f-bffd-4eb8-9429-6a0b4da341ff None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:26.880549 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:26.904614 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff60fc-aa18-4983-a400-ee9368a739bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:26.906091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff60fc-aa18-4983-a400-ee9368a739bd None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:26.944280 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:26.957148 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb8f3f-bffd-4eb8-9429-6a0b4da341ff None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:26.990263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9b5af-fe0f-4a46-89f7-bbce3ee0cedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:26.990929 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9b5af-fe0f-4a46-89f7-bbce3ee0cedd None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:26.991237 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9b5af-fe0f-4a46-89f7-bbce3ee0cedd None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:26.991605 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9b5af-fe0f-4a46-89f7-bbce3ee0cedd None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:26.992334 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9b5af-fe0f-4a46-89f7-bbce3ee0cedd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:26.992749 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9b5af-fe0f-4a46-89f7-bbce3ee0cedd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:26.994134 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9b5af-fe0f-4a46-89f7-bbce3ee0cedd None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:27.005376 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 265/516] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:40:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:27.010195 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 252/517] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:27.010307 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff60fc-aa18-4983-a400-ee9368a739bd None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:27.010394 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9b5af-fe0f-4a46-89f7-bbce3ee0cedd None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:27.090248 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:27.105706 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff60fc-aa18-4983-a400-ee9368a739bd None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:27.107392 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9b5af-fe0f-4a46-89f7-bbce3ee0cedd None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:27.140318 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf63fd-233c-480e-be53-fb94e32841b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:27.140663 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c440f4-581c-42e0-9050-4b815db56f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:27.140916 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf63fd-233c-480e-be53-fb94e32841b4 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:27.141195 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf63fd-233c-480e-be53-fb94e32841b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:27.141359 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c440f4-581c-42e0-9050-4b815db56f0a None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:27.141457 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf63fd-233c-480e-be53-fb94e32841b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:27.141615 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c440f4-581c-42e0-9050-4b815db56f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:27.141891 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c440f4-581c-42e0-9050-4b815db56f0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:27.142177 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf63fd-233c-480e-be53-fb94e32841b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:27.142482 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf63fd-233c-480e-be53-fb94e32841b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:27.144008 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf63fd-233c-480e-be53-fb94e32841b4 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:27.150673 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:27.160409 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 266/518] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:27.160409 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf63fd-233c-480e-be53-fb94e32841b4 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:27.220530 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c440f4-581c-42e0-9050-4b815db56f0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:27.222039 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c440f4-581c-42e0-9050-4b815db56f0a None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:27.260574 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf63fd-233c-480e-be53-fb94e32841b4 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:27.293525 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b679c3-8c86-4a9b-893e-7079a5b69632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:27.294378 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b679c3-8c86-4a9b-893e-7079a5b69632 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:27.294659 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b679c3-8c86-4a9b-893e-7079a5b69632 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:27.294931 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b679c3-8c86-4a9b-893e-7079a5b69632 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:27.301489 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b679c3-8c86-4a9b-893e-7079a5b69632 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:27.302905 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b679c3-8c86-4a9b-893e-7079a5b69632 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:27.305923 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:27.318313 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-c0b679c3-8c86-4a9b-893e-7079a5b69632 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:27.318313 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:27.318313 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:27.318313 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:27.318313 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:27.318313 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:27.318313 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:27.318313 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:27.318313 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:27.318313 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:27.318313 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:27.318313 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:27.318313 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:40:27.318313 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:40:27.318313 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:40:27.319237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:40:27.319237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:27.319237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:27.319237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:27.319237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:27.319237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:27.319237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:27.319237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:27.319237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:27.319237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:27.319237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:27.319237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:27.319237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:27.319237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:27.319237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:27.319237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:27.319237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:27.320277 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:40:27.320277 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:40:27.320277 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:40:27.320277 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:40:27.320277 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:40:27.320277 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:40:27.320277 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:27.320277 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:27.320277 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 267/519] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:40:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:27.320968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b679c3-8c86-4a9b-893e-7079a5b69632 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:27.331298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 253/520] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:40:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:27.331298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c440f4-581c-42e0-9050-4b815db56f0a None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:27.378354 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:27.420115 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b679c3-8c86-4a9b-893e-7079a5b69632 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:27.429855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c440f4-581c-42e0-9050-4b815db56f0a None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:27.453735 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a488d6-3b49-426e-9eb6-b1724e0fae5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:27.454537 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a488d6-3b49-426e-9eb6-b1724e0fae5a None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:27.454833 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a488d6-3b49-426e-9eb6-b1724e0fae5a None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:27.455111 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a488d6-3b49-426e-9eb6-b1724e0fae5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:27.464533 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ee5ce-05aa-48fb-a3ff-bf9636458c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:27.465339 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ee5ce-05aa-48fb-a3ff-bf9636458c64 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:27.465611 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ee5ce-05aa-48fb-a3ff-bf9636458c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:27.465729 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a488d6-3b49-426e-9eb6-b1724e0fae5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:27.465901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ee5ce-05aa-48fb-a3ff-bf9636458c64 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:27.467106 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a488d6-3b49-426e-9eb6-b1724e0fae5a None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:27.472912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ee5ce-05aa-48fb-a3ff-bf9636458c64 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:27.474350 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ee5ce-05aa-48fb-a3ff-bf9636458c64 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:27.485506 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-53a488d6-3b49-426e-9eb6-b1724e0fae5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:27.485506 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:27.485506 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:27.485506 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:27.485506 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:27.485506 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:27.485506 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:27.485506 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:27.485506 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:27.485506 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:27.485506 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:27.485506 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:27.485506 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:27.485506 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:27.485506 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:27.486373 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:27.486373 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:27.486373 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:27.486373 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:27.486373 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:27.486373 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:27.486373 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:27.486373 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:27.486373 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:27.486373 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:27.486373 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:27.486373 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:27.486373 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:27.486373 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:27.486373 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:27.486373 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:27.486373 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:27.487256 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:27.487256 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:27.487256 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:27.487256 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:27.487256 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 268/521] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:27.487517 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a488d6-3b49-426e-9eb6-b1724e0fae5a None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:27.489517 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-255ee5ce-05aa-48fb-a3ff-bf9636458c64 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 10:40:27.489517 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:27.489517 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:27.489517 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:27.489517 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:27.489517 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:27.489517 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:27.489517 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:27.489517 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:27.489517 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:27.489517 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:27.489517 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:27.489517 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:40:27.489517 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:40:27.489517 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:40:27.489517 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:40:27.490513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:27.490513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:27.490513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:40:27.490513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:27.490513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:40:27.490513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:27.490513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:27.490513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:27.490513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:27.490513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:27.490513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:27.490513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:27.490513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:27.490513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:27.490513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:27.490513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:27.490513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:27.490513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:27.492015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:27.492015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:27.492015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:40:27.492015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:40:27.492015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:40:27.492015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:40:27.492015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:40:27.492015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:40:27.492015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 10:40:27.492015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:27.492015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 254/522] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 10:40:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:27.493125 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ee5ce-05aa-48fb-a3ff-bf9636458c64 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:27.539728 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:27.594302 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ee5ce-05aa-48fb-a3ff-bf9636458c64 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:27.596149 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a488d6-3b49-426e-9eb6-b1724e0fae5a None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:27.607172 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:27.628714 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa2c60-21e4-41e1-a569-551a627180ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:27.629386 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa2c60-21e4-41e1-a569-551a627180ba None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:27.629668 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa2c60-21e4-41e1-a569-551a627180ba None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:27.629969 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa2c60-21e4-41e1-a569-551a627180ba None admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:27.630746 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa2c60-21e4-41e1-a569-551a627180ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:27.631048 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa2c60-21e4-41e1-a569-551a627180ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:27.632620 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa2c60-21e4-41e1-a569-551a627180ba None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:27.635823 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80c13b-6b5e-45f7-b082-ad2f5e5099af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:27.636506 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80c13b-6b5e-45f7-b082-ad2f5e5099af None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:27.636792 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80c13b-6b5e-45f7-b082-ad2f5e5099af None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:27.637072 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80c13b-6b5e-45f7-b082-ad2f5e5099af None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:27.637786 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80c13b-6b5e-45f7-b082-ad2f5e5099af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:27.639215 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80c13b-6b5e-45f7-b082-ad2f5e5099af None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:27.651070 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 255/523] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:40:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:27.652481 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa2c60-21e4-41e1-a569-551a627180ba None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:27.666698 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 269/524] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 10:40:27 2022] POST /identity/v3/users => generated 247 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:40:27.667576 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80c13b-6b5e-45f7-b082-ad2f5e5099af None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:27.770026 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa2c60-21e4-41e1-a569-551a627180ba None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:27.774051 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:27.801764 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80c13b-6b5e-45f7-b082-ad2f5e5099af None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:27.809975 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c41a9-e19f-4d00-b08d-f72c66705146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:27.810779 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c41a9-e19f-4d00-b08d-f72c66705146 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:27.811064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c41a9-e19f-4d00-b08d-f72c66705146 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:27.811393 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c41a9-e19f-4d00-b08d-f72c66705146 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:27.822883 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c41a9-e19f-4d00-b08d-f72c66705146 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:27.824390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c41a9-e19f-4d00-b08d-f72c66705146 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:27.842953 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-8b3c41a9-e19f-4d00-b08d-f72c66705146 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:27.842953 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:27.842953 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:27.842953 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:27.842953 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:27.842953 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:27.842953 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:27.842953 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:27.842953 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:27.842953 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:27.842953 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:27.842953 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:27.842953 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:27.842953 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:27.842953 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:27.843981 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:27.843981 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:27.843981 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:27.843981 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:27.843981 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:27.843981 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:27.843981 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:27.843981 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:27.843981 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:27.843981 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:27.843981 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:27.843981 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:27.843981 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:27.843981 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:27.843981 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:27.843981 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:27.843981 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:27.844915 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:27.844915 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:27.844915 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:27.844915 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:27.844915 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 256/525] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:27.845293 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c41a9-e19f-4d00-b08d-f72c66705146 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:27.846134 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de64c7-069f-47d5-8d80-e9facf2b77f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:27.846825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de64c7-069f-47d5-8d80-e9facf2b77f3 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:27.847116 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de64c7-069f-47d5-8d80-e9facf2b77f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:27.847422 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de64c7-069f-47d5-8d80-e9facf2b77f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:27.848169 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de64c7-069f-47d5-8d80-e9facf2b77f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:27.848480 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de64c7-069f-47d5-8d80-e9facf2b77f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:27.849922 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de64c7-069f-47d5-8d80-e9facf2b77f3 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:27.865400 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 270/526] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:27.866282 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de64c7-069f-47d5-8d80-e9facf2b77f3 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:27.897458 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:27.956016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c41a9-e19f-4d00-b08d-f72c66705146 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:27.976999 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de64c7-069f-47d5-8d80-e9facf2b77f3 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:27.990783 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c24d62-a944-49fd-899b-b5538a09a347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:27.991514 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c24d62-a944-49fd-899b-b5538a09a347 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:27.991794 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c24d62-a944-49fd-899b-b5538a09a347 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:27.992077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c24d62-a944-49fd-899b-b5538a09a347 None admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:27.992926 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c24d62-a944-49fd-899b-b5538a09a347 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:27.993231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c24d62-a944-49fd-899b-b5538a09a347 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:27.994693 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c24d62-a944-49fd-899b-b5538a09a347 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:28.012514 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 257/527] 10.222.0.16 () {56 vars in 1139 bytes} [Fri Jun 24 10:40:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:28.013358 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c24d62-a944-49fd-899b-b5538a09a347 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:28.018678 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6b65f-0075-4f66-bec3-be14ccdca8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:28.019386 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6b65f-0075-4f66-bec3-be14ccdca8b3 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:28.019669 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6b65f-0075-4f66-bec3-be14ccdca8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:28.019944 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6b65f-0075-4f66-bec3-be14ccdca8b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:28.020837 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6b65f-0075-4f66-bec3-be14ccdca8b3 None admin] RBAC: Adding query filter params (role.id=7bab53c1ac3d4e04b18c87286e2ab0aa, scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user.id=e8034bad51144002a7386c975e412992) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:28.021101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6b65f-0075-4f66-bec3-be14ccdca8b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:28.022535 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6b65f-0075-4f66-bec3-be14ccdca8b3 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:28.029678 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 271/528] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:40:27 2022] GET /identity/v3/role_assignments?user.id=e8034bad51144002a7386c975e412992&scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e&role.id=7bab53c1ac3d4e04b18c87286e2ab0aa => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:28.030743 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6b65f-0075-4f66-bec3-be14ccdca8b3 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:28.042960 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:28.134873 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:28.151786 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6b65f-0075-4f66-bec3-be14ccdca8b3 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:28.176327 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c24d62-a944-49fd-899b-b5538a09a347 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:28.199085 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255c623-d95b-4ff6-8cd6-ae607ecac333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:28.199938 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255c623-d95b-4ff6-8cd6-ae607ecac333 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:28.200218 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255c623-d95b-4ff6-8cd6-ae607ecac333 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:28.200493 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255c623-d95b-4ff6-8cd6-ae607ecac333 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:28.213043 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255c623-d95b-4ff6-8cd6-ae607ecac333 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:28.213043 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255c623-d95b-4ff6-8cd6-ae607ecac333 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:28.220968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bc749-e695-4d15-97c9-00314c28e4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:28.221662 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bc749-e695-4d15-97c9-00314c28e4a1 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:28.221946 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bc749-e695-4d15-97c9-00314c28e4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:28.222222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bc749-e695-4d15-97c9-00314c28e4a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:28.222957 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bc749-e695-4d15-97c9-00314c28e4a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:28.223327 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bc749-e695-4d15-97c9-00314c28e4a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:28.224720 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bc749-e695-4d15-97c9-00314c28e4a1 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:28.232213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-a255c623-d95b-4ff6-8cd6-ae607ecac333 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:28.232213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:28.232213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:28.232213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:28.232213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:28.232213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:28.232213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:28.232213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:28.232213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:28.232213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:28.232213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:28.232213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:28.232213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:40:28.232213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:40:28.232213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:40:28.233079 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:40:28.233079 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:28.233079 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:28.233079 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:28.233079 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:28.233079 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:28.233079 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:28.233079 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:28.233079 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:28.233079 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:28.233079 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:28.233079 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:28.233079 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:28.233079 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:28.233079 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:28.233079 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:28.233079 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:28.233912 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:40:28.233912 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:40:28.233912 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:40:28.233912 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:40:28.233912 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:40:28.233912 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:40:28.233912 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:28.233912 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:28.236088 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 272/529] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:40:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:28.237102 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255c623-d95b-4ff6-8cd6-ae607ecac333 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:28.241893 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 258/530] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:28.242120 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bc749-e695-4d15-97c9-00314c28e4a1 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:28.344269 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:28.363360 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255c623-d95b-4ff6-8cd6-ae607ecac333 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:28.372487 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bc749-e695-4d15-97c9-00314c28e4a1 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:28.407720 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f7c9c-3ed3-4c95-929f-266067a8f8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:28.407939 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a94a1-0bc9-4df6-ae5f-e19c8d44c017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:28.408647 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f7c9c-3ed3-4c95-929f-266067a8f8e9 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:28.408895 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a94a1-0bc9-4df6-ae5f-e19c8d44c017 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:28.409131 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f7c9c-3ed3-4c95-929f-266067a8f8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:28.409483 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a94a1-0bc9-4df6-ae5f-e19c8d44c017 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:28.409592 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f7c9c-3ed3-4c95-929f-266067a8f8e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:28.409990 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a94a1-0bc9-4df6-ae5f-e19c8d44c017 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:28.410530 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f7c9c-3ed3-4c95-929f-266067a8f8e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:28.410933 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f7c9c-3ed3-4c95-929f-266067a8f8e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:28.412502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f7c9c-3ed3-4c95-929f-266067a8f8e9 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:28.431752 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:28.435959 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 259/531] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:40:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:28.436613 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f7c9c-3ed3-4c95-929f-266067a8f8e9 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:28.489050 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a94a1-0bc9-4df6-ae5f-e19c8d44c017 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:28.490988 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a94a1-0bc9-4df6-ae5f-e19c8d44c017 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:28.543985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f7c9c-3ed3-4c95-929f-266067a8f8e9 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:28.579614 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de237e-1d8f-431f-9e47-6b942e29cecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:28.580745 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de237e-1d8f-431f-9e47-6b942e29cecf None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:28.580854 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de237e-1d8f-431f-9e47-6b942e29cecf None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:28.581098 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de237e-1d8f-431f-9e47-6b942e29cecf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:28.583087 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:28.588717 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de237e-1d8f-431f-9e47-6b942e29cecf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:28.590618 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de237e-1d8f-431f-9e47-6b942e29cecf None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:28.605553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-d2de237e-1d8f-431f-9e47-6b942e29cecf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:28.605553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:28.605553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:28.605553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:28.605553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:28.605553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:28.605553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:28.605553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:28.605553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:28.605553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:28.605553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:28.605553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:28.605553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:40:28.605553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:40:28.605553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:40:28.606395 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:40:28.606395 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:28.606395 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:28.606395 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:28.606395 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:28.606395 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:28.606395 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:28.606395 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:28.606395 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:28.606395 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:28.606395 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:28.606395 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:28.606395 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:28.606395 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:28.606395 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:28.606395 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:28.606395 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:28.607246 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:40:28.607246 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:40:28.607246 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:40:28.607246 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:40:28.607246 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:40:28.607246 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:40:28.607246 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:28.607246 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:28.611288 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 260/532] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:40:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:28.612138 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de237e-1d8f-431f-9e47-6b942e29cecf None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:28.615121 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 273/533] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:40:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:28.628205 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a94a1-0bc9-4df6-ae5f-e19c8d44c017 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:28.707567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:28.730024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de237e-1d8f-431f-9e47-6b942e29cecf None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:28.738339 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a94a1-0bc9-4df6-ae5f-e19c8d44c017 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:28.766425 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff894bd9-f001-4ea6-8821-c38e8de05cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:28.767565 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff894bd9-f001-4ea6-8821-c38e8de05cde None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:28.768032 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff894bd9-f001-4ea6-8821-c38e8de05cde None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:28.768450 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff894bd9-f001-4ea6-8821-c38e8de05cde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:28.769447 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff894bd9-f001-4ea6-8821-c38e8de05cde None admin] RBAC: Adding query filter params (role.id=7bab53c1ac3d4e04b18c87286e2ab0aa, scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user.id=b2f6668cb6244bba9e547ff95b2e6f46) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:28.769902 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff894bd9-f001-4ea6-8821-c38e8de05cde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:28.771687 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff894bd9-f001-4ea6-8821-c38e8de05cde None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:28.776655 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90869e39-baa7-45e0-85e8-b99a03f6d2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:28.777548 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90869e39-baa7-45e0-85e8-b99a03f6d2cb None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:28.777916 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90869e39-baa7-45e0-85e8-b99a03f6d2cb None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:28.778259 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90869e39-baa7-45e0-85e8-b99a03f6d2cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:28.779140 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 261/534] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:40:28 2022] GET /identity/v3/role_assignments?user.id=b2f6668cb6244bba9e547ff95b2e6f46&scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e&role.id=7bab53c1ac3d4e04b18c87286e2ab0aa => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:28.780199 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff894bd9-f001-4ea6-8821-c38e8de05cde None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:28.790962 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90869e39-baa7-45e0-85e8-b99a03f6d2cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:28.792635 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90869e39-baa7-45e0-85e8-b99a03f6d2cb None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:28.813158 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-90869e39-baa7-45e0-85e8-b99a03f6d2cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:28.813158 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:28.813158 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:28.813158 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:28.813158 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:28.813158 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:28.813158 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:28.813158 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:28.813158 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:28.813158 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:28.813158 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:28.813158 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:28.813158 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:28.813158 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:28.813158 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:28.814452 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:28.814452 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:28.814452 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:28.814452 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:28.814452 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:28.814452 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:28.814452 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:28.814452 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:28.814452 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:28.814452 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:28.814452 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:28.814452 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:28.814452 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:28.814452 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:28.814452 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:28.814452 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:28.814452 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:28.815793 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:28.815793 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:28.815793 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:28.815793 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:28.815793 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 274/535] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:28.822190 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90869e39-baa7-45e0-85e8-b99a03f6d2cb None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:28.893831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:28.962132 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff894bd9-f001-4ea6-8821-c38e8de05cde None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:29.006734 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd7497-1f1b-4fbb-bbf7-0c8b72f796bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:29.007602 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd7497-1f1b-4fbb-bbf7-0c8b72f796bb None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:29.007919 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd7497-1f1b-4fbb-bbf7-0c8b72f796bb None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:29.008081 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd7497-1f1b-4fbb-bbf7-0c8b72f796bb None admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:29.008818 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd7497-1f1b-4fbb-bbf7-0c8b72f796bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:29.009129 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd7497-1f1b-4fbb-bbf7-0c8b72f796bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:29.010593 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd7497-1f1b-4fbb-bbf7-0c8b72f796bb None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:29.028540 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90869e39-baa7-45e0-85e8-b99a03f6d2cb None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:29.030081 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:29.041193 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 262/536] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:40:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:29.047035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd7497-1f1b-4fbb-bbf7-0c8b72f796bb None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:29.092984 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc0b5d-d6a3-4a57-863a-f7abcb7333b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:29.093714 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc0b5d-d6a3-4a57-863a-f7abcb7333b4 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:29.094001 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc0b5d-d6a3-4a57-863a-f7abcb7333b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:29.094283 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc0b5d-d6a3-4a57-863a-f7abcb7333b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:29.095022 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc0b5d-d6a3-4a57-863a-f7abcb7333b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:29.095355 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc0b5d-d6a3-4a57-863a-f7abcb7333b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:29.096756 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc0b5d-d6a3-4a57-863a-f7abcb7333b4 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:29.121840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 275/537] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:29.127242 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc0b5d-d6a3-4a57-863a-f7abcb7333b4 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:29.235389 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd7497-1f1b-4fbb-bbf7-0c8b72f796bb None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:29.279814 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:29.305614 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc0b5d-d6a3-4a57-863a-f7abcb7333b4 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:29.323903 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14c549-6684-4135-941e-9cf113180142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:29.324595 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14c549-6684-4135-941e-9cf113180142 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:29.324883 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14c549-6684-4135-941e-9cf113180142 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:29.325167 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14c549-6684-4135-941e-9cf113180142 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:29.326016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14c549-6684-4135-941e-9cf113180142 None admin] RBAC: Adding query filter params (role.id=7bab53c1ac3d4e04b18c87286e2ab0aa, scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user.id=fcba737e66244fe2b5b6ec3dd17dabd3) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:29.326332 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14c549-6684-4135-941e-9cf113180142 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:29.327873 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14c549-6684-4135-941e-9cf113180142 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:29.341447 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 263/538] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:40:29 2022] GET /identity/v3/role_assignments?user.id=fcba737e66244fe2b5b6ec3dd17dabd3&scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e&role.id=7bab53c1ac3d4e04b18c87286e2ab0aa => generated 259 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:29.348982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2e5bd-c8ec-4193-b3f8-b00026e00595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:29.349818 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2e5bd-c8ec-4193-b3f8-b00026e00595 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:29.350108 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2e5bd-c8ec-4193-b3f8-b00026e00595 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:29.350386 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2e5bd-c8ec-4193-b3f8-b00026e00595 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:29.358951 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2e5bd-c8ec-4193-b3f8-b00026e00595 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:29.360471 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2e5bd-c8ec-4193-b3f8-b00026e00595 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:29.375825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-66f2e5bd-c8ec-4193-b3f8-b00026e00595 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:29.375825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:29.375825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:29.375825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:29.375825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:29.375825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:29.375825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:29.375825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:29.375825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:29.375825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:29.375825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:29.375825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:29.375825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:40:29.375825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:40:29.375825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:40:29.376759 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:40:29.376759 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:29.376759 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:29.376759 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:29.376759 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:29.376759 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:29.376759 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:29.376759 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:29.376759 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:29.376759 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:29.376759 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:29.376759 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:29.376759 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:29.376759 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:29.376759 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:29.376759 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:29.376759 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:29.377896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:40:29.377896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:40:29.377896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:40:29.377896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:40:29.377896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:40:29.377896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:40:29.377896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:29.377896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:29.377896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 276/539] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:40:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:40:29.383450 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14c549-6684-4135-941e-9cf113180142 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:29.521209 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14c549-6684-4135-941e-9cf113180142 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:29.572160 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74653ad7-d18b-4356-938c-83c5c3bf538f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:29.572881 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74653ad7-d18b-4356-938c-83c5c3bf538f None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:29.573155 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74653ad7-d18b-4356-938c-83c5c3bf538f None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:29.573477 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74653ad7-d18b-4356-938c-83c5c3bf538f None admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:29.574280 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74653ad7-d18b-4356-938c-83c5c3bf538f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:29.574588 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74653ad7-d18b-4356-938c-83c5c3bf538f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:29.576053 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74653ad7-d18b-4356-938c-83c5c3bf538f None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:29.588497 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 264/540] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:40:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:29.594447 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2e5bd-c8ec-4193-b3f8-b00026e00595 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:29.625948 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:29.720903 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2e5bd-c8ec-4193-b3f8-b00026e00595 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:29.755493 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25969d8-2999-4c07-b802-0d0eee3d5219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:29.756164 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25969d8-2999-4c07-b802-0d0eee3d5219 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:29.756450 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25969d8-2999-4c07-b802-0d0eee3d5219 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:29.756730 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25969d8-2999-4c07-b802-0d0eee3d5219 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:29.757603 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25969d8-2999-4c07-b802-0d0eee3d5219 None admin] RBAC: Adding query filter params (role.id=7bab53c1ac3d4e04b18c87286e2ab0aa, scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user.id=9c20321abda7406c843b4ee691da2106) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:29.757922 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25969d8-2999-4c07-b802-0d0eee3d5219 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:29.759398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25969d8-2999-4c07-b802-0d0eee3d5219 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:29.765448 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 277/541] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:40:29 2022] GET /identity/v3/role_assignments?user.id=9c20321abda7406c843b4ee691da2106&scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e&role.id=7bab53c1ac3d4e04b18c87286e2ab0aa => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:29.828860 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48631949-04b3-4716-94ec-71a960c309c2 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:29.829044 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48631949-04b3-4716-94ec-71a960c309c2 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:29.829330 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48631949-04b3-4716-94ec-71a960c309c2 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:29.830939 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 265/542] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:29.836831 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad51cb-fcc0-49b1-a202-c1c004d09594 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:29.837111 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad51cb-fcc0-49b1-a202-c1c004d09594 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:29.837396 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad51cb-fcc0-49b1-a202-c1c004d09594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:29.855501 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-49ad51cb-fcc0-49b1-a202-c1c004d09594 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:29.856720 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-49ad51cb-fcc0-49b1-a202-c1c004d09594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:29.941316 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 278/543] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:29.984489 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48631949-04b3-4716-94ec-71a960c309c2 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:30.030872 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:30.109231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48631949-04b3-4716-94ec-71a960c309c2 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:30.148697 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22912cf5-7971-4944-ad62-5e9112c3077c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:30.149553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22912cf5-7971-4944-ad62-5e9112c3077c None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:30.149844 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22912cf5-7971-4944-ad62-5e9112c3077c None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:30.150121 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22912cf5-7971-4944-ad62-5e9112c3077c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:30.164650 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22912cf5-7971-4944-ad62-5e9112c3077c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:30.172634 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-22912cf5-7971-4944-ad62-5e9112c3077c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:40:30.172634 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:30.172634 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:30.172634 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:30.172634 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:30.172634 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:30.172634 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:30.172634 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:30.172634 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:30.172634 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:30.172634 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:30.172634 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:30.172634 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:30.172634 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:30.172634 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:30.172634 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:30.173516 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:30.173516 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:30.173516 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:30.173516 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:30.173516 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:30.173516 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:30.173516 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:30.173516 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:30.173516 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:30.173516 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:30.173516 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:30.173516 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:30.173516 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:30.173516 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:30.173516 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:30.173516 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:30.174732 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:30.174732 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:30.174732 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:30.174732 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:30.174732 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:30.174732 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:30.174732 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:30.174732 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:30.174732 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:30.174732 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:30.174732 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:40:30.174732 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:30.174732 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 266/544] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 10:40:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:30.179838 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad51cb-fcc0-49b1-a202-c1c004d09594 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:30.211533 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:30.338238 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad51cb-fcc0-49b1-a202-c1c004d09594 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:30.384651 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e11483-9e2b-4175-a9d4-bd1442e81403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:30.385254 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e11483-9e2b-4175-a9d4-bd1442e81403 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:30.385540 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e11483-9e2b-4175-a9d4-bd1442e81403 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:30.385819 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e11483-9e2b-4175-a9d4-bd1442e81403 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:30.386586 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e11483-9e2b-4175-a9d4-bd1442e81403 None admin] RBAC: Adding query filter params (name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:30.386898 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e11483-9e2b-4175-a9d4-bd1442e81403 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:30.388329 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e11483-9e2b-4175-a9d4-bd1442e81403 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:30.402935 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 279/545] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 10:40:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:30.408567 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22912cf5-7971-4944-ad62-5e9112c3077c None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:30.564131 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22912cf5-7971-4944-ad62-5e9112c3077c None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:30.565648 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:30.617831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399821e3-1618-4cc5-a8f9-00b9b1269397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:30.618664 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399821e3-1618-4cc5-a8f9-00b9b1269397 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:30.618949 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399821e3-1618-4cc5-a8f9-00b9b1269397 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:30.619252 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399821e3-1618-4cc5-a8f9-00b9b1269397 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:30.631521 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399821e3-1618-4cc5-a8f9-00b9b1269397 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:30.633341 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399821e3-1618-4cc5-a8f9-00b9b1269397 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:30.660738 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-399821e3-1618-4cc5-a8f9-00b9b1269397 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:30.660738 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:30.660738 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:30.660738 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:30.660738 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:30.660738 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:30.660738 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:30.660738 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:30.660738 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:30.660738 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:30.660738 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:30.660738 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:30.660738 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:30.660738 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:30.660738 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:30.661515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:30.661515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:30.661515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:30.661515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:30.661515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:30.661515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:30.661515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:30.661515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:30.661515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:30.661515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:30.661515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:30.661515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:30.661515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:30.661515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:30.661515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:30.661515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:30.661515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:30.662348 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:30.662348 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:30.662348 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:30.662348 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:30.662348 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 267/546] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:30.664943 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7184069-f30d-48f0-ad1f-4bfb0ece7e2a None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:30.665239 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7184069-f30d-48f0-ad1f-4bfb0ece7e2a None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:30.665527 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7184069-f30d-48f0-ad1f-4bfb0ece7e2a None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:30.667198 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 280/547] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:30.667478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399821e3-1618-4cc5-a8f9-00b9b1269397 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:30.671997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eac705-4fd8-481f-baf6-12488ed0670c None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:30.672292 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eac705-4fd8-481f-baf6-12488ed0670c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:30.672580 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eac705-4fd8-481f-baf6-12488ed0670c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:30.691790 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-d6eac705-4fd8-481f-baf6-12488ed0670c None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:30.693696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-d6eac705-4fd8-481f-baf6-12488ed0670c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:30.772794 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 281/548] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:40:30.815358 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eac705-4fd8-481f-baf6-12488ed0670c None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:30.827517 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:30.857620 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399821e3-1618-4cc5-a8f9-00b9b1269397 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:30.915675 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a115c-04c7-4ba5-a5ca-a5489d5e0a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:30.916290 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a115c-04c7-4ba5-a5ca-a5489d5e0a8a None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:30.916579 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a115c-04c7-4ba5-a5ca-a5489d5e0a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:30.916862 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a115c-04c7-4ba5-a5ca-a5489d5e0a8a None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:30.917617 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a115c-04c7-4ba5-a5ca-a5489d5e0a8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:30.917930 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a115c-04c7-4ba5-a5ca-a5489d5e0a8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:30.919392 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a115c-04c7-4ba5-a5ca-a5489d5e0a8a None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:30.935119 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 268/549] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:40:30.940800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a115c-04c7-4ba5-a5ca-a5489d5e0a8a None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:30.971582 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:31.021032 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eac705-4fd8-481f-baf6-12488ed0670c None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:31.100871 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f44384-f4b2-4947-b959-8fb326d6fdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:31.101711 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f44384-f4b2-4947-b959-8fb326d6fdfa None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:31.101998 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f44384-f4b2-4947-b959-8fb326d6fdfa None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:31.102279 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f44384-f4b2-4947-b959-8fb326d6fdfa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:31.124012 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f44384-f4b2-4947-b959-8fb326d6fdfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:31.140523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-a7f44384-f4b2-4947-b959-8fb326d6fdfa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:40:31.140523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:31.140523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:31.140523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:31.140523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:31.140523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:31.140523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:31.140523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:31.140523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:31.140523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:31.140523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:31.140523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:31.140523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:31.140523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:31.140523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:31.140523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:31.141937 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:31.141937 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:31.141937 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:31.141937 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:31.141937 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:31.141937 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:31.141937 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:31.141937 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:31.141937 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:31.141937 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:31.141937 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:31.141937 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:31.141937 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:31.141937 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:31.141937 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:31.141937 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:31.142898 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:31.142898 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:31.142898 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:31.142898 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:31.142898 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:31.142898 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:31.142898 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:31.142898 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:31.142898 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:31.142898 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:31.142898 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:40:31.142898 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:31.145688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a115c-04c7-4ba5-a5ca-a5489d5e0a8a None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:31.146112 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 282/550] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 10:40:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:40:31.147336 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7d8e6-8e43-42f1-96f8-2743aaa0b48f None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:31.147778 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7d8e6-8e43-42f1-96f8-2743aaa0b48f None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:31.148181 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7d8e6-8e43-42f1-96f8-2743aaa0b48f None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:31.150061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 283/551] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:31.154424 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7d8e6-8e43-42f1-96f8-2743aaa0b48f None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:31.187633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c224c0-2b61-4537-adb5-e32cd084aeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:31.189203 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c224c0-2b61-4537-adb5-e32cd084aeff None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:31.189676 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c224c0-2b61-4537-adb5-e32cd084aeff None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:31.190156 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c224c0-2b61-4537-adb5-e32cd084aeff None admin] PATH_INFO: `/v3/users/swift` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:31.197787 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c224c0-2b61-4537-adb5-e32cd084aeff None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:31.199511 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c224c0-2b61-4537-adb5-e32cd084aeff None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:31.214513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-66c224c0-2b61-4537-adb5-e32cd084aeff None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 10:40:31.214513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:31.214513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:31.214513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:31.214513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:31.214513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:31.214513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:31.214513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:31.214513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:31.214513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:31.214513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:31.214513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:31.214513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:40:31.214513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:40:31.214513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:40:31.214513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:40:31.215685 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:31.215685 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:31.215685 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:40:31.215685 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:31.215685 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:40:31.215685 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:31.215685 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:31.215685 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:31.215685 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:31.215685 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:31.215685 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:31.215685 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:31.215685 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:31.215685 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:31.215685 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:31.215685 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:31.215685 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:31.215685 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:31.216796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:31.216796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:31.216796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:40:31.216796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:40:31.216796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:40:31.216796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:40:31.216796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:40:31.216796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:40:31.216796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 10:40:31.216796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:31.219220 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 269/552] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:40:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:31.220619 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab5278-98ff-4f9d-92d5-623efbfc27c7 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:31.221111 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab5278-98ff-4f9d-92d5-623efbfc27c7 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:31.221571 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab5278-98ff-4f9d-92d5-623efbfc27c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:31.227543 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:31.238894 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-63ab5278-98ff-4f9d-92d5-623efbfc27c7 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:31.240390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-63ab5278-98ff-4f9d-92d5-623efbfc27c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:31.269276 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7d8e6-8e43-42f1-96f8-2743aaa0b48f None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:31.304169 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e3faf-6291-4f4b-9126-f77ce6f0461d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:31.305337 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e3faf-6291-4f4b-9126-f77ce6f0461d None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:31.305824 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e3faf-6291-4f4b-9126-f77ce6f0461d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:31.306294 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e3faf-6291-4f4b-9126-f77ce6f0461d None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:31.307311 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2e3faf-6291-4f4b-9126-f77ce6f0461d None admin] RBAC: Adding query filter params (name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:31.307810 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2e3faf-6291-4f4b-9126-f77ce6f0461d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:31.309447 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2e3faf-6291-4f4b-9126-f77ce6f0461d None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:31.318819 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 284/553] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 10:40:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:31.319939 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e3faf-6291-4f4b-9126-f77ce6f0461d None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:31.327250 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 270/554] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:31.327250 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab5278-98ff-4f9d-92d5-623efbfc27c7 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:31.333580 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:31.440657 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab5278-98ff-4f9d-92d5-623efbfc27c7 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:31.446803 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e3faf-6291-4f4b-9126-f77ce6f0461d None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:31.477325 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a109634-9831-4a23-ba09-af4043f3a501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:31.478571 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a109634-9831-4a23-ba09-af4043f3a501 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:31.479045 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a109634-9831-4a23-ba09-af4043f3a501 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:31.479550 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a109634-9831-4a23-ba09-af4043f3a501 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:31.482224 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d7e43-a09a-4cb0-ac5a-084324720b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:31.483095 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d7e43-a09a-4cb0-ac5a-084324720b1c None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:31.483546 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d7e43-a09a-4cb0-ac5a-084324720b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:31.483965 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d7e43-a09a-4cb0-ac5a-084324720b1c None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:31.484984 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d7e43-a09a-4cb0-ac5a-084324720b1c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:31.485439 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d7e43-a09a-4cb0-ac5a-084324720b1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:31.487133 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d7e43-a09a-4cb0-ac5a-084324720b1c None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:31.490966 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a109634-9831-4a23-ba09-af4043f3a501 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:31.492653 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a109634-9831-4a23-ba09-af4043f3a501 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:31.506803 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 285/555] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Jun 24 10:40:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:31.511058 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:31.511475 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-0a109634-9831-4a23-ba09-af4043f3a501 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:31.511475 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:31.511475 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:31.511475 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:31.511475 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:31.511475 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:31.511475 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:31.511475 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:31.511475 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:31.511475 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:31.511475 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:31.511475 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:31.511475 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:31.511475 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:31.511475 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:31.512366 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:31.512366 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:31.512366 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:31.512366 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:31.512366 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:31.512366 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:31.512366 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:31.512366 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:31.512366 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:31.512366 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:31.512366 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:31.512366 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:31.512366 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:31.512366 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:31.512366 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:31.512366 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:31.512366 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:31.513250 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:31.513250 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:31.513250 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:31.513250 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:31.513250 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 271/556] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:31.513879 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a109634-9831-4a23-ba09-af4043f3a501 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:31.514174 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d7e43-a09a-4cb0-ac5a-084324720b1c None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:31.574583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:31.616613 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d7e43-a09a-4cb0-ac5a-084324720b1c None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:31.627251 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a109634-9831-4a23-ba09-af4043f3a501 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:31.655210 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc63340-56a8-48a0-bcb7-488745441386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:31.655210 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc63340-56a8-48a0-bcb7-488745441386 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:31.655210 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc63340-56a8-48a0-bcb7-488745441386 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:31.655210 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc63340-56a8-48a0-bcb7-488745441386 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:31.665700 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc63340-56a8-48a0-bcb7-488745441386 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:31.669533 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1a5a9-1e1b-46b9-a7d8-d251d117a978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:31.670385 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1a5a9-1e1b-46b9-a7d8-d251d117a978 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:31.670806 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1a5a9-1e1b-46b9-a7d8-d251d117a978 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:31.671262 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1a5a9-1e1b-46b9-a7d8-d251d117a978 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:31.674557 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-3dc63340-56a8-48a0-bcb7-488745441386 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:40:31.674557 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:31.674557 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:31.674557 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:31.674557 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:31.674557 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:31.674557 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:31.674557 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:31.674557 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:31.674557 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:31.674557 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:31.674557 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:31.674557 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:31.674557 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:31.674557 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:31.674557 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:31.675732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:31.675732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:31.675732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:31.675732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:31.675732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:31.675732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:31.675732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:31.675732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:31.675732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:31.675732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:31.675732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:31.675732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:31.675732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:31.675732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:31.675732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:31.675732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:31.677007 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:31.677007 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:31.677007 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:31.677007 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:31.677007 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:31.677007 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:31.677007 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:31.677007 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:31.677007 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:31.677007 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:31.677007 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:40:31.677007 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:31.681585 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 286/557] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 10:40:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:31.682572 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc63340-56a8-48a0-bcb7-488745441386 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:31.736279 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:31.748721 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1a5a9-1e1b-46b9-a7d8-d251d117a978 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:31.750487 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1a5a9-1e1b-46b9-a7d8-d251d117a978 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:31.793161 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc63340-56a8-48a0-bcb7-488745441386 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:31.807282 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:31.831896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e34ec-c5fd-490c-afc1-a07386dcd808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:31.832822 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e34ec-c5fd-490c-afc1-a07386dcd808 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:31.833254 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e34ec-c5fd-490c-afc1-a07386dcd808 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:31.833706 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e34ec-c5fd-490c-afc1-a07386dcd808 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:31.834673 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e34ec-c5fd-490c-afc1-a07386dcd808 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:31.835197 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e34ec-c5fd-490c-afc1-a07386dcd808 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:31.836984 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e34ec-c5fd-490c-afc1-a07386dcd808 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:31.852045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 287/558] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:31.853171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e34ec-c5fd-490c-afc1-a07386dcd808 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:31.855591 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 272/559] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:40:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:31.857829 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1a5a9-1e1b-46b9-a7d8-d251d117a978 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:31.959806 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e34ec-c5fd-490c-afc1-a07386dcd808 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:31.968271 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1a5a9-1e1b-46b9-a7d8-d251d117a978 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:31.969787 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:32.005760 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff13203-84de-4fd3-8261-e3fa2f6021cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:32.005953 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0e25b-0f36-4205-98b5-3f36c0d4df94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:32.006411 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff13203-84de-4fd3-8261-e3fa2f6021cd None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:32.006515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0e25b-0f36-4205-98b5-3f36c0d4df94 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:32.006698 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff13203-84de-4fd3-8261-e3fa2f6021cd None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:32.006922 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0e25b-0f36-4205-98b5-3f36c0d4df94 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:32.007078 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff13203-84de-4fd3-8261-e3fa2f6021cd None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:32.007313 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0e25b-0f36-4205-98b5-3f36c0d4df94 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:32.008163 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff13203-84de-4fd3-8261-e3fa2f6021cd None admin] RBAC: Adding query filter params (name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:32.008481 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff13203-84de-4fd3-8261-e3fa2f6021cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:32.010552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff13203-84de-4fd3-8261-e3fa2f6021cd None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:32.014666 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0e25b-0f36-4205-98b5-3f36c0d4df94 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:32.016140 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0e25b-0f36-4205-98b5-3f36c0d4df94 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:32.024967 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 288/560] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 10:40:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:32.024967 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff13203-84de-4fd3-8261-e3fa2f6021cd None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:32.031031 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-22e0e25b-0f36-4205-98b5-3f36c0d4df94 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:40:32.031031 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:32.031031 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:32.031031 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:32.031031 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:32.031031 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:32.031031 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:32.031031 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:32.031031 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:32.031031 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:32.031031 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:32.031031 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:32.031031 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:40:32.031031 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:40:32.031031 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:40:32.031031 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:40:32.031970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:32.031970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:32.031970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:40:32.031970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:32.031970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:40:32.031970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:32.031970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:32.031970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:32.031970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:32.031970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:32.031970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:32.031970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:32.031970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:32.031970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:32.031970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:32.031970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:32.031970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:32.031970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:32.032900 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:32.032900 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:32.032900 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:40:32.032900 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:40:32.032900 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:40:32.032900 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:40:32.032900 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:40:32.032900 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:40:32.032900 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:40:32.032900 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:32.035522 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 273/561] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Jun 24 10:40:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:32.036773 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c6d00-5552-41ff-ae5d-30e95baeb0d1 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:32.037049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c6d00-5552-41ff-ae5d-30e95baeb0d1 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:32.037332 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c6d00-5552-41ff-ae5d-30e95baeb0d1 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:32.038728 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 274/562] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:32.039471 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c6d00-5552-41ff-ae5d-30e95baeb0d1 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:32.057625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:32.128940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff13203-84de-4fd3-8261-e3fa2f6021cd None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:32.140587 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c6d00-5552-41ff-ae5d-30e95baeb0d1 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:32.162236 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90ad86-4761-4930-bac1-77fb1b0f4681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:32.163042 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90ad86-4761-4930-bac1-77fb1b0f4681 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:32.163488 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90ad86-4761-4930-bac1-77fb1b0f4681 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:32.163770 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90ad86-4761-4930-bac1-77fb1b0f4681 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:32.174275 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90ad86-4761-4930-bac1-77fb1b0f4681 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:32.175530 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b1a8d-980c-4944-8a96-b451793305c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:32.176004 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90ad86-4761-4930-bac1-77fb1b0f4681 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:32.176342 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b1a8d-980c-4944-8a96-b451793305c1 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:32.176625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b1a8d-980c-4944-8a96-b451793305c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:32.176902 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b1a8d-980c-4944-8a96-b451793305c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:32.187307 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b1a8d-980c-4944-8a96-b451793305c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:32.189108 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b1a8d-980c-4944-8a96-b451793305c1 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:32.193105 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-ef90ad86-4761-4930-bac1-77fb1b0f4681 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:32.193105 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:32.193105 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:32.193105 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:32.193105 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:32.193105 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:32.193105 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:32.193105 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:32.193105 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:32.193105 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:32.193105 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:32.193105 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:32.193105 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:32.193105 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:32.193105 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:32.193982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:32.193982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:32.193982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:32.193982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:32.193982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:32.193982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:32.193982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:32.193982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:32.193982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:32.193982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:32.193982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:32.193982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:32.193982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:32.193982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:32.193982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:32.193982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:32.193982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:32.194954 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:32.194954 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:32.194954 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:32.194954 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:32.194954 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 289/563] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:32.195702 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37a210-dadf-4ec7-9bfe-47035129a81c None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:32.196310 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37a210-dadf-4ec7-9bfe-47035129a81c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:32.196310 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37a210-dadf-4ec7-9bfe-47035129a81c None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:32.197634 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 290/564] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:32.198227 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37a210-dadf-4ec7-9bfe-47035129a81c None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:32.210801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-cc0b1a8d-980c-4944-8a96-b451793305c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:32.210801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:32.210801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:32.210801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:32.210801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:32.210801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:32.210801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:32.210801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:32.210801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:32.210801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:32.210801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:32.210801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:32.210801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:32.210801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:32.210801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:32.211879 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:32.211879 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:32.211879 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:32.211879 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:32.211879 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:32.211879 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:32.211879 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:32.211879 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:32.211879 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:32.211879 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:32.211879 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:32.211879 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:32.211879 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:32.211879 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:32.211879 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:32.211879 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:32.211879 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:32.212938 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:32.212938 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:32.212938 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:32.212938 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:32.212938 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 275/565] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:32.213631 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe78c8-8e92-4b32-9e3c-bc043fd3fb60 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:32.213734 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe78c8-8e92-4b32-9e3c-bc043fd3fb60 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:32.214067 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe78c8-8e92-4b32-9e3c-bc043fd3fb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:32.226578 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:32.230143 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-5cfe78c8-8e92-4b32-9e3c-bc043fd3fb60 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:32.231376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-5cfe78c8-8e92-4b32-9e3c-bc043fd3fb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:32.293650 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:32.310265 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 276/566] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:32.310265 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe78c8-8e92-4b32-9e3c-bc043fd3fb60 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:32.310514 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37a210-dadf-4ec7-9bfe-47035129a81c None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:32.339402 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3584270-d3da-48bf-a524-dc428e7aa757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:32.340070 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3584270-d3da-48bf-a524-dc428e7aa757 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:32.340354 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3584270-d3da-48bf-a524-dc428e7aa757 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:32.340635 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3584270-d3da-48bf-a524-dc428e7aa757 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:32.341484 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3584270-d3da-48bf-a524-dc428e7aa757 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:32.341797 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3584270-d3da-48bf-a524-dc428e7aa757 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:32.343280 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3584270-d3da-48bf-a524-dc428e7aa757 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:32.360775 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 291/567] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jun 24 10:40:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:32.361978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d53418-5215-42a8-bddb-5aa6f09b2d47 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:32.362255 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d53418-5215-42a8-bddb-5aa6f09b2d47 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:32.362555 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d53418-5215-42a8-bddb-5aa6f09b2d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:32.378424 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-94d53418-5215-42a8-bddb-5aa6f09b2d47 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:32.379624 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-94d53418-5215-42a8-bddb-5aa6f09b2d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:32.408325 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe78c8-8e92-4b32-9e3c-bc043fd3fb60 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:32.442972 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22abdbbf-4110-432d-bbfc-ac83e6821ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:32.443679 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abdbbf-4110-432d-bbfc-ac83e6821ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:32.443964 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abdbbf-4110-432d-bbfc-ac83e6821ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:32.444242 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abdbbf-4110-432d-bbfc-ac83e6821ef2 None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:32.444777 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 292/568] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:32.445026 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22abdbbf-4110-432d-bbfc-ac83e6821ef2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:32.445335 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22abdbbf-4110-432d-bbfc-ac83e6821ef2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:32.445601 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d53418-5215-42a8-bddb-5aa6f09b2d47 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:32.446744 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22abdbbf-4110-432d-bbfc-ac83e6821ef2 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:32.458187 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 277/569] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:32.458961 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22abdbbf-4110-432d-bbfc-ac83e6821ef2 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:32.475748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:32.519884 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:32.562146 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22abdbbf-4110-432d-bbfc-ac83e6821ef2 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:32.565138 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d53418-5215-42a8-bddb-5aa6f09b2d47 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:32.596317 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2216f-4891-4f01-94eb-4c36250c345e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:32.597131 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2216f-4891-4f01-94eb-4c36250c345e None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:32.597412 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2216f-4891-4f01-94eb-4c36250c345e None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:32.597687 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2216f-4891-4f01-94eb-4c36250c345e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:32.602762 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafaf97b-44ce-4567-8b0c-3cd269175e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:32.603465 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafaf97b-44ce-4567-8b0c-3cd269175e04 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:32.603745 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafaf97b-44ce-4567-8b0c-3cd269175e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:32.604021 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafaf97b-44ce-4567-8b0c-3cd269175e04 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:32.604752 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafaf97b-44ce-4567-8b0c-3cd269175e04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:32.605080 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafaf97b-44ce-4567-8b0c-3cd269175e04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:32.606486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafaf97b-44ce-4567-8b0c-3cd269175e04 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:32.608592 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2216f-4891-4f01-94eb-4c36250c345e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:32.616653 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-42a2216f-4891-4f01-94eb-4c36250c345e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:40:32.616653 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:32.616653 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:32.616653 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:32.616653 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:32.616653 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:32.616653 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:32.616653 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:32.616653 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:32.616653 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:32.616653 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:32.616653 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:32.616653 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:32.616653 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:32.616653 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:32.616653 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:32.617874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:32.617874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:32.617874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:32.617874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:32.617874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:32.617874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:32.617874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:32.617874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:32.617874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:32.617874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:32.617874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:32.617874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:32.617874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:32.617874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:32.617874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:32.617874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:32.619057 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:32.619057 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:32.619057 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:32.619057 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:32.619057 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:32.619057 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:32.619057 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:32.619057 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:32.619057 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:32.619057 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:32.619057 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:40:32.619057 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:32.619057 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 278/570] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 10:40:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:32.620242 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2216f-4891-4f01-94eb-4c36250c345e None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:32.627331 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 293/571] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:32.627331 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafaf97b-44ce-4567-8b0c-3cd269175e04 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:32.702805 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:32.725329 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2216f-4891-4f01-94eb-4c36250c345e None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:32.733960 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafaf97b-44ce-4567-8b0c-3cd269175e04 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:32.744042 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:32.761601 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9896785-33d1-4132-8bb7-5193526f5815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:32.762413 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9896785-33d1-4132-8bb7-5193526f5815 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:32.762703 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9896785-33d1-4132-8bb7-5193526f5815 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:32.762983 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9896785-33d1-4132-8bb7-5193526f5815 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:32.767734 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4792e-6b35-43ee-ac21-c6936f1cd89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:32.768539 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4792e-6b35-43ee-ac21-c6936f1cd89a None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:32.768821 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4792e-6b35-43ee-ac21-c6936f1cd89a None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:32.769101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4792e-6b35-43ee-ac21-c6936f1cd89a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:32.773658 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9896785-33d1-4132-8bb7-5193526f5815 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:32.775111 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9896785-33d1-4132-8bb7-5193526f5815 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:32.776030 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c4792e-6b35-43ee-ac21-c6936f1cd89a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:32.777457 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c4792e-6b35-43ee-ac21-c6936f1cd89a None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:32.791659 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-b6c4792e-6b35-43ee-ac21-c6936f1cd89a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:32.791659 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:32.791659 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:32.791659 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:32.791659 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:32.791659 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:32.791659 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:32.791659 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:32.791659 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:32.791659 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:32.791659 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:32.791659 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:32.791659 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:40:32.791659 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:40:32.791659 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:40:32.792731 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:40:32.792731 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:32.792731 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:32.792731 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:32.792731 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:32.792731 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:32.792731 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:32.792731 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:32.792731 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:32.792731 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:32.792731 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:32.792731 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:32.792731 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:32.792731 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:32.792731 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:32.792731 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:32.792731 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:32.793696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:40:32.793696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:40:32.793696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:40:32.793696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:40:32.793696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:40:32.793696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:40:32.793696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:32.793696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:32.794164 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-a9896785-33d1-4132-8bb7-5193526f5815 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:32.794164 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:32.794164 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:32.794164 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:32.794164 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:32.794164 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:32.794164 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:32.794164 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:32.794164 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:32.794164 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:32.794164 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:32.794164 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:32.794164 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:32.794164 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:32.794164 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:32.795208 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:32.795208 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:32.795208 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:32.795208 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:32.795208 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:32.795208 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:32.795208 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:32.795208 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:32.795208 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:32.795208 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:32.795208 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:32.795208 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:32.795208 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:32.795208 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:32.795208 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:32.795208 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:32.795208 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:32.796081 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:32.796081 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:32.796081 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:32.796081 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:32.796310 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 294/572] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:40:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:32.796310 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4792e-6b35-43ee-ac21-c6936f1cd89a None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:32.796557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 279/573] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:32.797491 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9896785-33d1-4132-8bb7-5193526f5815 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:32.897728 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4792e-6b35-43ee-ac21-c6936f1cd89a None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:32.898827 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9896785-33d1-4132-8bb7-5193526f5815 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:32.925448 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:32.932219 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5755e67-3833-4b52-9b3a-f1e42bdf8013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:32.932427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e24530-2338-43ea-b640-fdde822065ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:32.933027 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5755e67-3833-4b52-9b3a-f1e42bdf8013 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:32.933146 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e24530-2338-43ea-b640-fdde822065ce None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:32.933313 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5755e67-3833-4b52-9b3a-f1e42bdf8013 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:32.933403 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e24530-2338-43ea-b640-fdde822065ce None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:32.933588 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5755e67-3833-4b52-9b3a-f1e42bdf8013 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:32.933676 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e24530-2338-43ea-b640-fdde822065ce None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:32.934369 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e24530-2338-43ea-b640-fdde822065ce None admin] RBAC: Adding query filter params (name=service) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:32.934671 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e24530-2338-43ea-b640-fdde822065ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:32.936067 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e24530-2338-43ea-b640-fdde822065ce None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:32.944454 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 280/574] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 10:40:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:32.944621 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5755e67-3833-4b52-9b3a-f1e42bdf8013 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:32.945269 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e24530-2338-43ea-b640-fdde822065ce None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:32.952552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-e5755e67-3833-4b52-9b3a-f1e42bdf8013 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:40:32.952552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:32.952552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:32.952552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:32.952552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:32.952552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:32.952552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:32.952552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:32.952552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:32.952552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:32.952552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:32.952552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:32.952552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:32.952552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:32.952552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:32.952552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:32.953678 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:32.953678 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:32.953678 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:32.953678 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:32.953678 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:32.953678 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:32.953678 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:32.953678 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:32.953678 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:32.953678 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:32.953678 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:32.953678 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:32.953678 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:32.953678 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:32.953678 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:32.953678 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:32.954672 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:32.954672 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:32.954672 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:32.954672 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:32.954672 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:32.954672 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:32.954672 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:32.954672 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:32.954672 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:32.954672 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:32.954672 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:40:32.954672 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:32.954672 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 295/575] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 10:40:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:32.954672 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5755e67-3833-4b52-9b3a-f1e42bdf8013 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:32.981712 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:33.050376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e24530-2338-43ea-b640-fdde822065ce None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:33.055511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5755e67-3833-4b52-9b3a-f1e42bdf8013 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:33.084331 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe3ff8-bbb0-4023-9a01-10a37bd24b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:33.085212 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe3ff8-bbb0-4023-9a01-10a37bd24b62 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:33.085507 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe3ff8-bbb0-4023-9a01-10a37bd24b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:33.085782 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe3ff8-bbb0-4023-9a01-10a37bd24b62 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:33.090211 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5200e2f-eb9d-4a70-9424-935cc8451c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:33.090873 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5200e2f-eb9d-4a70-9424-935cc8451c81 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:33.091172 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5200e2f-eb9d-4a70-9424-935cc8451c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:33.091461 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5200e2f-eb9d-4a70-9424-935cc8451c81 None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:33.092254 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5200e2f-eb9d-4a70-9424-935cc8451c81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:33.092569 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5200e2f-eb9d-4a70-9424-935cc8451c81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:33.093217 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe3ff8-bbb0-4023-9a01-10a37bd24b62 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:33.094005 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5200e2f-eb9d-4a70-9424-935cc8451c81 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:33.094639 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe3ff8-bbb0-4023-9a01-10a37bd24b62 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:33.108750 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-5afe3ff8-bbb0-4023-9a01-10a37bd24b62 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 10:40:33.108750 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:33.108750 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:33.108750 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:33.108750 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:33.108750 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:33.108750 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:33.108750 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:33.108750 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:33.108750 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:33.108750 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:33.108750 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:33.108750 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:40:33.108750 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:40:33.108750 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:40:33.108750 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:40:33.109914 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:33.109914 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:33.109914 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:40:33.109914 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:33.109914 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:40:33.109914 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:33.109914 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:33.109914 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:33.109914 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:33.109914 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:33.109914 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:33.109914 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:33.109914 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:33.109914 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:33.109914 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:33.109914 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:33.109914 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:33.109914 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:33.111279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:33.111279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:33.111279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:40:33.111279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:40:33.111279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:40:33.111279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:40:33.111279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:40:33.111279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:40:33.111279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 10:40:33.111279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:33.111279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 281/576] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:40:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:33.111279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe3ff8-bbb0-4023-9a01-10a37bd24b62 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:33.115238 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 296/577] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:40:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:33.116062 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5200e2f-eb9d-4a70-9424-935cc8451c81 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:33.167853 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:33.204173 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:33.213449 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe3ff8-bbb0-4023-9a01-10a37bd24b62 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:33.217430 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5200e2f-eb9d-4a70-9424-935cc8451c81 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:33.246926 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952e1cd-8ee5-4c0c-b56b-d8a782454b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:33.247614 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952e1cd-8ee5-4c0c-b56b-d8a782454b74 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:33.247893 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952e1cd-8ee5-4c0c-b56b-d8a782454b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:33.248170 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952e1cd-8ee5-4c0c-b56b-d8a782454b74 None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:33.248919 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952e1cd-8ee5-4c0c-b56b-d8a782454b74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:33.249226 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952e1cd-8ee5-4c0c-b56b-d8a782454b74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:33.250606 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952e1cd-8ee5-4c0c-b56b-d8a782454b74 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:33.250926 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c459772-bd4a-4a65-b503-4636c8538300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:33.251747 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c459772-bd4a-4a65-b503-4636c8538300 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:33.252030 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c459772-bd4a-4a65-b503-4636c8538300 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:33.252302 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c459772-bd4a-4a65-b503-4636c8538300 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:33.262059 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c459772-bd4a-4a65-b503-4636c8538300 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:33.262553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 282/578] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:33.263262 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952e1cd-8ee5-4c0c-b56b-d8a782454b74 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:33.263526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c459772-bd4a-4a65-b503-4636c8538300 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:33.284169 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-8c459772-bd4a-4a65-b503-4636c8538300 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:33.284169 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:33.284169 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:33.284169 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:33.284169 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:33.284169 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:33.284169 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:33.284169 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:33.284169 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:33.284169 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:33.284169 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:33.284169 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:33.284169 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:33.284169 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:33.284169 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:33.285101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:33.285101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:33.285101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:33.285101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:33.285101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:33.285101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:33.285101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:33.285101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:33.285101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:33.285101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:33.285101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:33.285101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:33.285101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:33.285101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:33.285101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:33.285101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:33.285101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:33.285999 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:33.285999 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:33.285999 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:33.285999 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:33.285999 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 297/579] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:33.286271 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c459772-bd4a-4a65-b503-4636c8538300 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:33.369195 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952e1cd-8ee5-4c0c-b56b-d8a782454b74 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:33.385271 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c459772-bd4a-4a65-b503-4636c8538300 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:33.386762 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:33.404441 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a833d9-96d6-4c1e-af84-1b4de3b6f8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:33.405117 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a833d9-96d6-4c1e-af84-1b4de3b6f8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:33.405400 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a833d9-96d6-4c1e-af84-1b4de3b6f8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:33.405676 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a833d9-96d6-4c1e-af84-1b4de3b6f8c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:33.406423 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a833d9-96d6-4c1e-af84-1b4de3b6f8c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:33.406728 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a833d9-96d6-4c1e-af84-1b4de3b6f8c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:33.408142 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a833d9-96d6-4c1e-af84-1b4de3b6f8c2 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:33.416166 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 283/580] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 10:40:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:33.416955 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a833d9-96d6-4c1e-af84-1b4de3b6f8c2 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:33.418875 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79df19-795c-4473-a169-244deb740436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:33.419529 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79df19-795c-4473-a169-244deb740436 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:33.419812 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79df19-795c-4473-a169-244deb740436 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:33.420089 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79df19-795c-4473-a169-244deb740436 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:33.420934 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79df19-795c-4473-a169-244deb740436 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:33.421244 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79df19-795c-4473-a169-244deb740436 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:33.422683 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79df19-795c-4473-a169-244deb740436 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:33.432863 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:33.440955 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 298/581] 10.222.0.16 () {56 vars in 1137 bytes} [Fri Jun 24 10:40:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:33.441781 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79df19-795c-4473-a169-244deb740436 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:33.526582 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a833d9-96d6-4c1e-af84-1b4de3b6f8c2 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:33.554921 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79df19-795c-4473-a169-244deb740436 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:33.561379 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73ec92-0257-4b9c-9772-d645180012c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:33.562043 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73ec92-0257-4b9c-9772-d645180012c4 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:33.562329 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73ec92-0257-4b9c-9772-d645180012c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:33.562607 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73ec92-0257-4b9c-9772-d645180012c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:33.563841 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73ec92-0257-4b9c-9772-d645180012c4 None admin] RBAC: Adding query filter params (role.id=7bab53c1ac3d4e04b18c87286e2ab0aa, scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user.id=ff592d9ebd4241019625828ddd41aee8) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:33.564149 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73ec92-0257-4b9c-9772-d645180012c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:33.565608 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73ec92-0257-4b9c-9772-d645180012c4 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:33.571470 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 284/582] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:40:33 2022] GET /identity/v3/role_assignments?user.id=ff592d9ebd4241019625828ddd41aee8&scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e&role.id=7bab53c1ac3d4e04b18c87286e2ab0aa => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:33.572246 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73ec92-0257-4b9c-9772-d645180012c4 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:33.595238 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed20361-f008-427c-8b60-60a257826341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:33.596095 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed20361-f008-427c-8b60-60a257826341 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:33.596378 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed20361-f008-427c-8b60-60a257826341 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:33.597236 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed20361-f008-427c-8b60-60a257826341 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:33.608064 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed20361-f008-427c-8b60-60a257826341 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:33.609547 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed20361-f008-427c-8b60-60a257826341 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:33.630765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-fed20361-f008-427c-8b60-60a257826341 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:33.630765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:33.630765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:33.630765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:33.630765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:33.630765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:33.630765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:33.630765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:33.630765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:33.630765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:33.630765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:33.630765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:33.630765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:40:33.630765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:40:33.630765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:40:33.631887 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:40:33.631887 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:33.631887 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:33.631887 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:33.631887 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:33.631887 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:33.631887 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:33.631887 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:33.631887 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:33.631887 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:33.631887 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:33.631887 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:33.631887 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:33.631887 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:33.631887 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:33.631887 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:33.631887 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:33.632773 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:40:33.632773 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:40:33.632773 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:40:33.632773 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:40:33.632773 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:40:33.632773 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:40:33.632773 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:33.632773 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:33.632773 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 299/583] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:40:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:33.633278 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed20361-f008-427c-8b60-60a257826341 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:33.663478 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:33.670968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:33.698328 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73ec92-0257-4b9c-9772-d645180012c4 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:33.739761 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce046c5-53ea-43da-9e18-d017364460c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:33.740439 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce046c5-53ea-43da-9e18-d017364460c7 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:33.740724 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce046c5-53ea-43da-9e18-d017364460c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:33.740996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce046c5-53ea-43da-9e18-d017364460c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:33.741912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce046c5-53ea-43da-9e18-d017364460c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:33.742300 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce046c5-53ea-43da-9e18-d017364460c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:33.743830 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce046c5-53ea-43da-9e18-d017364460c7 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:33.760757 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed20361-f008-427c-8b60-60a257826341 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:33.760944 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 285/584] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:33.760944 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce046c5-53ea-43da-9e18-d017364460c7 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:33.796354 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb5d5d-32b7-46d1-9374-f41c1b657165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:33.797160 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb5d5d-32b7-46d1-9374-f41c1b657165 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:33.797443 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb5d5d-32b7-46d1-9374-f41c1b657165 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:33.797719 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb5d5d-32b7-46d1-9374-f41c1b657165 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:33.808925 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb5d5d-32b7-46d1-9374-f41c1b657165 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:33.810379 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb5d5d-32b7-46d1-9374-f41c1b657165 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:33.828626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-7ecb5d5d-32b7-46d1-9374-f41c1b657165 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:33.828626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:33.828626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:33.828626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:33.828626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:33.828626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:33.828626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:33.828626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:33.828626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:33.828626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:33.828626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:33.828626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:33.828626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:33.828626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:33.828626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:33.829592 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:33.829592 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:33.829592 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:33.829592 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:33.829592 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:33.829592 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:33.829592 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:33.829592 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:33.829592 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:33.829592 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:33.829592 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:33.829592 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:33.829592 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:33.829592 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:33.829592 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:33.829592 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:33.829592 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:33.830482 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:33.830482 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:33.830482 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:33.830482 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:33.830482 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 300/585] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:33.830774 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb5d5d-32b7-46d1-9374-f41c1b657165 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:33.871460 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce046c5-53ea-43da-9e18-d017364460c7 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:33.909201 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b2789-6c32-41e7-b2ee-7c57376d4620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:33.910490 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b2789-6c32-41e7-b2ee-7c57376d4620 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:33.910904 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b2789-6c32-41e7-b2ee-7c57376d4620 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:33.911215 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b2789-6c32-41e7-b2ee-7c57376d4620 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:33.918983 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:33.920610 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:33.923623 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b2789-6c32-41e7-b2ee-7c57376d4620 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:33.925805 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b2789-6c32-41e7-b2ee-7c57376d4620 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:33.948731 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-4c3b2789-6c32-41e7-b2ee-7c57376d4620 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:33.948731 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:33.948731 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:33.948731 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:33.948731 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:33.948731 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:33.948731 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:33.948731 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:33.948731 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:33.948731 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:33.948731 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:33.948731 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:33.948731 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:33.948731 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:33.948731 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:33.949684 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:33.949684 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:33.949684 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:33.949684 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:33.949684 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:33.949684 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:33.949684 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:33.949684 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:33.949684 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:33.949684 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:33.949684 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:33.949684 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:33.949684 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:33.949684 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:33.949684 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:33.949684 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:33.949684 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:33.950574 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:33.950574 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:33.950574 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:33.950574 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:33.954605 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 286/586] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:33.955726 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b2789-6c32-41e7-b2ee-7c57376d4620 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:33.958567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb5d5d-32b7-46d1-9374-f41c1b657165 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:33.995269 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc257b8d-cd19-47e1-9b3d-22dd155a57d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:33.995937 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc257b8d-cd19-47e1-9b3d-22dd155a57d4 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:33.996219 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc257b8d-cd19-47e1-9b3d-22dd155a57d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:33.996495 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc257b8d-cd19-47e1-9b3d-22dd155a57d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:33.997288 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc257b8d-cd19-47e1-9b3d-22dd155a57d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:33.997593 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc257b8d-cd19-47e1-9b3d-22dd155a57d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:33.999040 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc257b8d-cd19-47e1-9b3d-22dd155a57d4 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:34.016734 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 301/587] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:40:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:34.016734 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc257b8d-cd19-47e1-9b3d-22dd155a57d4 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:34.067398 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b2789-6c32-41e7-b2ee-7c57376d4620 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:34.103162 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77097cda-25e6-43a9-80f5-bd269eb947b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:34.104021 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77097cda-25e6-43a9-80f5-bd269eb947b0 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:34.104304 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77097cda-25e6-43a9-80f5-bd269eb947b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:34.104584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77097cda-25e6-43a9-80f5-bd269eb947b0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:34.112251 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77097cda-25e6-43a9-80f5-bd269eb947b0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:34.113719 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77097cda-25e6-43a9-80f5-bd269eb947b0 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:34.121783 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc257b8d-cd19-47e1-9b3d-22dd155a57d4 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:34.129024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-77097cda-25e6-43a9-80f5-bd269eb947b0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 10:40:34.129024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:34.129024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:34.129024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:34.129024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:34.129024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:34.129024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:34.129024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:34.129024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:34.129024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:34.129024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:34.129024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:34.129024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:40:34.129024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:40:34.129024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:40:34.129024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:40:34.129948 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:34.129948 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:34.129948 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:40:34.129948 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:34.129948 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:40:34.129948 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:34.129948 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:34.129948 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:34.129948 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:34.129948 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:34.129948 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:34.129948 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:34.129948 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:34.129948 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:34.129948 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:34.129948 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:34.129948 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:34.129948 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:34.130858 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:34.130858 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:34.130858 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:40:34.130858 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:40:34.130858 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:40:34.130858 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:40:34.130858 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:40:34.130858 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:40:34.130858 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 10:40:34.130858 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:34.130858 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 287/588] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:40:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:34.131601 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77097cda-25e6-43a9-80f5-bd269eb947b0 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:34.160528 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:34.166572 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7b2f5-e699-4cbe-a656-627a197c49e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:34.167366 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7b2f5-e699-4cbe-a656-627a197c49e7 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:34.167723 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7b2f5-e699-4cbe-a656-627a197c49e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:34.168072 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7b2f5-e699-4cbe-a656-627a197c49e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:34.169728 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7b2f5-e699-4cbe-a656-627a197c49e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:34.169728 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7b2f5-e699-4cbe-a656-627a197c49e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:34.170851 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7b2f5-e699-4cbe-a656-627a197c49e7 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:34.187581 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 302/589] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:34.187581 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7b2f5-e699-4cbe-a656-627a197c49e7 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:34.190985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:34.245365 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77097cda-25e6-43a9-80f5-bd269eb947b0 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:34.282105 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f344d-defb-4702-a412-592560083c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:34.282784 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f344d-defb-4702-a412-592560083c7f None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:34.283071 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f344d-defb-4702-a412-592560083c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:34.283406 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f344d-defb-4702-a412-592560083c7f None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:34.284108 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f344d-defb-4702-a412-592560083c7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:34.284561 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f344d-defb-4702-a412-592560083c7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:34.285810 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f344d-defb-4702-a412-592560083c7f None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:34.297650 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 288/590] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:34.298300 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f344d-defb-4702-a412-592560083c7f None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:34.308037 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7b2f5-e699-4cbe-a656-627a197c49e7 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:34.345496 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66314bfe-2cdd-4476-802d-724358bbb72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:34.346405 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66314bfe-2cdd-4476-802d-724358bbb72f None admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:34.346688 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66314bfe-2cdd-4476-802d-724358bbb72f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:34.346967 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66314bfe-2cdd-4476-802d-724358bbb72f None admin] PATH_INFO: `/v3/projects/61b2f5f9674c4fd3a1ec5db2f3b4b26e/users/e8034bad51144002a7386c975e412992/roles/7bab53c1ac3d4e04b18c87286e2ab0aa` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:34.361741 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66314bfe-2cdd-4476-802d-724358bbb72f None admin] RBAC: Authorizing `identity:create_grant(project_id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user_id=e8034bad51144002a7386c975e412992, role_id=7bab53c1ac3d4e04b18c87286e2ab0aa)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:34.363237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66314bfe-2cdd-4476-802d-724358bbb72f None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:34.387180 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 303/591] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 10:40:34 2022] PUT /identity/v3/projects/61b2f5f9674c4fd3a1ec5db2f3b4b26e/users/e8034bad51144002a7386c975e412992/roles/7bab53c1ac3d4e04b18c87286e2ab0aa => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:40:34.387180 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66314bfe-2cdd-4476-802d-724358bbb72f None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:34.415717 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f344d-defb-4702-a412-592560083c7f None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:34.428490 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:34.434506 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:34.460606 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79269e41-49d0-4357-8b44-c030a14cbf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:34.461369 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79269e41-49d0-4357-8b44-c030a14cbf80 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:34.461748 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79269e41-49d0-4357-8b44-c030a14cbf80 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:34.462124 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79269e41-49d0-4357-8b44-c030a14cbf80 None admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:34.463100 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79269e41-49d0-4357-8b44-c030a14cbf80 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:34.463650 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79269e41-49d0-4357-8b44-c030a14cbf80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:34.465349 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79269e41-49d0-4357-8b44-c030a14cbf80 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:34.486524 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 289/592] 10.222.0.16 () {56 vars in 1137 bytes} [Fri Jun 24 10:40:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:34.487767 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79269e41-49d0-4357-8b44-c030a14cbf80 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:34.507970 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66314bfe-2cdd-4476-802d-724358bbb72f None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:34.547962 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbde9bd-88cc-48be-bdd6-f7c0510f0ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:34.548794 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbde9bd-88cc-48be-bdd6-f7c0510f0ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:34.549078 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbde9bd-88cc-48be-bdd6-f7c0510f0ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:34.549361 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbde9bd-88cc-48be-bdd6-f7c0510f0ad6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:34.557624 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbde9bd-88cc-48be-bdd6-f7c0510f0ad6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:34.559083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbde9bd-88cc-48be-bdd6-f7c0510f0ad6 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:34.575748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-9cbde9bd-88cc-48be-bdd6-f7c0510f0ad6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 10:40:34.575748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:34.575748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:34.575748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:34.575748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:34.575748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:34.575748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:34.575748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:34.575748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:34.575748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:34.575748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:34.575748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:34.575748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:40:34.575748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:40:34.575748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:40:34.575748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:40:34.576863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:34.576863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:34.576863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:40:34.576863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:34.576863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:40:34.576863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:34.576863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:34.576863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:34.576863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:34.576863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:34.576863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:34.576863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:34.576863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:34.576863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:34.576863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:34.576863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:34.576863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:34.576863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:34.577989 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:34.577989 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:34.577989 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:40:34.577989 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:40:34.577989 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:40:34.577989 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:40:34.577989 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:40:34.577989 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:40:34.577989 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 10:40:34.577989 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:34.577989 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 304/593] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 10:40:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:34.581834 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbde9bd-88cc-48be-bdd6-f7c0510f0ad6 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:34.638649 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79269e41-49d0-4357-8b44-c030a14cbf80 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:34.694847 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234b37e-7117-4715-8e00-74b5d108cba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:34.695926 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234b37e-7117-4715-8e00-74b5d108cba9 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:34.696229 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234b37e-7117-4715-8e00-74b5d108cba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:34.696508 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234b37e-7117-4715-8e00-74b5d108cba9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:34.705706 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234b37e-7117-4715-8e00-74b5d108cba9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:34.707917 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234b37e-7117-4715-8e00-74b5d108cba9 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:34.717382 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbde9bd-88cc-48be-bdd6-f7c0510f0ad6 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:34.719123 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:34.726213 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-e234b37e-7117-4715-8e00-74b5d108cba9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:34.726213 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:34.726213 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:34.726213 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:34.726213 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:34.726213 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:34.726213 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:34.726213 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:34.726213 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:34.726213 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:34.726213 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:34.726213 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:34.726213 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:40:34.726213 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:40:34.726213 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:40:34.727312 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:40:34.727312 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:34.727312 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:34.727312 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:34.727312 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:34.727312 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:34.727312 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:34.727312 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:34.727312 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:34.727312 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:34.727312 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:34.727312 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:34.727312 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:34.727312 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:34.727312 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:34.727312 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:34.727312 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:34.728377 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:40:34.728377 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:40:34.728377 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:40:34.728377 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:40:34.728377 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:40:34.728377 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:40:34.728377 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:34.728377 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:34.730313 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 290/594] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:40:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:34.730313 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234b37e-7117-4715-8e00-74b5d108cba9 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:34.763472 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab5a87-a432-4a43-a910-a5a19c1ea1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:34.764284 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab5a87-a432-4a43-a910-a5a19c1ea1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:34.764567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab5a87-a432-4a43-a910-a5a19c1ea1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:34.764942 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab5a87-a432-4a43-a910-a5a19c1ea1c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:34.765653 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:34.778044 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab5a87-a432-4a43-a910-a5a19c1ea1c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:34.779729 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab5a87-a432-4a43-a910-a5a19c1ea1c0 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:34.798993 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-44ab5a87-a432-4a43-a910-a5a19c1ea1c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:34.798993 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:34.798993 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:34.798993 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:34.798993 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:34.798993 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:34.798993 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:34.798993 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:34.798993 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:34.798993 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:34.798993 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:34.798993 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:34.798993 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:34.798993 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:34.798993 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:34.800109 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:34.800109 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:34.800109 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:34.800109 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:34.800109 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:34.800109 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:34.800109 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:34.800109 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:34.800109 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:34.800109 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:34.800109 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:34.800109 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:34.800109 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:34.800109 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:34.800109 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:34.800109 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:34.800109 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:34.801090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:34.801090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:34.801090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:34.801090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:34.801090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 305/595] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:34.805594 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab5a87-a432-4a43-a910-a5a19c1ea1c0 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:34.845049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234b37e-7117-4715-8e00-74b5d108cba9 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:34.878935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677ba76-f054-4109-9816-26999764501f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:34.879673 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677ba76-f054-4109-9816-26999764501f None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:34.879959 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677ba76-f054-4109-9816-26999764501f None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:34.880241 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677ba76-f054-4109-9816-26999764501f None admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:34.881092 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677ba76-f054-4109-9816-26999764501f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:34.881406 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677ba76-f054-4109-9816-26999764501f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:34.882909 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677ba76-f054-4109-9816-26999764501f None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:34.905169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 291/596] 10.222.0.16 () {56 vars in 1139 bytes} [Fri Jun 24 10:40:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:34.906114 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677ba76-f054-4109-9816-26999764501f None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:34.914084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab5a87-a432-4a43-a910-a5a19c1ea1c0 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:34.952548 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f49bb4-f7e9-4b34-9268-ea6613523380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:34.953220 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f49bb4-f7e9-4b34-9268-ea6613523380 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:34.953550 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f49bb4-f7e9-4b34-9268-ea6613523380 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:34.953835 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f49bb4-f7e9-4b34-9268-ea6613523380 None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:34.954734 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f49bb4-f7e9-4b34-9268-ea6613523380 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:34.955049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f49bb4-f7e9-4b34-9268-ea6613523380 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:34.956700 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f49bb4-f7e9-4b34-9268-ea6613523380 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:34.970592 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 306/597] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:40:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:34.971603 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f49bb4-f7e9-4b34-9268-ea6613523380 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:34.990994 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:34.994474 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:35.010785 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677ba76-f054-4109-9816-26999764501f None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:35.046474 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26549f-507c-428f-a6ac-6f2d345fbb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:35.047292 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26549f-507c-428f-a6ac-6f2d345fbb7c None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:35.047647 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26549f-507c-428f-a6ac-6f2d345fbb7c None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:35.048144 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26549f-507c-428f-a6ac-6f2d345fbb7c None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:35.048964 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26549f-507c-428f-a6ac-6f2d345fbb7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:35.049804 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26549f-507c-428f-a6ac-6f2d345fbb7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:35.051573 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26549f-507c-428f-a6ac-6f2d345fbb7c None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:35.067231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 292/598] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:35.068267 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26549f-507c-428f-a6ac-6f2d345fbb7c None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:35.097685 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f49bb4-f7e9-4b34-9268-ea6613523380 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:35.144987 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3e668-199a-4b40-8f07-1a8c4bb90638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:35.146326 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3e668-199a-4b40-8f07-1a8c4bb90638 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:35.146789 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3e668-199a-4b40-8f07-1a8c4bb90638 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:35.147519 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3e668-199a-4b40-8f07-1a8c4bb90638 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:35.162301 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3e668-199a-4b40-8f07-1a8c4bb90638 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:35.164731 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3e668-199a-4b40-8f07-1a8c4bb90638 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:35.180367 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26549f-507c-428f-a6ac-6f2d345fbb7c None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:35.187666 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-12e3e668-199a-4b40-8f07-1a8c4bb90638 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:35.187666 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:35.187666 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:35.187666 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:35.187666 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:35.187666 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:35.187666 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:35.187666 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:35.187666 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:35.187666 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:35.187666 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:35.187666 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:35.187666 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:35.187666 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:35.187666 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:35.189097 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:35.189097 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:35.189097 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:35.189097 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:35.189097 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:35.189097 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:35.189097 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:35.189097 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:35.189097 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:35.189097 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:35.189097 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:35.189097 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:35.189097 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:35.189097 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:35.189097 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:35.189097 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:35.189097 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:35.190202 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:35.190202 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:35.190202 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:35.190202 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:35.191066 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 307/599] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:35.195867 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3e668-199a-4b40-8f07-1a8c4bb90638 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:35.230880 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be45c24-7dfa-4d4a-9945-5e05d02c7b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:35.232334 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be45c24-7dfa-4d4a-9945-5e05d02c7b85 None admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:35.233633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be45c24-7dfa-4d4a-9945-5e05d02c7b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:35.234064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be45c24-7dfa-4d4a-9945-5e05d02c7b85 None admin] PATH_INFO: `/v3/projects/61b2f5f9674c4fd3a1ec5db2f3b4b26e/users/b2f6668cb6244bba9e547ff95b2e6f46/roles/7bab53c1ac3d4e04b18c87286e2ab0aa` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:35.253317 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be45c24-7dfa-4d4a-9945-5e05d02c7b85 None admin] RBAC: Authorizing `identity:create_grant(project_id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user_id=b2f6668cb6244bba9e547ff95b2e6f46, role_id=7bab53c1ac3d4e04b18c87286e2ab0aa)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:35.255931 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be45c24-7dfa-4d4a-9945-5e05d02c7b85 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:35.260165 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:35.274374 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:35.276875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 293/600] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 10:40:35 2022] PUT /identity/v3/projects/61b2f5f9674c4fd3a1ec5db2f3b4b26e/users/b2f6668cb6244bba9e547ff95b2e6f46/roles/7bab53c1ac3d4e04b18c87286e2ab0aa => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:40:35.277951 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be45c24-7dfa-4d4a-9945-5e05d02c7b85 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:35.320679 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3e668-199a-4b40-8f07-1a8c4bb90638 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:35.360990 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfd398-4175-447e-b701-cd2bdabc6bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:35.361963 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfd398-4175-447e-b701-cd2bdabc6bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:35.362353 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfd398-4175-447e-b701-cd2bdabc6bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:35.362801 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfd398-4175-447e-b701-cd2bdabc6bd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:35.371446 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bfd398-4175-447e-b701-cd2bdabc6bd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:35.373310 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bfd398-4175-447e-b701-cd2bdabc6bd3 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:35.389845 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-85bfd398-4175-447e-b701-cd2bdabc6bd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:35.389845 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:35.389845 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:35.389845 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:35.389845 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:35.389845 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:35.389845 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:35.389845 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:35.389845 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:35.389845 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:35.389845 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:35.389845 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:35.389845 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:40:35.389845 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:40:35.389845 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:40:35.391470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:40:35.391470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:35.391470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:35.391470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:35.391470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:35.391470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:35.391470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:35.391470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:35.391470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:35.391470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:35.391470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:35.391470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:35.391470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:35.391470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:35.391470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:35.391470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:35.391470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:35.392595 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:40:35.392595 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:40:35.392595 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:40:35.392595 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:40:35.392595 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:40:35.392595 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:40:35.392595 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:35.392595 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:35.394301 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 308/601] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:40:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:35.399927 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfd398-4175-447e-b701-cd2bdabc6bd3 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:35.408424 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be45c24-7dfa-4d4a-9945-5e05d02c7b85 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:35.454892 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13280e-9209-4a6d-a232-a79add74683d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:35.456142 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13280e-9209-4a6d-a232-a79add74683d None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:35.456605 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13280e-9209-4a6d-a232-a79add74683d None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:35.457449 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13280e-9209-4a6d-a232-a79add74683d None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:35.458658 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a13280e-9209-4a6d-a232-a79add74683d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:35.459201 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a13280e-9209-4a6d-a232-a79add74683d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:35.461315 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a13280e-9209-4a6d-a232-a79add74683d None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:35.477416 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 294/602] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:35.483378 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13280e-9209-4a6d-a232-a79add74683d None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:35.546830 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfd398-4175-447e-b701-cd2bdabc6bd3 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:35.580125 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:35.594693 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f0963-a4c5-44f9-ba4f-621adc935e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:35.595809 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f0963-a4c5-44f9-ba4f-621adc935e00 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:35.596273 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f0963-a4c5-44f9-ba4f-621adc935e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:35.596733 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f0963-a4c5-44f9-ba4f-621adc935e00 None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:35.597591 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f0963-a4c5-44f9-ba4f-621adc935e00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:35.597911 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f0963-a4c5-44f9-ba4f-621adc935e00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:35.599391 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f0963-a4c5-44f9-ba4f-621adc935e00 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:35.619633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:35.624701 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 309/603] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:40:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:40:35.631261 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f0963-a4c5-44f9-ba4f-621adc935e00 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:35.637210 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13280e-9209-4a6d-a232-a79add74683d None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:35.686202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd6602-91b3-42fb-9f33-3738a4384d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:35.687944 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd6602-91b3-42fb-9f33-3738a4384d69 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:35.688762 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd6602-91b3-42fb-9f33-3738a4384d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:35.689237 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd6602-91b3-42fb-9f33-3738a4384d69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:35.699656 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd6602-91b3-42fb-9f33-3738a4384d69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:35.702186 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd6602-91b3-42fb-9f33-3738a4384d69 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:35.721234 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-55bd6602-91b3-42fb-9f33-3738a4384d69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:35.721234 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:35.721234 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:35.721234 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:35.721234 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:35.721234 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:35.721234 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:35.721234 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:35.721234 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:35.721234 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:35.721234 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:35.721234 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:35.721234 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:40:35.721234 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:40:35.721234 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:40:35.722202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:40:35.722202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:35.722202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:35.722202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:35.722202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:35.722202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:35.722202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:35.722202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:35.722202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:35.722202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:35.722202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:35.722202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:35.722202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:35.722202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:35.722202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:35.722202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:35.722202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:35.723072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:40:35.723072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:40:35.723072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:40:35.723072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:40:35.723072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:40:35.723072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:40:35.723072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:35.723072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:35.726315 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 295/604] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:40:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:35.728507 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd909794-5270-4cfc-a69e-6735bf6a1ab4 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:35.728984 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd909794-5270-4cfc-a69e-6735bf6a1ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:35.729455 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd909794-5270-4cfc-a69e-6735bf6a1ab4 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:35.731781 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 296/605] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:35.732956 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd909794-5270-4cfc-a69e-6735bf6a1ab4 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:35.744409 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f0963-a4c5-44f9-ba4f-621adc935e00 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:35.783629 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0322e1a-e0b9-4e8a-813d-de4fc00d6772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:35.784603 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0322e1a-e0b9-4e8a-813d-de4fc00d6772 None admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:35.784972 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0322e1a-e0b9-4e8a-813d-de4fc00d6772 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:35.785212 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0322e1a-e0b9-4e8a-813d-de4fc00d6772 None admin] PATH_INFO: `/v3/projects/61b2f5f9674c4fd3a1ec5db2f3b4b26e/users/fcba737e66244fe2b5b6ec3dd17dabd3/roles/7bab53c1ac3d4e04b18c87286e2ab0aa` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:35.801234 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0322e1a-e0b9-4e8a-813d-de4fc00d6772 None admin] RBAC: Authorizing `identity:create_grant(project_id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user_id=fcba737e66244fe2b5b6ec3dd17dabd3, role_id=7bab53c1ac3d4e04b18c87286e2ab0aa)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:35.802697 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0322e1a-e0b9-4e8a-813d-de4fc00d6772 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:35.824293 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 310/606] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 10:40:35 2022] PUT /identity/v3/projects/61b2f5f9674c4fd3a1ec5db2f3b4b26e/users/fcba737e66244fe2b5b6ec3dd17dabd3/roles/7bab53c1ac3d4e04b18c87286e2ab0aa => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:40:35.826023 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd88f6-c6b8-4471-b5e2-160b5adbb1bb None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:35.826944 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd88f6-c6b8-4471-b5e2-160b5adbb1bb None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:35.827301 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd88f6-c6b8-4471-b5e2-160b5adbb1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:35.851364 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-11bd88f6-c6b8-4471-b5e2-160b5adbb1bb None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:35.854440 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-11bd88f6-c6b8-4471-b5e2-160b5adbb1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:35.875317 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd909794-5270-4cfc-a69e-6735bf6a1ab4 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:35.885327 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:35.897614 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:35.918486 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e12090-5c86-402a-9d4a-bdecdfb03cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:35.919650 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e12090-5c86-402a-9d4a-bdecdfb03cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:35.920180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e12090-5c86-402a-9d4a-bdecdfb03cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:35.920693 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e12090-5c86-402a-9d4a-bdecdfb03cd4 None admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:35.921698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e12090-5c86-402a-9d4a-bdecdfb03cd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:35.922309 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e12090-5c86-402a-9d4a-bdecdfb03cd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:35.924096 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e12090-5c86-402a-9d4a-bdecdfb03cd4 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:35.929097 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 311/607] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:35.940055 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 297/608] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:40:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:35.948784 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd88f6-c6b8-4471-b5e2-160b5adbb1bb None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:35.962750 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e12090-5c86-402a-9d4a-bdecdfb03cd4 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:36.057824 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd88f6-c6b8-4471-b5e2-160b5adbb1bb None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:36.101410 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c6b42-833c-4250-969a-3a5f3738b440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:36.102333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c6b42-833c-4250-969a-3a5f3738b440 None admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:36.102620 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c6b42-833c-4250-969a-3a5f3738b440 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:36.102894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c6b42-833c-4250-969a-3a5f3738b440 None admin] PATH_INFO: `/v3/projects/61b2f5f9674c4fd3a1ec5db2f3b4b26e/users/9c20321abda7406c843b4ee691da2106/roles/7bab53c1ac3d4e04b18c87286e2ab0aa` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:36.134861 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c6b42-833c-4250-969a-3a5f3738b440 None admin] RBAC: Authorizing `identity:create_grant(project_id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user_id=9c20321abda7406c843b4ee691da2106, role_id=7bab53c1ac3d4e04b18c87286e2ab0aa)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:36.137520 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c6b42-833c-4250-969a-3a5f3738b440 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:36.156961 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e12090-5c86-402a-9d4a-bdecdfb03cd4 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:36.158797 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 312/609] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 10:40:35 2022] PUT /identity/v3/projects/61b2f5f9674c4fd3a1ec5db2f3b4b26e/users/9c20321abda7406c843b4ee691da2106/roles/7bab53c1ac3d4e04b18c87286e2ab0aa => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:40:36.202271 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75b484-2d5b-456d-9f60-9bf360f4523d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:36.203314 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75b484-2d5b-456d-9f60-9bf360f4523d None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:36.203600 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75b484-2d5b-456d-9f60-9bf360f4523d None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:36.203874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75b484-2d5b-456d-9f60-9bf360f4523d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:36.217529 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75b484-2d5b-456d-9f60-9bf360f4523d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:36.225875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-7c75b484-2d5b-456d-9f60-9bf360f4523d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:40:36.225875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:36.225875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:36.225875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:36.225875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:36.225875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:36.225875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:36.225875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:36.225875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:36.225875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:36.225875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:36.225875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:36.225875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:36.225875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:36.225875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:36.225875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:36.226911 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:36.226911 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:36.226911 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:36.226911 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:36.226911 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:36.226911 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:36.226911 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:36.226911 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:36.226911 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:36.226911 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:36.226911 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:36.226911 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:36.226911 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:36.226911 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:36.226911 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:36.226911 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:36.228263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:36.228263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:36.228263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:36.228263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:36.228263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:36.228263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:36.228263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:36.228263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:36.228263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:36.228263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:36.228263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:40:36.228263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:36.228263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 298/610] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 10:40:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:36.234061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c6b42-833c-4250-969a-3a5f3738b440 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:36.260547 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:36.344462 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c6b42-833c-4250-969a-3a5f3738b440 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:36.397720 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d0da0-a4d3-44ee-9160-2f56481c7dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:36.398498 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d0da0-a4d3-44ee-9160-2f56481c7dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:36.398693 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d0da0-a4d3-44ee-9160-2f56481c7dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:36.398975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d0da0-a4d3-44ee-9160-2f56481c7dc7 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:36.399765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d0da0-a4d3-44ee-9160-2f56481c7dc7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:36.400075 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d0da0-a4d3-44ee-9160-2f56481c7dc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:36.401457 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d0da0-a4d3-44ee-9160-2f56481c7dc7 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:36.410709 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 313/611] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 10:40:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:36.416094 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75b484-2d5b-456d-9f60-9bf360f4523d None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:36.458750 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:36.528322 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75b484-2d5b-456d-9f60-9bf360f4523d None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:36.562846 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5986f-1d6c-49fe-89f2-14c0676362ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:36.564055 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5986f-1d6c-49fe-89f2-14c0676362ed None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:36.564339 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5986f-1d6c-49fe-89f2-14c0676362ed None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:36.564612 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5986f-1d6c-49fe-89f2-14c0676362ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:36.576077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5986f-1d6c-49fe-89f2-14c0676362ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:36.577539 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5986f-1d6c-49fe-89f2-14c0676362ed None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:36.595508 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-3fa5986f-1d6c-49fe-89f2-14c0676362ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:36.595508 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:36.595508 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:36.595508 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:36.595508 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:36.595508 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:36.595508 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:36.595508 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:36.595508 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:36.595508 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:36.595508 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:36.595508 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:36.595508 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:36.595508 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:36.595508 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:36.596415 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:36.596415 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:36.596415 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:36.596415 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:36.596415 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:36.596415 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:36.596415 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:36.596415 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:36.596415 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:36.596415 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:36.596415 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:36.596415 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:36.596415 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:36.596415 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:36.596415 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:36.596415 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:36.596415 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:36.597314 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:36.597314 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:36.597314 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:36.597314 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:36.597314 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 299/612] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:36.602811 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d0da0-a4d3-44ee-9160-2f56481c7dc7 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:36.720096 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:36.746625 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d0da0-a4d3-44ee-9160-2f56481c7dc7 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:36.789087 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fdb75-bc0f-4980-9d40-58ff0ed948d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:36.789786 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fdb75-bc0f-4980-9d40-58ff0ed948d3 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:36.790039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fdb75-bc0f-4980-9d40-58ff0ed948d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:36.790316 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fdb75-bc0f-4980-9d40-58ff0ed948d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:36.791087 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7fdb75-bc0f-4980-9d40-58ff0ed948d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:36.791426 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7fdb75-bc0f-4980-9d40-58ff0ed948d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:36.792853 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7fdb75-bc0f-4980-9d40-58ff0ed948d3 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:36.812880 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 314/613] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:36.818747 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5986f-1d6c-49fe-89f2-14c0676362ed None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:36.899711 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae56499-5fb5-437c-8091-cea737f1fb62 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:36.900015 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae56499-5fb5-437c-8091-cea737f1fb62 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:36.900198 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae56499-5fb5-437c-8091-cea737f1fb62 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:36.901831 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 315/614] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:36.906832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55c63d-0ebb-4070-8aad-ad103fef436b None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:36.907119 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55c63d-0ebb-4070-8aad-ad103fef436b None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:36.907434 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55c63d-0ebb-4070-8aad-ad103fef436b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:36.931237 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:36.940271 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-1c55c63d-0ebb-4070-8aad-ad103fef436b None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:36.941738 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1c55c63d-0ebb-4070-8aad-ad103fef436b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:36.943491 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5986f-1d6c-49fe-89f2-14c0676362ed None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:36.998762 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f79da-942b-45c1-bafc-f92cdaafd8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:37.000192 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f79da-942b-45c1-bafc-f92cdaafd8ba None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:37.000710 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f79da-942b-45c1-bafc-f92cdaafd8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:37.001189 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f79da-942b-45c1-bafc-f92cdaafd8ba None admin] PATH_INFO: `/v3/users/swift` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:37.009565 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f79da-942b-45c1-bafc-f92cdaafd8ba None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:37.011373 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f79da-942b-45c1-bafc-f92cdaafd8ba None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:37.026547 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-2b7f79da-942b-45c1-bafc-f92cdaafd8ba None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 10:40:37.026547 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:37.026547 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:37.026547 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:37.026547 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:37.026547 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:37.026547 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:37.026547 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:37.026547 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:37.026547 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:37.026547 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:37.026547 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:37.026547 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:40:37.026547 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:40:37.026547 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:40:37.026547 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:40:37.027757 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:37.027757 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:37.027757 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:40:37.027757 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:37.027757 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:40:37.027757 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:37.027757 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:37.027757 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:37.027757 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:37.027757 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:37.027757 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:37.027757 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:37.027757 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:37.027757 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:37.027757 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:37.027757 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:37.027757 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:37.027757 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:37.028682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:37.028682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:37.028682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:40:37.028682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:40:37.028682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:40:37.028682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:40:37.028682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:40:37.028682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:40:37.028682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 10:40:37.028682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:37.031314 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 300/615] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:40:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:37.040221 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f79da-942b-45c1-bafc-f92cdaafd8ba None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:37.052238 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 316/616] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:37.090811 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55c63d-0ebb-4070-8aad-ad103fef436b None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:37.200047 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:37.221421 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55c63d-0ebb-4070-8aad-ad103fef436b None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:37.243341 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f79da-942b-45c1-bafc-f92cdaafd8ba None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:37.257941 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7560ca-24b9-4809-be08-1f419c6410b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:37.258877 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7560ca-24b9-4809-be08-1f419c6410b5 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:37.259250 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7560ca-24b9-4809-be08-1f419c6410b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:37.259613 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7560ca-24b9-4809-be08-1f419c6410b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:37.270285 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7560ca-24b9-4809-be08-1f419c6410b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:37.281720 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-ed7560ca-24b9-4809-be08-1f419c6410b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:40:37.281720 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:37.281720 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:37.281720 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:37.281720 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:37.281720 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:37.281720 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:37.281720 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:37.281720 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:37.281720 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:37.281720 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:37.281720 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:37.281720 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:37.281720 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:37.281720 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:37.281720 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:37.282692 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:37.282692 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:37.282692 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:37.282692 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:37.282692 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:37.282692 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:37.282692 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:37.282692 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:37.282692 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:37.282692 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:37.282692 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:37.282692 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:37.282692 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:37.282692 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:37.282692 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:37.282692 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:37.283558 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:37.283558 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:37.283558 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:37.283558 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:37.283558 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:37.283558 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:37.283558 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:37.283558 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:37.283558 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:37.283558 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:37.283558 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:40:37.283558 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:37.288687 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 317/617] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 10:40:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:40:37.292648 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7560ca-24b9-4809-be08-1f419c6410b5 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:37.314240 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8d826-9820-47f5-b36c-bd4ac5e8fc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:37.315392 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8d826-9820-47f5-b36c-bd4ac5e8fc69 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:37.315884 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8d826-9820-47f5-b36c-bd4ac5e8fc69 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:37.316405 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8d826-9820-47f5-b36c-bd4ac5e8fc69 None admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:37.317558 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8d826-9820-47f5-b36c-bd4ac5e8fc69 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:37.318069 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8d826-9820-47f5-b36c-bd4ac5e8fc69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:37.319787 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8d826-9820-47f5-b36c-bd4ac5e8fc69 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:37.354638 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 301/618] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Jun 24 10:40:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:37.359791 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8d826-9820-47f5-b36c-bd4ac5e8fc69 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:37.375178 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:37.400522 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7560ca-24b9-4809-be08-1f419c6410b5 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:37.429051 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:37.437427 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c82fa6-5bb6-4252-b8d0-065d237c020f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:37.438492 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c82fa6-5bb6-4252-b8d0-065d237c020f None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:37.438781 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c82fa6-5bb6-4252-b8d0-065d237c020f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:37.439063 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c82fa6-5bb6-4252-b8d0-065d237c020f None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:37.439861 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c82fa6-5bb6-4252-b8d0-065d237c020f None admin] RBAC: Adding query filter params (name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:37.440174 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c82fa6-5bb6-4252-b8d0-065d237c020f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:37.441579 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c82fa6-5bb6-4252-b8d0-065d237c020f None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:37.453154 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 318/619] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 10:40:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:37.456832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c82fa6-5bb6-4252-b8d0-065d237c020f None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:37.553669 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8d826-9820-47f5-b36c-bd4ac5e8fc69 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:37.559487 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c82fa6-5bb6-4252-b8d0-065d237c020f None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:37.593989 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d5900-7bd5-43b8-83bd-f9063b3a71b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:37.594815 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d5900-7bd5-43b8-83bd-f9063b3a71b1 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:37.595107 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d5900-7bd5-43b8-83bd-f9063b3a71b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:37.595463 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d5900-7bd5-43b8-83bd-f9063b3a71b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:37.606755 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026d5900-7bd5-43b8-83bd-f9063b3a71b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:37.608358 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026d5900-7bd5-43b8-83bd-f9063b3a71b1 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:37.626569 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-026d5900-7bd5-43b8-83bd-f9063b3a71b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:37.626569 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:37.626569 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:37.626569 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:37.626569 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:37.626569 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:37.626569 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:37.626569 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:37.626569 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:37.626569 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:37.626569 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:37.626569 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:37.626569 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:37.626569 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:37.626569 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:37.627526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:37.627526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:37.627526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:37.627526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:37.627526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:37.627526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:37.627526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:37.627526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:37.627526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:37.627526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:37.627526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:37.627526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:37.627526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:37.627526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:37.627526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:37.627526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:37.627526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:37.628413 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:37.628413 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:37.628413 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:37.628413 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:37.628639 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2869c1-d80e-4eab-a8be-dc46032aed3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:37.628729 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 319/620] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:40:37.628807 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2869c1-d80e-4eab-a8be-dc46032aed3c None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:37.628927 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2869c1-d80e-4eab-a8be-dc46032aed3c None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:37.629196 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2869c1-d80e-4eab-a8be-dc46032aed3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:37.633830 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d5900-7bd5-43b8-83bd-f9063b3a71b1 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:37.656455 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2869c1-d80e-4eab-a8be-dc46032aed3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:37.659196 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2869c1-d80e-4eab-a8be-dc46032aed3c None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:37.695362 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-4a2869c1-d80e-4eab-a8be-dc46032aed3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:37.695362 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:37.695362 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:37.695362 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:37.695362 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:37.695362 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:37.695362 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:37.695362 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:37.695362 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:37.695362 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:37.695362 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:37.695362 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:37.695362 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:37.695362 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:37.695362 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:37.696376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:37.696376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:37.696376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:37.696376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:37.696376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:37.696376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:37.696376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:37.696376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:37.696376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:37.696376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:37.696376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:37.696376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:37.696376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:37.696376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:37.696376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:37.696376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:37.696376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:37.697251 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:37.697251 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:37.697251 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:37.697251 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:37.699507 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:37.699700 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 302/621] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:40:37.704627 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2869c1-d80e-4eab-a8be-dc46032aed3c None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:37.756764 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d5900-7bd5-43b8-83bd-f9063b3a71b1 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:37.792510 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a0c79-309e-4feb-a71f-07f3b7af5814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:37.793300 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a0c79-309e-4feb-a71f-07f3b7af5814 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:37.793652 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a0c79-309e-4feb-a71f-07f3b7af5814 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:37.793998 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a0c79-309e-4feb-a71f-07f3b7af5814 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:37.794824 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a0c79-309e-4feb-a71f-07f3b7af5814 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:37.795220 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a0c79-309e-4feb-a71f-07f3b7af5814 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:37.796668 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a0c79-309e-4feb-a71f-07f3b7af5814 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:37.810167 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 320/622] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:37.811803 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0777d3c-5059-4d52-bcd4-d9bd81d76ae6 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:37.812169 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0777d3c-5059-4d52-bcd4-d9bd81d76ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:37.812517 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0777d3c-5059-4d52-bcd4-d9bd81d76ae6 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:37.814683 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 321/623] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:37.819699 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0777d3c-5059-4d52-bcd4-d9bd81d76ae6 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:37.827639 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:37.877176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2869c1-d80e-4eab-a8be-dc46032aed3c None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:37.922297 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8a9f7-2a9f-42af-9076-dd43c7ba4187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:37.924689 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8a9f7-2a9f-42af-9076-dd43c7ba4187 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:37.925523 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8a9f7-2a9f-42af-9076-dd43c7ba4187 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:37.926182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8a9f7-2a9f-42af-9076-dd43c7ba4187 None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:37.927609 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8a9f7-2a9f-42af-9076-dd43c7ba4187 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:37.927925 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8a9f7-2a9f-42af-9076-dd43c7ba4187 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:37.929554 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8a9f7-2a9f-42af-9076-dd43c7ba4187 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:37.945628 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0777d3c-5059-4d52-bcd4-d9bd81d76ae6 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:37.949176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 303/624] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:40:37.949342 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:37.950421 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d406ae-8361-4ca8-8d1a-a05a53f6d01f None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:37.950709 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d406ae-8361-4ca8-8d1a-a05a53f6d01f None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:37.950986 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d406ae-8361-4ca8-8d1a-a05a53f6d01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:37.968440 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-12d406ae-8361-4ca8-8d1a-a05a53f6d01f None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:37.969532 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-12d406ae-8361-4ca8-8d1a-a05a53f6d01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:37.986900 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f900df-d3e1-427c-af14-fee11f339c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:37.988181 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f900df-d3e1-427c-af14-fee11f339c4c None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:37.988684 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f900df-d3e1-427c-af14-fee11f339c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:37.989172 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f900df-d3e1-427c-af14-fee11f339c4c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:37.998195 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f900df-d3e1-427c-af14-fee11f339c4c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:38.000096 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f900df-d3e1-427c-af14-fee11f339c4c None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:38.016195 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-58f900df-d3e1-427c-af14-fee11f339c4c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:40:38.016195 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:38.016195 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:38.016195 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:38.016195 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:38.016195 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:38.016195 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:38.016195 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:38.016195 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:38.016195 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:38.016195 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:38.016195 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:38.016195 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:40:38.016195 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:40:38.016195 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:40:38.016195 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:40:38.017175 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:38.017175 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:38.017175 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:40:38.017175 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:38.017175 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:40:38.017175 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:38.017175 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:38.017175 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:38.017175 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:38.017175 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:38.017175 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:38.017175 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:38.017175 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:38.017175 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:38.017175 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:38.017175 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:38.017175 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:38.017175 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:38.018162 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:38.018162 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:38.018162 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:40:38.018162 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:40:38.018162 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:40:38.018162 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:40:38.018162 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:40:38.018162 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:40:38.018162 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:40:38.018162 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:38.026102 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 322/625] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Jun 24 10:40:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:38.027237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f900df-d3e1-427c-af14-fee11f339c4c None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:38.047228 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 304/626] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:38.048398 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d406ae-8361-4ca8-8d1a-a05a53f6d01f None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:38.113989 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:38.173789 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d406ae-8361-4ca8-8d1a-a05a53f6d01f None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:38.174034 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f900df-d3e1-427c-af14-fee11f339c4c None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:38.214415 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd34bd1-8a11-44e0-9b89-8518f41aee02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:38.215109 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd34bd1-8a11-44e0-9b89-8518f41aee02 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:38.215421 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd34bd1-8a11-44e0-9b89-8518f41aee02 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:38.215697 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd34bd1-8a11-44e0-9b89-8518f41aee02 None admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:38.216543 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd34bd1-8a11-44e0-9b89-8518f41aee02 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:38.216848 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd34bd1-8a11-44e0-9b89-8518f41aee02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:38.218297 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd34bd1-8a11-44e0-9b89-8518f41aee02 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:38.218727 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3367e27-9a12-416b-91cd-57f9117cff47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:38.219816 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3367e27-9a12-416b-91cd-57f9117cff47 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:38.220289 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3367e27-9a12-416b-91cd-57f9117cff47 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:38.220750 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3367e27-9a12-416b-91cd-57f9117cff47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:38.229010 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3367e27-9a12-416b-91cd-57f9117cff47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:38.230762 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3367e27-9a12-416b-91cd-57f9117cff47 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:38.243181 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 305/627] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jun 24 10:40:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:38.243181 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd34bd1-8a11-44e0-9b89-8518f41aee02 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:38.251251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-a3367e27-9a12-416b-91cd-57f9117cff47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:38.251251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:38.251251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:38.251251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:38.251251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:38.251251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:38.251251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:38.251251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:38.251251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:38.251251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:38.251251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:38.251251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:38.251251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:40:38.251251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:40:38.251251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:40:38.252210 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:40:38.252210 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:38.252210 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:38.252210 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:38.252210 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:38.252210 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:38.252210 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:38.252210 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:38.252210 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:38.252210 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:38.252210 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:38.252210 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:38.252210 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:38.252210 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:38.252210 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:38.252210 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:38.252210 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:38.253203 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:40:38.253203 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:40:38.253203 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:40:38.253203 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:40:38.253203 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:40:38.253203 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:40:38.253203 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:38.253203 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:38.255838 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 323/628] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:40:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:38.257735 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3367e27-9a12-416b-91cd-57f9117cff47 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:38.284690 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:38.368280 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3367e27-9a12-416b-91cd-57f9117cff47 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:38.377226 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd34bd1-8a11-44e0-9b89-8518f41aee02 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:38.387300 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:38.407586 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5494d-3572-4d62-8fe4-31ccde7b921d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:38.408269 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5494d-3572-4d62-8fe4-31ccde7b921d None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:38.408526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5494d-3572-4d62-8fe4-31ccde7b921d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:38.408800 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5494d-3572-4d62-8fe4-31ccde7b921d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:38.421023 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d9d21-4729-4db0-a5bc-ce7477351ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:38.422225 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d9d21-4729-4db0-a5bc-ce7477351ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:38.422507 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d9d21-4729-4db0-a5bc-ce7477351ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:38.423041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d9d21-4729-4db0-a5bc-ce7477351ee6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:38.436764 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d9d21-4729-4db0-a5bc-ce7477351ee6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:38.447906 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-c44d9d21-4729-4db0-a5bc-ce7477351ee6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:40:38.447906 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:38.447906 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:38.447906 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:38.447906 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:38.447906 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:38.447906 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:38.447906 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:38.447906 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:38.447906 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:38.447906 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:38.447906 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:38.447906 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:38.447906 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:38.447906 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:38.447906 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:38.448826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:38.448826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:38.448826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:38.448826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:38.448826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:38.448826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:38.448826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:38.448826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:38.448826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:38.448826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:38.448826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:38.448826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:38.448826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:38.448826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:38.448826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:38.448826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:38.449691 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:38.449691 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:38.449691 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:38.449691 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:38.449691 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:38.449691 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:38.449691 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:38.449691 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:38.449691 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:38.449691 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:38.449691 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:40:38.449691 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:38.450980 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 306/629] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 10:40:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:38.451861 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d9d21-4729-4db0-a5bc-ce7477351ee6 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:38.484939 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5494d-3572-4d62-8fe4-31ccde7b921d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:38.486334 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5494d-3572-4d62-8fe4-31ccde7b921d None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:38.510818 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:38.564649 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d9d21-4729-4db0-a5bc-ce7477351ee6 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:38.603644 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 324/630] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:40:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:38.603644 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b20bce-fc6e-46e5-930e-16b8bc602c17 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:38.603644 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b20bce-fc6e-46e5-930e-16b8bc602c17 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:38.603644 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b20bce-fc6e-46e5-930e-16b8bc602c17 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:38.603644 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 325/631] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:38.603644 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b20bce-fc6e-46e5-930e-16b8bc602c17 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:38.611939 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651de66-1f61-4453-8f12-2228fe59eeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:38.612624 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651de66-1f61-4453-8f12-2228fe59eeaa None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:38.612911 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651de66-1f61-4453-8f12-2228fe59eeaa None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:38.613192 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651de66-1f61-4453-8f12-2228fe59eeaa None admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:38.613993 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651de66-1f61-4453-8f12-2228fe59eeaa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:38.614310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651de66-1f61-4453-8f12-2228fe59eeaa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:38.616558 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651de66-1f61-4453-8f12-2228fe59eeaa None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:38.633335 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 307/632] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:40:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:38.634493 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651de66-1f61-4453-8f12-2228fe59eeaa None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:38.666630 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:38.726407 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b20bce-fc6e-46e5-930e-16b8bc602c17 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:38.742977 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651de66-1f61-4453-8f12-2228fe59eeaa None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:38.753273 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:38.766153 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1263a-24f2-43ac-9faf-8f462e1766e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:38.766935 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1263a-24f2-43ac-9faf-8f462e1766e4 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:38.767233 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1263a-24f2-43ac-9faf-8f462e1766e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:38.767615 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1263a-24f2-43ac-9faf-8f462e1766e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:38.768374 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea1263a-24f2-43ac-9faf-8f462e1766e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:38.768667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea1263a-24f2-43ac-9faf-8f462e1766e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:38.770202 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea1263a-24f2-43ac-9faf-8f462e1766e4 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:38.778440 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa7fec-2c3e-42dc-a505-bfc150db520f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:38.783827 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 326/633] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 10:40:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:38.783963 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa7fec-2c3e-42dc-a505-bfc150db520f None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:38.783963 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa7fec-2c3e-42dc-a505-bfc150db520f None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:38.783963 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa7fec-2c3e-42dc-a505-bfc150db520f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:38.784234 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55fe05-d82b-4a0e-9b2d-b2ddd30dde7f None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:38.784234 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55fe05-d82b-4a0e-9b2d-b2ddd30dde7f None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:38.784234 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55fe05-d82b-4a0e-9b2d-b2ddd30dde7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:38.794825 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa7fec-2c3e-42dc-a505-bfc150db520f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:38.796302 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa7fec-2c3e-42dc-a505-bfc150db520f None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:38.798930 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-1b55fe05-d82b-4a0e-9b2d-b2ddd30dde7f None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:38.800141 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1b55fe05-d82b-4a0e-9b2d-b2ddd30dde7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:38.814859 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-f9fa7fec-2c3e-42dc-a505-bfc150db520f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:38.814859 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:38.814859 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:38.814859 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:38.814859 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:38.814859 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:38.814859 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:38.814859 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:38.814859 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:38.814859 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:38.814859 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:38.814859 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:38.814859 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:38.814859 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:38.814859 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:38.815828 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:38.815828 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:38.815828 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:38.815828 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:38.815828 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:38.815828 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:38.815828 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:38.815828 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:38.815828 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:38.815828 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:38.815828 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:38.815828 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:38.815828 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:38.815828 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:38.815828 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:38.815828 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:38.815828 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:38.816760 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:38.816760 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:38.816760 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:38.816760 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:38.816760 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 308/634] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:38.816760 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa7fec-2c3e-42dc-a505-bfc150db520f None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:38.868744 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 327/635] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:38.869591 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55fe05-d82b-4a0e-9b2d-b2ddd30dde7f None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:38.894641 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:38.918779 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa7fec-2c3e-42dc-a505-bfc150db520f None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:38.952726 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae736d7-7f85-4bdf-be9e-45f40fbde43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:38.953620 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae736d7-7f85-4bdf-be9e-45f40fbde43a None admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:38.953898 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae736d7-7f85-4bdf-be9e-45f40fbde43a None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:38.954168 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae736d7-7f85-4bdf-be9e-45f40fbde43a None admin] PATH_INFO: `/v3/projects/61b2f5f9674c4fd3a1ec5db2f3b4b26e/users/ff592d9ebd4241019625828ddd41aee8/roles/7bab53c1ac3d4e04b18c87286e2ab0aa` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:38.968306 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae736d7-7f85-4bdf-be9e-45f40fbde43a None admin] RBAC: Authorizing `identity:create_grant(project_id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user_id=ff592d9ebd4241019625828ddd41aee8, role_id=7bab53c1ac3d4e04b18c87286e2ab0aa)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:38.969757 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae736d7-7f85-4bdf-be9e-45f40fbde43a None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:38.973087 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55fe05-d82b-4a0e-9b2d-b2ddd30dde7f None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:38.982716 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 309/636] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 10:40:38 2022] PUT /identity/v3/projects/61b2f5f9674c4fd3a1ec5db2f3b4b26e/users/ff592d9ebd4241019625828ddd41aee8/roles/7bab53c1ac3d4e04b18c87286e2ab0aa => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:40:38.983826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd08235-019b-4520-acd3-1ca5312bbf2a None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:38.984111 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd08235-019b-4520-acd3-1ca5312bbf2a None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:38.984385 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd08235-019b-4520-acd3-1ca5312bbf2a None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:38.985898 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 310/637] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:38.986644 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd08235-019b-4520-acd3-1ca5312bbf2a None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:38.993711 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:39.019429 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323ad92-de0c-4896-9e85-2af5a7da2879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:39.020542 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323ad92-de0c-4896-9e85-2af5a7da2879 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:39.020829 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323ad92-de0c-4896-9e85-2af5a7da2879 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:39.021269 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323ad92-de0c-4896-9e85-2af5a7da2879 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:39.032969 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323ad92-de0c-4896-9e85-2af5a7da2879 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:39.034542 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323ad92-de0c-4896-9e85-2af5a7da2879 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:39.053830 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-7323ad92-de0c-4896-9e85-2af5a7da2879 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:39.053830 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:39.053830 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:39.053830 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:39.053830 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:39.053830 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:39.053830 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:39.053830 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:39.053830 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:39.053830 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:39.053830 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:39.053830 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:39.053830 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:39.053830 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:39.053830 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:39.055055 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:39.055055 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:39.055055 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:39.055055 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:39.055055 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:39.055055 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:39.055055 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:39.055055 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:39.055055 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:39.055055 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:39.055055 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:39.055055 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:39.055055 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:39.055055 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:39.055055 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:39.055055 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:39.055055 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:39.055975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:39.055975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:39.055975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:39.055975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:39.055975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 328/638] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:39.055975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323ad92-de0c-4896-9e85-2af5a7da2879 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:39.106579 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd08235-019b-4520-acd3-1ca5312bbf2a None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:39.143618 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:39.156480 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b04155-3e5f-456f-bf87-2e5fcd7cfab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:39.157499 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b04155-3e5f-456f-bf87-2e5fcd7cfab0 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:39.157789 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b04155-3e5f-456f-bf87-2e5fcd7cfab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:39.158128 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b04155-3e5f-456f-bf87-2e5fcd7cfab0 None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:39.158869 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b04155-3e5f-456f-bf87-2e5fcd7cfab0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:39.159275 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b04155-3e5f-456f-bf87-2e5fcd7cfab0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:39.160684 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b04155-3e5f-456f-bf87-2e5fcd7cfab0 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:39.173002 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 311/639] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:39.173724 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323ad92-de0c-4896-9e85-2af5a7da2879 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:39.174286 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15de85-e197-4e36-96b2-aa2a686de8c8 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:39.174584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15de85-e197-4e36-96b2-aa2a686de8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:39.174866 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15de85-e197-4e36-96b2-aa2a686de8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:39.192754 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-fd15de85-e197-4e36-96b2-aa2a686de8c8 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:39.193992 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-fd15de85-e197-4e36-96b2-aa2a686de8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:39.209850 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06781693-66f8-44a8-9f4d-acf2f1478015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:39.211068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06781693-66f8-44a8-9f4d-acf2f1478015 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:39.211402 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06781693-66f8-44a8-9f4d-acf2f1478015 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:39.211692 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06781693-66f8-44a8-9f4d-acf2f1478015 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:39.222128 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06781693-66f8-44a8-9f4d-acf2f1478015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:39.230554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-06781693-66f8-44a8-9f4d-acf2f1478015 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:40:39.230554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:39.230554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:39.230554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:39.230554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:39.230554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:39.230554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:39.230554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:39.230554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:39.230554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:39.230554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:39.230554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:39.230554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:39.230554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:39.230554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:39.230554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:39.231567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:39.231567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:39.231567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:39.231567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:39.231567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:39.231567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:39.231567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:39.231567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:39.231567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:39.231567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:39.231567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:39.231567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:39.231567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:39.231567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:39.231567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:39.231567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:39.232406 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:39.232406 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:39.232406 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:39.232406 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:39.232406 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:39.232406 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:39.232406 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:39.232406 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:39.232406 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:39.232406 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:39.232406 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:40:39.232406 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:39.232406 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 329/640] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 10:40:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:39.233130 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06781693-66f8-44a8-9f4d-acf2f1478015 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:39.262201 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:39.279322 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 312/641] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:39.279322 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15de85-e197-4e36-96b2-aa2a686de8c8 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:39.350461 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06781693-66f8-44a8-9f4d-acf2f1478015 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:39.386960 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82753b6-a7b3-4a5e-a5b0-609a0e51d3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:39.387654 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82753b6-a7b3-4a5e-a5b0-609a0e51d3d4 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:39.387939 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82753b6-a7b3-4a5e-a5b0-609a0e51d3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:39.388217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82753b6-a7b3-4a5e-a5b0-609a0e51d3d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:39.388945 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82753b6-a7b3-4a5e-a5b0-609a0e51d3d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:39.389259 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82753b6-a7b3-4a5e-a5b0-609a0e51d3d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:39.390629 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82753b6-a7b3-4a5e-a5b0-609a0e51d3d4 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:39.402860 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 330/642] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:39.403721 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82753b6-a7b3-4a5e-a5b0-609a0e51d3d4 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:39.413153 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15de85-e197-4e36-96b2-aa2a686de8c8 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:39.433884 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:39.453396 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500a00b-07b0-4407-93fc-32dd00f8befc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:39.454217 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500a00b-07b0-4407-93fc-32dd00f8befc None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:39.454503 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500a00b-07b0-4407-93fc-32dd00f8befc None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:39.454785 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500a00b-07b0-4407-93fc-32dd00f8befc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:39.464330 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500a00b-07b0-4407-93fc-32dd00f8befc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:39.465890 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500a00b-07b0-4407-93fc-32dd00f8befc None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:39.481003 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-4500a00b-07b0-4407-93fc-32dd00f8befc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:39.481003 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:39.481003 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:39.481003 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:39.481003 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:39.481003 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:39.481003 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:39.481003 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:39.481003 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:39.481003 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:39.481003 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:39.481003 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:39.481003 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:40:39.481003 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:40:39.481003 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:40:39.482014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:40:39.482014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:39.482014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:39.482014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:39.482014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:39.482014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:39.482014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:39.482014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:39.482014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:39.482014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:39.482014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:39.482014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:39.482014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:39.482014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:39.482014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:39.482014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:39.482014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:39.482912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:40:39.482912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:40:39.482912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:40:39.482912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:40:39.482912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:40:39.482912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:40:39.482912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:39.482912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:39.482912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 313/643] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:40:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:39.483454 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500a00b-07b0-4407-93fc-32dd00f8befc None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:39.497645 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:39.513774 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82753b6-a7b3-4a5e-a5b0-609a0e51d3d4 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:39.554792 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb3d8c-4354-4190-a6be-8c9239abf160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:39.555758 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb3d8c-4354-4190-a6be-8c9239abf160 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:39.556044 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb3d8c-4354-4190-a6be-8c9239abf160 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:39.556329 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb3d8c-4354-4190-a6be-8c9239abf160 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:39.557084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb3d8c-4354-4190-a6be-8c9239abf160 None admin] RBAC: Adding query filter params (name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:39.557395 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb3d8c-4354-4190-a6be-8c9239abf160 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:39.559189 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb3d8c-4354-4190-a6be-8c9239abf160 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:39.571861 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 331/644] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 10:40:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:39.571861 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb3d8c-4354-4190-a6be-8c9239abf160 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:39.597165 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500a00b-07b0-4407-93fc-32dd00f8befc None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:39.637170 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34e673-8261-4d5c-ac36-f46480f2cb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:39.638091 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34e673-8261-4d5c-ac36-f46480f2cb31 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:39.638381 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34e673-8261-4d5c-ac36-f46480f2cb31 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:39.638659 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34e673-8261-4d5c-ac36-f46480f2cb31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:39.650529 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34e673-8261-4d5c-ac36-f46480f2cb31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:39.658831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-4d34e673-8261-4d5c-ac36-f46480f2cb31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:40:39.658831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:39.658831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:39.658831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:39.658831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:39.658831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:39.658831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:39.658831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:39.658831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:39.658831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:39.658831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:39.658831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:39.658831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:39.658831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:39.658831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:39.658831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:39.659780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:39.659780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:39.659780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:39.659780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:39.659780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:39.659780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:39.659780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:39.659780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:39.659780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:39.659780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:39.659780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:39.659780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:39.659780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:39.659780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:39.659780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:39.659780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:39.660781 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:39.660781 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:39.660781 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:39.660781 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:39.660781 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:39.660781 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:39.660781 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:39.660781 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:39.660781 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:39.660781 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:39.660781 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:40:39.660781 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:39.667425 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 314/645] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 10:40:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:39.668940 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34e673-8261-4d5c-ac36-f46480f2cb31 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:39.691398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb3d8c-4354-4190-a6be-8c9239abf160 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:39.712686 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:39.729840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a778b-0fd5-4483-9410-9c76ecd35a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:39.730654 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a778b-0fd5-4483-9410-9c76ecd35a72 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:39.730939 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a778b-0fd5-4483-9410-9c76ecd35a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:39.731249 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a778b-0fd5-4483-9410-9c76ecd35a72 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:39.739172 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a778b-0fd5-4483-9410-9c76ecd35a72 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:39.740660 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a778b-0fd5-4483-9410-9c76ecd35a72 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:39.755182 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-9d4a778b-0fd5-4483-9410-9c76ecd35a72 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 10:40:39.755182 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:39.755182 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:39.755182 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:39.755182 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:39.755182 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:39.755182 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:39.755182 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:39.755182 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:39.755182 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:39.755182 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:39.755182 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:39.755182 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:40:39.755182 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:40:39.755182 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:40:39.755182 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:40:39.756171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:39.756171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:39.756171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:40:39.756171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:39.756171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:40:39.756171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:39.756171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:39.756171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:39.756171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:39.756171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:39.756171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:39.756171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:39.756171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:39.756171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:39.756171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:39.756171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:39.756171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:39.756171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:39.757184 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:39.757184 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:39.757184 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:40:39.757184 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:40:39.757184 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:40:39.757184 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:40:39.757184 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:40:39.757184 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:40:39.757184 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 10:40:39.757184 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:39.757184 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 332/646] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:40:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:39.757934 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a778b-0fd5-4483-9410-9c76ecd35a72 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:39.770183 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:39.781074 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34e673-8261-4d5c-ac36-f46480f2cb31 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:39.816606 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173955b-d169-4953-91fd-5cb426dd06de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:39.817280 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173955b-d169-4953-91fd-5cb426dd06de None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:39.817568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173955b-d169-4953-91fd-5cb426dd06de None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:39.817847 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173955b-d169-4953-91fd-5cb426dd06de None admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:39.818648 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173955b-d169-4953-91fd-5cb426dd06de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:39.818962 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173955b-d169-4953-91fd-5cb426dd06de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:39.820478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173955b-d169-4953-91fd-5cb426dd06de None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:39.832826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 315/647] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:40:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:39.833620 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173955b-d169-4953-91fd-5cb426dd06de None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:39.870658 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a778b-0fd5-4483-9410-9c76ecd35a72 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:39.906370 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64570ec-63b5-41bc-aba3-3052b8f7b623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:39.907564 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64570ec-63b5-41bc-aba3-3052b8f7b623 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:39.907564 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64570ec-63b5-41bc-aba3-3052b8f7b623 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:39.907761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64570ec-63b5-41bc-aba3-3052b8f7b623 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:39.918576 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64570ec-63b5-41bc-aba3-3052b8f7b623 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:39.920066 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64570ec-63b5-41bc-aba3-3052b8f7b623 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:39.935009 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:39.937574 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-a64570ec-63b5-41bc-aba3-3052b8f7b623 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:39.937574 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:39.937574 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:39.937574 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:39.937574 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:39.937574 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:39.937574 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:39.937574 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:39.937574 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:39.937574 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:39.937574 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:39.937574 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:39.937574 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:39.937574 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:39.937574 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:39.938832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:39.938832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:39.938832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:39.938832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:39.938832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:39.938832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:39.938832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:39.938832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:39.938832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:39.938832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:39.938832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:39.938832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:39.938832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:39.938832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:39.938832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:39.938832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:39.938832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:39.945227 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:39.945227 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:39.945227 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:39.945227 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:39.945459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173955b-d169-4953-91fd-5cb426dd06de None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:39.945535 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 333/648] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:39.945535 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64570ec-63b5-41bc-aba3-3052b8f7b623 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:39.975136 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f1e29-31f3-4e7e-93e6-49c6548f2973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:39.975921 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f1e29-31f3-4e7e-93e6-49c6548f2973 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:39.976341 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f1e29-31f3-4e7e-93e6-49c6548f2973 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:39.976623 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f1e29-31f3-4e7e-93e6-49c6548f2973 None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:39.977379 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f1e29-31f3-4e7e-93e6-49c6548f2973 None admin] RBAC: Adding query filter params (name=service) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:39.977688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f1e29-31f3-4e7e-93e6-49c6548f2973 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:39.979057 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f1e29-31f3-4e7e-93e6-49c6548f2973 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:39.991631 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 316/649] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 10:40:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:39.991631 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f1e29-31f3-4e7e-93e6-49c6548f2973 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:40.014981 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:40.060950 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64570ec-63b5-41bc-aba3-3052b8f7b623 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:40.097272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768e6c3-49da-436d-97e6-90d309ef837d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:40.097672 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f1e29-31f3-4e7e-93e6-49c6548f2973 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:40.097955 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768e6c3-49da-436d-97e6-90d309ef837d None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:40.098240 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768e6c3-49da-436d-97e6-90d309ef837d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:40.098516 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768e6c3-49da-436d-97e6-90d309ef837d None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:40.099390 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768e6c3-49da-436d-97e6-90d309ef837d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:40.099704 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768e6c3-49da-436d-97e6-90d309ef837d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:40.101251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768e6c3-49da-436d-97e6-90d309ef837d None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:40.119925 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 334/650] 10.222.0.16 () {56 vars in 1137 bytes} [Fri Jun 24 10:40:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:40.119925 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768e6c3-49da-436d-97e6-90d309ef837d None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:40.140427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c6182-eeb7-4aae-a2b6-9c0a81ff1fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:40.141210 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c6182-eeb7-4aae-a2b6-9c0a81ff1fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:40.141492 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c6182-eeb7-4aae-a2b6-9c0a81ff1fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:40.141863 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c6182-eeb7-4aae-a2b6-9c0a81ff1fc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:40.142718 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5c6182-eeb7-4aae-a2b6-9c0a81ff1fc4 None admin] RBAC: Adding query filter params (role.id=7bab53c1ac3d4e04b18c87286e2ab0aa, scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user.id=e8034bad51144002a7386c975e412992) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:40.143024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5c6182-eeb7-4aae-a2b6-9c0a81ff1fc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:40.144491 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5c6182-eeb7-4aae-a2b6-9c0a81ff1fc4 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:40.161019 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 317/651] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:40:39 2022] GET /identity/v3/role_assignments?user.id=e8034bad51144002a7386c975e412992&scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e&role.id=7bab53c1ac3d4e04b18c87286e2ab0aa => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:40.161019 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c6182-eeb7-4aae-a2b6-9c0a81ff1fc4 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:40.195222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:40.250104 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768e6c3-49da-436d-97e6-90d309ef837d None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:40.269934 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:40.292697 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764740a-884a-4f26-9f3d-4d63239333ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:40.293429 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764740a-884a-4f26-9f3d-4d63239333ed None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:40.293719 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764740a-884a-4f26-9f3d-4d63239333ed None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:40.293999 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764740a-884a-4f26-9f3d-4d63239333ed None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:40.294740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764740a-884a-4f26-9f3d-4d63239333ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:40.295048 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764740a-884a-4f26-9f3d-4d63239333ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:40.296483 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764740a-884a-4f26-9f3d-4d63239333ed None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:40.314839 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 335/652] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:40.315287 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c6182-eeb7-4aae-a2b6-9c0a81ff1fc4 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:40.316318 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764740a-884a-4f26-9f3d-4d63239333ed None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:40.354428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501ed91-f759-4c52-8ad1-767bf7e4e054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:40.355320 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501ed91-f759-4c52-8ad1-767bf7e4e054 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:40.355605 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501ed91-f759-4c52-8ad1-767bf7e4e054 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:40.355884 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501ed91-f759-4c52-8ad1-767bf7e4e054 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:40.367090 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501ed91-f759-4c52-8ad1-767bf7e4e054 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:40.368594 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501ed91-f759-4c52-8ad1-767bf7e4e054 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:40.388621 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-0501ed91-f759-4c52-8ad1-767bf7e4e054 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:40.388621 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:40.388621 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:40.388621 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:40.388621 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:40.388621 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:40.388621 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:40.388621 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:40.388621 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:40.388621 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:40.388621 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:40.388621 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:40.388621 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:40.388621 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:40.388621 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:40.389537 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:40.389537 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:40.389537 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:40.389537 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:40.389537 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:40.389537 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:40.389537 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:40.389537 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:40.389537 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:40.389537 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:40.389537 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:40.389537 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:40.389537 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:40.389537 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:40.389537 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:40.389537 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:40.389537 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:40.391023 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:40.391023 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:40.391023 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:40.391023 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:40.391023 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 318/653] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:40.391023 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501ed91-f759-4c52-8ad1-767bf7e4e054 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:40.447507 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764740a-884a-4f26-9f3d-4d63239333ed None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:40.481357 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:40.484235 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59177230-9bb4-45ec-9b55-bfd1d613a350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:40.484965 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59177230-9bb4-45ec-9b55-bfd1d613a350 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:40.485314 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59177230-9bb4-45ec-9b55-bfd1d613a350 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:40.485623 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59177230-9bb4-45ec-9b55-bfd1d613a350 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:40.512521 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501ed91-f759-4c52-8ad1-767bf7e4e054 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:40.556686 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd91409-de62-4ecd-ba56-a7d68deda3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:40.557737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd91409-de62-4ecd-ba56-a7d68deda3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:40.558084 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd91409-de62-4ecd-ba56-a7d68deda3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:40.558694 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd91409-de62-4ecd-ba56-a7d68deda3e6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:40.568922 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd91409-de62-4ecd-ba56-a7d68deda3e6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:40.570805 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd91409-de62-4ecd-ba56-a7d68deda3e6 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:40.579541 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:40.580839 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59177230-9bb4-45ec-9b55-bfd1d613a350 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:40.582554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59177230-9bb4-45ec-9b55-bfd1d613a350 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:40.589218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-dcd91409-de62-4ecd-ba56-a7d68deda3e6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 10:40:40.589218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:40.589218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:40.589218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:40.589218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:40.589218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:40.589218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:40.589218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:40.589218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:40.589218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:40.589218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:40.589218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:40.589218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:40:40.589218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:40:40.589218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:40:40.589218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:40:40.590172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:40.590172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:40.590172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:40:40.590172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:40.590172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:40:40.590172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:40.590172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:40.590172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:40.590172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:40.590172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:40.590172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:40.590172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:40.590172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:40.590172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:40.590172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:40.590172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:40.590172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:40.590172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:40.591284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:40.591284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:40.591284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:40:40.591284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:40:40.591284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:40:40.591284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:40:40.591284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:40:40.591284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:40:40.591284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 10:40:40.591284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:40.591284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 319/654] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:40:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:40.596800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd91409-de62-4ecd-ba56-a7d68deda3e6 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:40.702363 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd91409-de62-4ecd-ba56-a7d68deda3e6 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:40.706365 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 336/655] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:40:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:40.707587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59177230-9bb4-45ec-9b55-bfd1d613a350 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:40.739784 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974b41d-0668-4fa5-8cdd-0b102edf6210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:40.740554 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974b41d-0668-4fa5-8cdd-0b102edf6210 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:40.741005 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974b41d-0668-4fa5-8cdd-0b102edf6210 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:40.741467 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974b41d-0668-4fa5-8cdd-0b102edf6210 None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:40.742473 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974b41d-0668-4fa5-8cdd-0b102edf6210 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:40.742872 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974b41d-0668-4fa5-8cdd-0b102edf6210 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:40.744328 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974b41d-0668-4fa5-8cdd-0b102edf6210 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:40.754859 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:40.759755 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 320/656] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:40.761272 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974b41d-0668-4fa5-8cdd-0b102edf6210 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:40.796863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:40.827105 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59177230-9bb4-45ec-9b55-bfd1d613a350 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:40.862741 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048765e-5fc1-496c-9add-8a0d63ee54d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:40.863596 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048765e-5fc1-496c-9add-8a0d63ee54d1 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:40.863976 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048765e-5fc1-496c-9add-8a0d63ee54d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:40.864345 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048765e-5fc1-496c-9add-8a0d63ee54d1 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:40.865289 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048765e-5fc1-496c-9add-8a0d63ee54d1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:40.865698 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048765e-5fc1-496c-9add-8a0d63ee54d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:40.867553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048765e-5fc1-496c-9add-8a0d63ee54d1 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:40.890655 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 337/657] 10.222.0.16 () {56 vars in 1137 bytes} [Fri Jun 24 10:40:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:40.890655 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048765e-5fc1-496c-9add-8a0d63ee54d1 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:40.904579 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974b41d-0668-4fa5-8cdd-0b102edf6210 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:40.952173 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c613c27-7b0b-43f6-9080-bb34aea35e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:40.953496 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c613c27-7b0b-43f6-9080-bb34aea35e8a None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:40.953923 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c613c27-7b0b-43f6-9080-bb34aea35e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:40.954380 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c613c27-7b0b-43f6-9080-bb34aea35e8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:40.969101 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c613c27-7b0b-43f6-9080-bb34aea35e8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:40.971330 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c613c27-7b0b-43f6-9080-bb34aea35e8a None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:40.995737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-3c613c27-7b0b-43f6-9080-bb34aea35e8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:40.995737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:40.995737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:40.995737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:40.995737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:40.995737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:40.995737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:40.995737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:40.995737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:40.995737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:40.995737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:40.995737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:40.995737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:40.995737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:40.995737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:40.996839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:40.996839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:40.996839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:40.996839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:40.996839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:40.996839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:40.996839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:40.996839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:40.996839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:40.996839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:40.996839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:40.996839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:40.996839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:40.996839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:40.996839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:40.996839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:40.996839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:40.997927 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:40.997927 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:40.997927 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:40.997927 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:40.999618 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048765e-5fc1-496c-9add-8a0d63ee54d1 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:40.999981 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 321/658] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:41.000923 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c613c27-7b0b-43f6-9080-bb34aea35e8a None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:41.037961 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4d41b-2a96-49fb-aec1-49f3e8c3513b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:41.038982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4d41b-2a96-49fb-aec1-49f3e8c3513b None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:41.039385 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4d41b-2a96-49fb-aec1-49f3e8c3513b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:41.039755 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4d41b-2a96-49fb-aec1-49f3e8c3513b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:41.043191 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:41.048794 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc4d41b-2a96-49fb-aec1-49f3e8c3513b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:41.050599 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc4d41b-2a96-49fb-aec1-49f3e8c3513b None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:41.066920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-0bc4d41b-2a96-49fb-aec1-49f3e8c3513b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 10:40:41.066920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:41.066920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:41.066920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:41.066920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:41.066920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:41.066920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:41.066920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:41.066920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:41.066920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:41.066920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:41.066920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:41.066920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:40:41.066920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:40:41.066920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:40:41.066920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:40:41.068143 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:41.068143 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:41.068143 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:40:41.068143 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:41.068143 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:40:41.068143 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:41.068143 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:41.068143 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:41.068143 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:41.068143 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:41.068143 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:41.068143 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:41.068143 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:41.068143 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:41.068143 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:41.068143 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:41.068143 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:41.068143 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:41.069299 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:41.069299 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:41.069299 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:40:41.069299 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:40:41.069299 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:40:41.069299 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:40:41.069299 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:40:41.069299 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:40:41.069299 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 10:40:41.069299 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:41.070545 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:41.071736 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 338/659] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 10:40:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:41.072818 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4d41b-2a96-49fb-aec1-49f3e8c3513b None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:41.139055 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c613c27-7b0b-43f6-9080-bb34aea35e8a None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:41.174846 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e959ea-5eff-46d9-b723-6e95a050e1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:41.175549 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e959ea-5eff-46d9-b723-6e95a050e1ef None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:41.175826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e959ea-5eff-46d9-b723-6e95a050e1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:41.176102 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e959ea-5eff-46d9-b723-6e95a050e1ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:41.178151 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4d41b-2a96-49fb-aec1-49f3e8c3513b None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:41.216049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5eeea-8e05-4b41-88ee-6428569c2ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:41.217118 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5eeea-8e05-4b41-88ee-6428569c2ada None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:41.217582 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5eeea-8e05-4b41-88ee-6428569c2ada None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:41.218041 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5eeea-8e05-4b41-88ee-6428569c2ada None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:41.219334 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5eeea-8e05-4b41-88ee-6428569c2ada None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:41.219913 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5eeea-8e05-4b41-88ee-6428569c2ada None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:41.222295 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5eeea-8e05-4b41-88ee-6428569c2ada None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:41.239847 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 339/660] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:41.239847 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5eeea-8e05-4b41-88ee-6428569c2ada None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:41.254931 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e959ea-5eff-46d9-b723-6e95a050e1ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:41.256478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e959ea-5eff-46d9-b723-6e95a050e1ef None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:41.294862 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:41.308950 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:41.344953 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5eeea-8e05-4b41-88ee-6428569c2ada None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:41.374199 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 322/661] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:40:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:41.374199 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee27e1e-4447-4986-8701-da4e8187a598 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:41.374199 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee27e1e-4447-4986-8701-da4e8187a598 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:41.374199 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee27e1e-4447-4986-8701-da4e8187a598 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:41.378985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 323/662] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:41.378985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee27e1e-4447-4986-8701-da4e8187a598 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:41.382574 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9aabef-5c2b-41e8-9fe4-276c1f879330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:41.383321 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9aabef-5c2b-41e8-9fe4-276c1f879330 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:41.383609 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9aabef-5c2b-41e8-9fe4-276c1f879330 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:41.383888 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9aabef-5c2b-41e8-9fe4-276c1f879330 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:41.384747 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9aabef-5c2b-41e8-9fe4-276c1f879330 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:41.385060 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9aabef-5c2b-41e8-9fe4-276c1f879330 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:41.386520 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9aabef-5c2b-41e8-9fe4-276c1f879330 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:41.405950 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 340/663] 10.222.0.16 () {56 vars in 1139 bytes} [Fri Jun 24 10:40:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:41.406708 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9aabef-5c2b-41e8-9fe4-276c1f879330 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:41.488812 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee27e1e-4447-4986-8701-da4e8187a598 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:41.517605 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9aabef-5c2b-41e8-9fe4-276c1f879330 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:41.523316 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d0576-0280-4d8a-8292-2cd8f2e91d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:41.524122 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d0576-0280-4d8a-8292-2cd8f2e91d86 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:41.524402 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d0576-0280-4d8a-8292-2cd8f2e91d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:41.524673 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d0576-0280-4d8a-8292-2cd8f2e91d86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:41.531340 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d0576-0280-4d8a-8292-2cd8f2e91d86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:41.532782 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d0576-0280-4d8a-8292-2cd8f2e91d86 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:41.534086 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:41.547378 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-7b9d0576-0280-4d8a-8292-2cd8f2e91d86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:41.547378 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:41.547378 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:41.547378 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:41.547378 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:41.547378 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:41.547378 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:41.547378 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:41.547378 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:41.547378 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:41.547378 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:41.547378 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:41.547378 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:40:41.547378 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:40:41.547378 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:40:41.548284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:40:41.548284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:41.548284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:41.548284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:41.548284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:41.548284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:41.548284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:41.548284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:41.548284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:41.548284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:41.548284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:41.548284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:41.548284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:41.548284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:41.548284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:41.548284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:41.548284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:41.549169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:40:41.549169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:40:41.549169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:40:41.549169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:40:41.549169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:40:41.549169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:40:41.549169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:41.549169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:41.549169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 324/664] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:40:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:41.550235 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639a235-7e04-4ead-be96-79348a2ef3db None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:41.550235 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639a235-7e04-4ead-be96-79348a2ef3db None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:41.550235 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639a235-7e04-4ead-be96-79348a2ef3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:41.563855 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e85689-de5d-4b23-bf70-852f180f81cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:41.564668 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e85689-de5d-4b23-bf70-852f180f81cb None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:41.564951 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e85689-de5d-4b23-bf70-852f180f81cb None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:41.565227 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e85689-de5d-4b23-bf70-852f180f81cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:41.567437 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-d639a235-7e04-4ead-be96-79348a2ef3db None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:41.568660 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-d639a235-7e04-4ead-be96-79348a2ef3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:41.571131 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:41.576726 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e85689-de5d-4b23-bf70-852f180f81cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:41.578243 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e85689-de5d-4b23-bf70-852f180f81cb None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:41.596893 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-78e85689-de5d-4b23-bf70-852f180f81cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:41.596893 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:41.596893 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:41.596893 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:41.596893 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:41.596893 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:41.596893 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:41.596893 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:41.596893 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:41.596893 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:41.596893 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:41.596893 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:41.596893 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:41.596893 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:41.596893 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:41.598368 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:41.598368 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:41.598368 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:41.598368 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:41.598368 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:41.598368 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:41.598368 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:41.598368 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:41.598368 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:41.598368 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:41.598368 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:41.598368 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:41.598368 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:41.598368 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:41.598368 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:41.598368 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:41.598368 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:41.599307 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:41.599307 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:41.599307 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:41.599307 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:41.599307 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 341/665] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:41.599307 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e85689-de5d-4b23-bf70-852f180f81cb None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:41.651211 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 325/666] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:41.651211 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639a235-7e04-4ead-be96-79348a2ef3db None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:41.719758 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e85689-de5d-4b23-bf70-852f180f81cb None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:41.755903 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b94bf2-c8b1-4f6c-af5b-f62fdb52cecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:41.756655 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b94bf2-c8b1-4f6c-af5b-f62fdb52cecd None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:41.757000 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b94bf2-c8b1-4f6c-af5b-f62fdb52cecd None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:41.757343 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b94bf2-c8b1-4f6c-af5b-f62fdb52cecd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:41.762654 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639a235-7e04-4ead-be96-79348a2ef3db None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:41.794708 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:41.797443 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a245bd1-8807-4e21-a89a-f660f67c0450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:41.798175 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a245bd1-8807-4e21-a89a-f660f67c0450 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:41.798533 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a245bd1-8807-4e21-a89a-f660f67c0450 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:41.798881 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a245bd1-8807-4e21-a89a-f660f67c0450 None admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:41.799813 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a245bd1-8807-4e21-a89a-f660f67c0450 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:41.800222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a245bd1-8807-4e21-a89a-f660f67c0450 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:41.801788 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a245bd1-8807-4e21-a89a-f660f67c0450 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:41.809644 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:41.815421 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 326/667] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:40:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:41.816383 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a245bd1-8807-4e21-a89a-f660f67c0450 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:41.839834 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b94bf2-c8b1-4f6c-af5b-f62fdb52cecd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:41.841431 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b94bf2-c8b1-4f6c-af5b-f62fdb52cecd None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:41.919047 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a245bd1-8807-4e21-a89a-f660f67c0450 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:41.954438 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c6cf2-f493-4eb1-8a86-8242490adeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:41.955113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c6cf2-f493-4eb1-8a86-8242490adeaf None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:41.955443 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c6cf2-f493-4eb1-8a86-8242490adeaf None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:41.955720 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c6cf2-f493-4eb1-8a86-8242490adeaf None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:41.956451 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c6cf2-f493-4eb1-8a86-8242490adeaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:41.956759 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c6cf2-f493-4eb1-8a86-8242490adeaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:41.958128 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c6cf2-f493-4eb1-8a86-8242490adeaf None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:41.959793 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 342/668] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:40:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:41.960663 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b94bf2-c8b1-4f6c-af5b-f62fdb52cecd None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:41.971633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 327/669] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:41.972971 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c6cf2-f493-4eb1-8a86-8242490adeaf None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:42.036678 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:42.041291 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:42.077003 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b94bf2-c8b1-4f6c-af5b-f62fdb52cecd None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:42.089192 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c6cf2-f493-4eb1-8a86-8242490adeaf None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:42.112388 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350a663-0967-404d-a970-3e1494f4c2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:42.113539 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350a663-0967-404d-a970-3e1494f4c2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:42.113539 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350a663-0967-404d-a970-3e1494f4c2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:42.113739 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350a663-0967-404d-a970-3e1494f4c2d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:42.124088 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350a663-0967-404d-a970-3e1494f4c2d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:42.129380 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6a78d-08ae-4e12-9aef-24a6d1784340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:42.130056 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6a78d-08ae-4e12-9aef-24a6d1784340 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:42.130340 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6a78d-08ae-4e12-9aef-24a6d1784340 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:42.130619 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6a78d-08ae-4e12-9aef-24a6d1784340 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:42.131565 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef6a78d-08ae-4e12-9aef-24a6d1784340 None admin] RBAC: Adding query filter params (role.id=7bab53c1ac3d4e04b18c87286e2ab0aa, scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user.id=b2f6668cb6244bba9e547ff95b2e6f46) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:42.131849 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-3350a663-0967-404d-a970-3e1494f4c2d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:40:42.131849 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:42.131849 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:42.131849 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:42.131849 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:42.131849 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:42.131849 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:42.131849 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:42.131849 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:42.131849 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:42.131849 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:42.131849 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:42.131849 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:42.131849 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:42.131849 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:42.131849 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:42.132761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:42.132761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:42.132761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:42.132761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:42.132761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:42.132761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:42.132761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:42.132761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:42.132761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:42.132761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:42.132761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:42.132761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:42.132761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:42.132761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:42.132761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:42.132761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:42.133615 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:42.133615 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:42.133615 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:42.133615 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:42.133615 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:42.133615 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:42.133615 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:42.133615 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:42.133615 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:42.133615 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:42.133615 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:40:42.133615 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:42.134325 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef6a78d-08ae-4e12-9aef-24a6d1784340 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:42.134325 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef6a78d-08ae-4e12-9aef-24a6d1784340 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:42.138066 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 343/670] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 10:40:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:42.138927 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350a663-0967-404d-a970-3e1494f4c2d5 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:42.147505 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 328/671] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:40:41 2022] GET /identity/v3/role_assignments?user.id=b2f6668cb6244bba9e547ff95b2e6f46&scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e&role.id=7bab53c1ac3d4e04b18c87286e2ab0aa => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:42.147505 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6a78d-08ae-4e12-9aef-24a6d1784340 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:42.254661 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350a663-0967-404d-a970-3e1494f4c2d5 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:42.274683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6a78d-08ae-4e12-9aef-24a6d1784340 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:42.284468 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:42.296827 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa91f5-2c5e-45cd-be3a-9fc03107df80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:42.298104 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa91f5-2c5e-45cd-be3a-9fc03107df80 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:42.298403 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa91f5-2c5e-45cd-be3a-9fc03107df80 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:42.298686 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa91f5-2c5e-45cd-be3a-9fc03107df80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:42.310305 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:42.315072 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa91f5-2c5e-45cd-be3a-9fc03107df80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:42.316632 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa91f5-2c5e-45cd-be3a-9fc03107df80 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:42.317964 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127f4f0-e563-42de-9d19-fdc2be2ebd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:42.318876 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127f4f0-e563-42de-9d19-fdc2be2ebd1f None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:42.319427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127f4f0-e563-42de-9d19-fdc2be2ebd1f None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:42.319924 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127f4f0-e563-42de-9d19-fdc2be2ebd1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:42.330680 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127f4f0-e563-42de-9d19-fdc2be2ebd1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:42.332255 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127f4f0-e563-42de-9d19-fdc2be2ebd1f None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:42.343924 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-90fa91f5-2c5e-45cd-be3a-9fc03107df80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:42.343924 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:42.343924 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:42.343924 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:42.343924 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:42.343924 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:42.343924 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:42.343924 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:42.343924 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:42.343924 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:42.343924 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:42.343924 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:42.343924 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:42.343924 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:42.343924 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:42.344836 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:42.344836 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:42.344836 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:42.344836 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:42.344836 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:42.344836 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:42.344836 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:42.344836 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:42.344836 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:42.344836 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:42.344836 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:42.344836 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:42.344836 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:42.344836 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:42.344836 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:42.344836 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:42.344836 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:42.345797 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:42.345797 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:42.345797 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:42.345797 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:42.345797 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 344/672] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:42.346647 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-b127f4f0-e563-42de-9d19-fdc2be2ebd1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:42.346647 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:42.346647 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:42.346647 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:42.346647 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:42.346647 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:42.346647 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:42.346647 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:42.346647 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:42.346647 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:42.346647 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:42.346647 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:42.346647 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:40:42.346647 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:40:42.346647 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:40:42.347628 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:40:42.347628 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:42.347628 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:42.347628 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:42.347628 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:42.347628 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:42.347628 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:42.347628 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:42.347628 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:42.347628 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:42.347628 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:42.347628 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:42.347628 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:42.347628 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:42.347628 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:42.347628 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:42.347628 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:42.348883 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:40:42.348883 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:40:42.348883 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:40:42.348883 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:40:42.348883 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:40:42.348883 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:40:42.348883 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:42.348883 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:42.349851 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa91f5-2c5e-45cd-be3a-9fc03107df80 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:42.349992 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 329/673] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:40:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:42.349992 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5cfa8-676c-412f-ac98-1f401dbb90ec None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:42.349992 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5cfa8-676c-412f-ac98-1f401dbb90ec None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:42.349992 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5cfa8-676c-412f-ac98-1f401dbb90ec None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:42.351832 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 330/674] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:42.356231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5cfa8-676c-412f-ac98-1f401dbb90ec None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:42.467478 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa91f5-2c5e-45cd-be3a-9fc03107df80 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:42.471262 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5cfa8-676c-412f-ac98-1f401dbb90ec None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:42.503676 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842db52b-a5aa-4902-b171-8dbd3cd5b8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:42.504349 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842db52b-a5aa-4902-b171-8dbd3cd5b8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:42.504727 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842db52b-a5aa-4902-b171-8dbd3cd5b8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:42.504910 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842db52b-a5aa-4902-b171-8dbd3cd5b8b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:42.505670 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842db52b-a5aa-4902-b171-8dbd3cd5b8b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:42.505975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842db52b-a5aa-4902-b171-8dbd3cd5b8b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:42.507636 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842db52b-a5aa-4902-b171-8dbd3cd5b8b5 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:42.507761 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948a836-f816-4914-a646-1cc41515dc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:42.508614 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948a836-f816-4914-a646-1cc41515dc6a None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:42.508896 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948a836-f816-4914-a646-1cc41515dc6a None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:42.509368 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948a836-f816-4914-a646-1cc41515dc6a None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:42.510456 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3948a836-f816-4914-a646-1cc41515dc6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:42.510769 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3948a836-f816-4914-a646-1cc41515dc6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:42.512171 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3948a836-f816-4914-a646-1cc41515dc6a None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:42.521208 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 345/675] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 10:40:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:42.521208 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842db52b-a5aa-4902-b171-8dbd3cd5b8b5 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:42.530039 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 331/676] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:42.531268 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa9100-0902-4458-b9e0-c0debafd2141 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:42.531560 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa9100-0902-4458-b9e0-c0debafd2141 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:42.531834 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa9100-0902-4458-b9e0-c0debafd2141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:42.549354 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-a5fa9100-0902-4458-b9e0-c0debafd2141 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:42.550548 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-a5fa9100-0902-4458-b9e0-c0debafd2141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:42.568369 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:42.587709 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:42.629806 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842db52b-a5aa-4902-b171-8dbd3cd5b8b5 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:42.633025 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 332/677] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:42.636052 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa9100-0902-4458-b9e0-c0debafd2141 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:42.672653 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bf78b-220b-4626-aa34-a1733fe624d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:42.673601 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bf78b-220b-4626-aa34-a1733fe624d2 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:42.674017 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bf78b-220b-4626-aa34-a1733fe624d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:42.674437 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bf78b-220b-4626-aa34-a1733fe624d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:42.675465 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0bf78b-220b-4626-aa34-a1733fe624d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:42.675918 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0bf78b-220b-4626-aa34-a1733fe624d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:42.677387 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0bf78b-220b-4626-aa34-a1733fe624d2 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:42.691623 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 346/678] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:40:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:42.692847 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bf78b-220b-4626-aa34-a1733fe624d2 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:42.754923 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa9100-0902-4458-b9e0-c0debafd2141 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:42.790585 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b766f2-b8ac-4e6a-829d-8473eb00dd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:42.791521 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b766f2-b8ac-4e6a-829d-8473eb00dd7c None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:42.791803 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b766f2-b8ac-4e6a-829d-8473eb00dd7c None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:42.792076 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b766f2-b8ac-4e6a-829d-8473eb00dd7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:42.796352 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:42.799379 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bf78b-220b-4626-aa34-a1733fe624d2 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:42.804811 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b766f2-b8ac-4e6a-829d-8473eb00dd7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:42.806266 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b766f2-b8ac-4e6a-829d-8473eb00dd7c None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:42.825149 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-34b766f2-b8ac-4e6a-829d-8473eb00dd7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:42.825149 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:42.825149 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:42.825149 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:42.825149 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:42.825149 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:42.825149 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:42.825149 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:42.825149 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:42.825149 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:42.825149 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:42.825149 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:42.825149 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:42.825149 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:42.825149 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:42.826261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:42.826261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:42.826261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:42.826261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:42.826261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:42.826261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:42.826261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:42.826261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:42.826261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:42.826261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:42.826261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:42.826261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:42.826261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:42.826261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:42.826261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:42.826261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:42.826261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:42.827541 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:42.827541 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:42.827541 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:42.827541 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:42.827541 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 333/679] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:42.827541 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b766f2-b8ac-4e6a-829d-8473eb00dd7c None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:42.841132 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27079e57-57ee-4c21-83ce-6fad4af330b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:42.841926 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27079e57-57ee-4c21-83ce-6fad4af330b6 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:42.842198 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27079e57-57ee-4c21-83ce-6fad4af330b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:42.842481 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27079e57-57ee-4c21-83ce-6fad4af330b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:42.849750 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27079e57-57ee-4c21-83ce-6fad4af330b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:42.851349 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27079e57-57ee-4c21-83ce-6fad4af330b6 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:42.853610 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:42.866627 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-27079e57-57ee-4c21-83ce-6fad4af330b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:42.866627 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:42.866627 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:42.866627 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:42.866627 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:42.866627 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:42.866627 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:42.866627 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:42.866627 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:42.866627 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:42.866627 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:42.866627 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:42.866627 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:40:42.866627 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:40:42.866627 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:40:42.867621 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:40:42.867621 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:42.867621 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:42.867621 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:42.867621 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:42.867621 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:42.867621 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:42.867621 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:42.867621 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:42.867621 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:42.867621 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:42.867621 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:42.867621 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:42.867621 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:42.867621 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:42.867621 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:42.867621 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:42.868512 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:40:42.868512 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:40:42.868512 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:40:42.868512 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:40:42.868512 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:40:42.868512 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:40:42.868512 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:42.868512 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:42.872673 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 347/680] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:40:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:42.873309 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27079e57-57ee-4c21-83ce-6fad4af330b6 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:42.933900 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b766f2-b8ac-4e6a-829d-8473eb00dd7c None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:42.970356 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380712a7-4893-4747-a88a-1c15f50205b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:42.971253 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380712a7-4893-4747-a88a-1c15f50205b2 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:42.971534 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380712a7-4893-4747-a88a-1c15f50205b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:42.971804 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380712a7-4893-4747-a88a-1c15f50205b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:42.982688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380712a7-4893-4747-a88a-1c15f50205b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:42.989043 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27079e57-57ee-4c21-83ce-6fad4af330b6 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:42.990464 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-380712a7-4893-4747-a88a-1c15f50205b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:40:42.990464 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:42.990464 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:42.990464 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:42.990464 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:42.990464 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:42.990464 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:42.990464 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:42.990464 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:42.990464 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:42.990464 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:42.990464 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:42.990464 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:42.990464 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:42.990464 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:42.990464 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:42.991652 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:42.991652 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:42.991652 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:42.991652 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:42.991652 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:42.991652 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:42.991652 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:42.991652 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:42.991652 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:42.991652 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:42.991652 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:42.991652 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:42.991652 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:42.991652 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:42.991652 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:42.991652 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:42.992488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:42.992488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:42.992488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:42.992488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:42.992488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:42.992488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:42.992488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:42.992488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:42.992488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:42.992488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:42.992488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:40:42.992488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:42.992488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 334/681] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:40:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:42.992488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380712a7-4893-4747-a88a-1c15f50205b2 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:43.030983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13efd040-bc80-4314-a63b-16d483bcd32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:43.031614 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efd040-bc80-4314-a63b-16d483bcd32c None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:43.031899 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efd040-bc80-4314-a63b-16d483bcd32c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:43.032179 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efd040-bc80-4314-a63b-16d483bcd32c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:43.033013 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13efd040-bc80-4314-a63b-16d483bcd32c None admin] RBAC: Adding query filter params (role.id=7bab53c1ac3d4e04b18c87286e2ab0aa, scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user.id=fcba737e66244fe2b5b6ec3dd17dabd3) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:43.033328 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13efd040-bc80-4314-a63b-16d483bcd32c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:43.034760 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13efd040-bc80-4314-a63b-16d483bcd32c None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:43.051199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 348/682] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:40:42 2022] GET /identity/v3/role_assignments?user.id=fcba737e66244fe2b5b6ec3dd17dabd3&scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e&role.id=7bab53c1ac3d4e04b18c87286e2ab0aa => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:43.051199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13efd040-bc80-4314-a63b-16d483bcd32c None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:43.081921 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:43.121435 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:43.129829 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380712a7-4893-4747-a88a-1c15f50205b2 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:43.168354 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13efd040-bc80-4314-a63b-16d483bcd32c None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:43.170512 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf29a9-d419-4675-b034-47a4ab30a4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:43.171352 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf29a9-d419-4675-b034-47a4ab30a4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:43.171640 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf29a9-d419-4675-b034-47a4ab30a4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:43.171918 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf29a9-d419-4675-b034-47a4ab30a4f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:43.172671 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf29a9-d419-4675-b034-47a4ab30a4f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:43.172976 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf29a9-d419-4675-b034-47a4ab30a4f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:43.174399 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf29a9-d419-4675-b034-47a4ab30a4f0 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:43.189483 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 335/683] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:43.190374 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf29a9-d419-4675-b034-47a4ab30a4f0 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:43.213624 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbf213-7d1f-419b-8c3f-cf96ccf5d22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:43.214626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbf213-7d1f-419b-8c3f-cf96ccf5d22d None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:43.215120 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbf213-7d1f-419b-8c3f-cf96ccf5d22d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:43.215525 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbf213-7d1f-419b-8c3f-cf96ccf5d22d None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:43.216398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbf213-7d1f-419b-8c3f-cf96ccf5d22d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:43.216713 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbf213-7d1f-419b-8c3f-cf96ccf5d22d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:43.218166 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbf213-7d1f-419b-8c3f-cf96ccf5d22d None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:43.237723 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 349/684] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:40:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:43.238418 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbf213-7d1f-419b-8c3f-cf96ccf5d22d None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:43.326913 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf29a9-d419-4675-b034-47a4ab30a4f0 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:43.356972 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:43.370386 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2184c8-d6be-410c-97b2-a57ff2852e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:43.371113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2184c8-d6be-410c-97b2-a57ff2852e34 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:43.371446 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2184c8-d6be-410c-97b2-a57ff2852e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:43.371720 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2184c8-d6be-410c-97b2-a57ff2852e34 None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:43.372481 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2184c8-d6be-410c-97b2-a57ff2852e34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:43.372785 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2184c8-d6be-410c-97b2-a57ff2852e34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:43.373000 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbf213-7d1f-419b-8c3f-cf96ccf5d22d None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:43.374218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2184c8-d6be-410c-97b2-a57ff2852e34 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:43.383570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 336/685] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:40:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:43.384434 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2184c8-d6be-410c-97b2-a57ff2852e34 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:43.403536 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:43.414002 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd0427-5af7-47e1-87d4-4111f44ea056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:43.414839 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd0427-5af7-47e1-87d4-4111f44ea056 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:43.415128 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd0427-5af7-47e1-87d4-4111f44ea056 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:43.415447 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd0427-5af7-47e1-87d4-4111f44ea056 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:43.423604 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd0427-5af7-47e1-87d4-4111f44ea056 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:43.425594 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd0427-5af7-47e1-87d4-4111f44ea056 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:43.441585 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-7bdd0427-5af7-47e1-87d4-4111f44ea056 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 10:40:43.441585 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:43.441585 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:43.441585 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:43.441585 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:43.441585 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:43.441585 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:43.441585 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:43.441585 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:43.441585 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:43.441585 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:43.441585 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:43.441585 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:40:43.441585 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:40:43.441585 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:40:43.441585 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:40:43.442760 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:43.442760 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:43.442760 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:40:43.442760 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:43.442760 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:40:43.442760 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:43.442760 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:43.442760 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:43.442760 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:43.442760 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:43.442760 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:43.442760 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:43.442760 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:43.442760 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:43.442760 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:43.442760 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:43.442760 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:43.442760 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:43.443804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:43.443804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:43.443804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:40:43.443804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:40:43.443804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:40:43.443804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:40:43.443804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:40:43.443804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:40:43.443804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 10:40:43.443804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:43.447617 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 350/686] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:40:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:43.448487 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd0427-5af7-47e1-87d4-4111f44ea056 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:43.490979 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2184c8-d6be-410c-97b2-a57ff2852e34 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:43.535833 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0a425-c766-47db-8f16-e0baff5d73bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:43.536502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0a425-c766-47db-8f16-e0baff5d73bd None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:43.536781 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0a425-c766-47db-8f16-e0baff5d73bd None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:43.537052 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0a425-c766-47db-8f16-e0baff5d73bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:43.537978 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a0a425-c766-47db-8f16-e0baff5d73bd None admin] RBAC: Adding query filter params (role.id=7bab53c1ac3d4e04b18c87286e2ab0aa, scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user.id=9c20321abda7406c843b4ee691da2106) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:43.538312 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a0a425-c766-47db-8f16-e0baff5d73bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:43.539880 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a0a425-c766-47db-8f16-e0baff5d73bd None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:43.547050 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 337/687] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:40:43 2022] GET /identity/v3/role_assignments?user.id=9c20321abda7406c843b4ee691da2106&scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e&role.id=7bab53c1ac3d4e04b18c87286e2ab0aa => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:43.547961 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0a425-c766-47db-8f16-e0baff5d73bd None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:43.586202 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd0427-5af7-47e1-87d4-4111f44ea056 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:43.623719 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2f0d1-82a5-49a7-bbec-c5b763adc575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:43.624920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2f0d1-82a5-49a7-bbec-c5b763adc575 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:43.625432 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2f0d1-82a5-49a7-bbec-c5b763adc575 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:43.625907 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2f0d1-82a5-49a7-bbec-c5b763adc575 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:43.626419 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:43.637938 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2f0d1-82a5-49a7-bbec-c5b763adc575 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:43.640288 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2f0d1-82a5-49a7-bbec-c5b763adc575 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:43.643719 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:43.662223 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0a425-c766-47db-8f16-e0baff5d73bd None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:43.663398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-b0a2f0d1-82a5-49a7-bbec-c5b763adc575 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:43.663398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:43.663398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:43.663398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:43.663398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:43.663398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:43.663398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:43.663398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:43.663398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:43.663398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:43.663398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:43.663398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:43.663398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:43.663398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:43.663398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:43.664279 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:43.664279 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:43.664279 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:43.664279 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:43.664279 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:43.664279 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:43.664279 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:43.664279 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:43.664279 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:43.664279 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:43.664279 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:43.664279 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:43.664279 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:43.664279 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:43.664279 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:43.664279 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:43.664279 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:43.665194 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:43.665194 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:43.665194 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:43.665194 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:43.667583 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 351/688] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:43.680353 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2f0d1-82a5-49a7-bbec-c5b763adc575 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:43.699818 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f7b0c-4010-4eec-93af-dd9d58db7c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:43.700661 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f7b0c-4010-4eec-93af-dd9d58db7c5e None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:43.700844 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f7b0c-4010-4eec-93af-dd9d58db7c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:43.701095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f7b0c-4010-4eec-93af-dd9d58db7c5e None admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:43.702038 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f7b0c-4010-4eec-93af-dd9d58db7c5e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:43.702344 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f7b0c-4010-4eec-93af-dd9d58db7c5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:43.703829 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f7b0c-4010-4eec-93af-dd9d58db7c5e None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:43.732783 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 338/689] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Jun 24 10:40:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:43.738786 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f7b0c-4010-4eec-93af-dd9d58db7c5e None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:43.851443 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2f0d1-82a5-49a7-bbec-c5b763adc575 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:43.893795 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed154fc-5bbb-4bca-86ad-4b4c18314baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:43.894466 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed154fc-5bbb-4bca-86ad-4b4c18314baf None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:43.894749 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed154fc-5bbb-4bca-86ad-4b4c18314baf None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:43.895025 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed154fc-5bbb-4bca-86ad-4b4c18314baf None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:43.895796 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed154fc-5bbb-4bca-86ad-4b4c18314baf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:43.896101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed154fc-5bbb-4bca-86ad-4b4c18314baf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:43.897540 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed154fc-5bbb-4bca-86ad-4b4c18314baf None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:43.909682 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 352/690] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:43.911035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f7b0c-4010-4eec-93af-dd9d58db7c5e None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:43.915372 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed154fc-5bbb-4bca-86ad-4b4c18314baf None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:43.941978 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:43.950532 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680463f3-aabc-4747-95ef-4f1ceb07cca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:43.951402 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680463f3-aabc-4747-95ef-4f1ceb07cca0 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:43.951758 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680463f3-aabc-4747-95ef-4f1ceb07cca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:43.952112 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680463f3-aabc-4747-95ef-4f1ceb07cca0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:43.979484 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:44.027575 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed154fc-5bbb-4bca-86ad-4b4c18314baf None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:44.029679 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680463f3-aabc-4747-95ef-4f1ceb07cca0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:44.031352 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680463f3-aabc-4747-95ef-4f1ceb07cca0 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:44.063355 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e1ee7-2a2c-4ee8-9016-1eb69e7f5c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:44.064309 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e1ee7-2a2c-4ee8-9016-1eb69e7f5c9e None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:44.064688 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e1ee7-2a2c-4ee8-9016-1eb69e7f5c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:44.065060 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e1ee7-2a2c-4ee8-9016-1eb69e7f5c9e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:44.073447 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e1ee7-2a2c-4ee8-9016-1eb69e7f5c9e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:44.075021 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e1ee7-2a2c-4ee8-9016-1eb69e7f5c9e None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:44.091486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-ce4e1ee7-2a2c-4ee8-9016-1eb69e7f5c9e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:40:44.091486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:44.091486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:44.091486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:44.091486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:44.091486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:44.091486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:44.091486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:44.091486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:44.091486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:44.091486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:44.091486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:44.091486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:40:44.091486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:40:44.091486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:40:44.091486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:40:44.092843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:44.092843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:44.092843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:40:44.092843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:44.092843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:40:44.092843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:44.092843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:44.092843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:44.092843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:44.092843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:44.092843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:44.092843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:44.092843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:44.092843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:44.092843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:44.092843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:44.092843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:44.092843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:44.094058 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:44.094058 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:44.094058 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:40:44.094058 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:40:44.094058 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:40:44.094058 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:40:44.094058 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:40:44.094058 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:40:44.094058 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:40:44.094058 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:44.095754 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 353/691] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Jun 24 10:40:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:44.108262 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e1ee7-2a2c-4ee8-9016-1eb69e7f5c9e None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:44.153016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 339/692] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:40:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:44.154608 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680463f3-aabc-4747-95ef-4f1ceb07cca0 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:44.184229 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:44.271747 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e1ee7-2a2c-4ee8-9016-1eb69e7f5c9e None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:44.295472 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680463f3-aabc-4747-95ef-4f1ceb07cca0 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:44.296150 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:44.307404 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c30068-f1c5-43fa-8f3b-5a39814d87e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:44.308329 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c30068-f1c5-43fa-8f3b-5a39814d87e2 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:44.308618 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c30068-f1c5-43fa-8f3b-5a39814d87e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:44.308897 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c30068-f1c5-43fa-8f3b-5a39814d87e2 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:44.309752 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c30068-f1c5-43fa-8f3b-5a39814d87e2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:44.310067 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c30068-f1c5-43fa-8f3b-5a39814d87e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:44.311567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c30068-f1c5-43fa-8f3b-5a39814d87e2 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:44.331036 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 354/693] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jun 24 10:40:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:44.332409 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83985f-671a-4363-a59a-472e3951c752 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:44.332699 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83985f-671a-4363-a59a-472e3951c752 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:44.333086 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83985f-671a-4363-a59a-472e3951c752 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:44.334657 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 355/694] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:44.339817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83985f-671a-4363-a59a-472e3951c752 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:44.350376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96762631-0860-481f-b1af-9847faafb155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:44.351213 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96762631-0860-481f-b1af-9847faafb155 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:44.351501 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96762631-0860-481f-b1af-9847faafb155 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:44.351779 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96762631-0860-481f-b1af-9847faafb155 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:44.362284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96762631-0860-481f-b1af-9847faafb155 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:44.363706 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96762631-0860-481f-b1af-9847faafb155 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:44.381801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-96762631-0860-481f-b1af-9847faafb155 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:44.381801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:44.381801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:44.381801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:44.381801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:44.381801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:44.381801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:44.381801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:44.381801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:44.381801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:44.381801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:44.381801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:44.381801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:44.381801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:44.381801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:44.382821 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:44.382821 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:44.382821 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:44.382821 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:44.382821 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:44.382821 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:44.382821 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:44.382821 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:44.382821 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:44.382821 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:44.382821 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:44.382821 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:44.382821 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:44.382821 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:44.382821 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:44.382821 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:44.382821 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:44.383961 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:44.383961 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:44.383961 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:44.383961 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:44.383961 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 340/695] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:40:44.384829 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363862d-0e99-455d-9c30-facd85e3df57 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:44.385116 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363862d-0e99-455d-9c30-facd85e3df57 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:44.385389 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363862d-0e99-455d-9c30-facd85e3df57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:44.402696 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-5363862d-0e99-455d-9c30-facd85e3df57 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:44.403917 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-5363862d-0e99-455d-9c30-facd85e3df57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:44.450359 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83985f-671a-4363-a59a-472e3951c752 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:44.487028 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff2583-fb6d-48c6-b545-4d2cff7b11c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:44.487764 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff2583-fb6d-48c6-b545-4d2cff7b11c3 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:44.488171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff2583-fb6d-48c6-b545-4d2cff7b11c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:44.488738 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff2583-fb6d-48c6-b545-4d2cff7b11c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:44.501976 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 341/696] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:44.503316 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363862d-0e99-455d-9c30-facd85e3df57 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:44.518428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:44.571524 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:44.587521 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff2583-fb6d-48c6-b545-4d2cff7b11c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:44.588983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff2583-fb6d-48c6-b545-4d2cff7b11c3 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:44.637652 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363862d-0e99-455d-9c30-facd85e3df57 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:44.683488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6258e29-1911-4fa4-97b5-eef3bad2bbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:44.684741 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6258e29-1911-4fa4-97b5-eef3bad2bbc4 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:44.685206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6258e29-1911-4fa4-97b5-eef3bad2bbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:44.685837 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6258e29-1911-4fa4-97b5-eef3bad2bbc4 None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:44.687061 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6258e29-1911-4fa4-97b5-eef3bad2bbc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:44.688164 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6258e29-1911-4fa4-97b5-eef3bad2bbc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:44.690181 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6258e29-1911-4fa4-97b5-eef3bad2bbc4 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:44.693567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 356/697] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:40:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:44.694953 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff2583-fb6d-48c6-b545-4d2cff7b11c3 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:44.711596 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 342/698] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:44.712678 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6258e29-1911-4fa4-97b5-eef3bad2bbc4 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:44.796040 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:44.819646 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:44.830100 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff2583-fb6d-48c6-b545-4d2cff7b11c3 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:44.834539 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6258e29-1911-4fa4-97b5-eef3bad2bbc4 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:44.872356 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71df945-ed7d-4e08-85a5-00d1ed8dbb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:44.873432 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71df945-ed7d-4e08-85a5-00d1ed8dbb27 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:44.873860 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71df945-ed7d-4e08-85a5-00d1ed8dbb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:44.874277 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71df945-ed7d-4e08-85a5-00d1ed8dbb27 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:44.874513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee23dc2-ca17-4c46-ab80-323c7104167b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:44.875308 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71df945-ed7d-4e08-85a5-00d1ed8dbb27 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:44.875540 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee23dc2-ca17-4c46-ab80-323c7104167b None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:44.875929 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee23dc2-ca17-4c46-ab80-323c7104167b None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:44.876293 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee23dc2-ca17-4c46-ab80-323c7104167b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:44.877326 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71df945-ed7d-4e08-85a5-00d1ed8dbb27 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:44.888251 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee23dc2-ca17-4c46-ab80-323c7104167b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:44.889762 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee23dc2-ca17-4c46-ab80-323c7104167b None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:44.894384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-a71df945-ed7d-4e08-85a5-00d1ed8dbb27 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 10:40:44.894384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:44.894384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:40:44.894384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:40:44.894384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:40:44.894384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:40:44.894384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:40:44.894384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:40:44.894384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 10:40:44.894384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:44.894384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:40:44.894384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:44.894384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:44.894384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:44.894384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:44.894384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:44.895639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:44.895639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:44.895639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:44.895639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:44.895639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:44.895639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:44.895639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:44.895639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:40:44.895639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:40:44.895639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:40:44.895639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:40:44.895639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:44.895639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:44.895639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:44.895639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:44.895639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:44.896716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:44.896716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:44.896716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:44.896716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:44.896716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:44.896716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:44.896716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:44.896716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:44.896716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:44.896716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:44.896716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:44.896716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:40:44.896716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:40:44.896716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 10:40:44.896716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:44.900255 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 357/699] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jun 24 10:40:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:44.901218 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71df945-ed7d-4e08-85a5-00d1ed8dbb27 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:44.917912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-5ee23dc2-ca17-4c46-ab80-323c7104167b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:44.917912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:44.917912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:44.917912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:44.917912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:44.917912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:44.917912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:44.917912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:44.917912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:44.917912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:44.917912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:44.917912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:44.917912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:44.917912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:44.917912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:44.919428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:44.919428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:44.919428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:44.919428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:44.919428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:44.919428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:44.919428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:44.919428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:44.919428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:44.919428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:44.919428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:44.919428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:44.919428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:44.919428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:44.919428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:44.919428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:44.919428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:44.920544 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:44.920544 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:44.920544 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:44.920544 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:44.921366 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 343/700] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:44.922385 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee23dc2-ca17-4c46-ab80-323c7104167b None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:45.027243 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71df945-ed7d-4e08-85a5-00d1ed8dbb27 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:45.055957 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee23dc2-ca17-4c46-ab80-323c7104167b None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:45.062577 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c387d6d-e050-4878-a092-ff4e3117042d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:45.063976 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c387d6d-e050-4878-a092-ff4e3117042d None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:45.064405 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c387d6d-e050-4878-a092-ff4e3117042d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:45.064823 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c387d6d-e050-4878-a092-ff4e3117042d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:45.072360 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c387d6d-e050-4878-a092-ff4e3117042d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:45.074023 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c387d6d-e050-4878-a092-ff4e3117042d None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:45.076088 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:45.091637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-2c387d6d-e050-4878-a092-ff4e3117042d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:45.091637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:45.091637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:45.091637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:45.091637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:45.091637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:45.091637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:45.091637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:45.091637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:45.091637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:45.091637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:45.091637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:45.091637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:40:45.091637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:40:45.091637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:40:45.092761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:40:45.092761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:45.092761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:45.092761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:45.092761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:45.092761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:45.092761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:45.092761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:45.092761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:45.092761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:45.092761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:45.092761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:45.092761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:45.092761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:45.092761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:45.092761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:45.092761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:45.094024 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:40:45.094024 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:40:45.094024 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:40:45.094024 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:40:45.094024 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:40:45.094024 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:40:45.094024 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:45.094024 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:45.094460 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:45.099815 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 358/701] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:40:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:45.099815 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c387d6d-e050-4878-a092-ff4e3117042d None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:45.100064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7eb7eb-1cc6-4d49-a537-4caf24c883e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:45.100064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7eb7eb-1cc6-4d49-a537-4caf24c883e7 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:45.100654 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7eb7eb-1cc6-4d49-a537-4caf24c883e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:45.100654 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7eb7eb-1cc6-4d49-a537-4caf24c883e7 None admin] PATH_INFO: `/v3/services` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:45.101371 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7eb7eb-1cc6-4d49-a537-4caf24c883e7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:45.103695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7eb7eb-1cc6-4d49-a537-4caf24c883e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:45.105430 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7eb7eb-1cc6-4d49-a537-4caf24c883e7 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:45.115358 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 344/702] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jun 24 10:40:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:45.116823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7eb7eb-1cc6-4d49-a537-4caf24c883e7 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:45.228447 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c387d6d-e050-4878-a092-ff4e3117042d None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:45.230259 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7eb7eb-1cc6-4d49-a537-4caf24c883e7 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:45.267391 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb17877-d5b3-42ed-9fe5-e58db6854a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:45.268360 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb17877-d5b3-42ed-9fe5-e58db6854a68 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:45.268789 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb17877-d5b3-42ed-9fe5-e58db6854a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:45.269197 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb17877-d5b3-42ed-9fe5-e58db6854a68 None admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:45.270131 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb17877-d5b3-42ed-9fe5-e58db6854a68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:45.270320 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a842ef6-750b-4bae-87ae-8b0f98a7af46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:45.270761 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb17877-d5b3-42ed-9fe5-e58db6854a68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:45.270992 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a842ef6-750b-4bae-87ae-8b0f98a7af46 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:45.271306 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a842ef6-750b-4bae-87ae-8b0f98a7af46 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:45.271587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a842ef6-750b-4bae-87ae-8b0f98a7af46 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:45.272592 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a842ef6-750b-4bae-87ae-8b0f98a7af46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:45.272904 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a842ef6-750b-4bae-87ae-8b0f98a7af46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:45.273371 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb17877-d5b3-42ed-9fe5-e58db6854a68 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:45.274278 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a842ef6-750b-4bae-87ae-8b0f98a7af46 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:45.292272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 359/704] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:45.292272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a842ef6-750b-4bae-87ae-8b0f98a7af46 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:45.292772 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 345/704] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:40:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:45.296188 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb17877-d5b3-42ed-9fe5-e58db6854a68 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:45.356708 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:45.360431 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:45.407428 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a842ef6-750b-4bae-87ae-8b0f98a7af46 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:45.432977 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb17877-d5b3-42ed-9fe5-e58db6854a68 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:45.443265 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606af9d-3996-4ce9-921f-63dcf2f48c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:45.444198 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606af9d-3996-4ce9-921f-63dcf2f48c45 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:45.444631 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606af9d-3996-4ce9-921f-63dcf2f48c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:45.445051 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606af9d-3996-4ce9-921f-63dcf2f48c45 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:45.445915 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1606af9d-3996-4ce9-921f-63dcf2f48c45 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:45.446393 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1606af9d-3996-4ce9-921f-63dcf2f48c45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:45.448043 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1606af9d-3996-4ce9-921f-63dcf2f48c45 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:45.454002 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 360/705] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jun 24 10:40:45 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:45.455032 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606af9d-3996-4ce9-921f-63dcf2f48c45 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:45.480344 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3fb84-a82c-40c3-87ef-642b0eafa64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:45.481106 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3fb84-a82c-40c3-87ef-642b0eafa64a None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:45.481395 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3fb84-a82c-40c3-87ef-642b0eafa64a None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:45.481690 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3fb84-a82c-40c3-87ef-642b0eafa64a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:45.492530 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3fb84-a82c-40c3-87ef-642b0eafa64a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:45.494329 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3fb84-a82c-40c3-87ef-642b0eafa64a None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:45.513799 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-aad3fb84-a82c-40c3-87ef-642b0eafa64a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:45.513799 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:45.513799 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:45.513799 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:45.513799 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:45.513799 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:45.513799 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:45.513799 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:45.513799 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:45.513799 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:45.513799 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:45.513799 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:45.513799 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:40:45.513799 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:40:45.513799 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:40:45.514935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:40:45.514935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:45.514935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:45.514935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:45.514935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:45.514935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:45.514935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:45.514935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:45.514935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:45.514935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:45.514935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:45.514935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:45.514935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:45.514935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:45.514935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:45.514935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:45.514935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:45.515985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:40:45.515985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:40:45.515985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:40:45.515985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:40:45.515985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:40:45.515985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:40:45.515985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:45.515985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:45.520290 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 346/706] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:40:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:45.522263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17505e-db1e-442b-9cdb-7e1923fd6a71 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:45.522557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17505e-db1e-442b-9cdb-7e1923fd6a71 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:45.522832 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17505e-db1e-442b-9cdb-7e1923fd6a71 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:45.527981 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 347/707] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:45.530425 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17505e-db1e-442b-9cdb-7e1923fd6a71 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:45.590870 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606af9d-3996-4ce9-921f-63dcf2f48c45 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:45.617454 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:45.633387 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c627474-e521-456e-bd77-3771f47ee29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:45.634815 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c627474-e521-456e-bd77-3771f47ee29f None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:45.635106 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c627474-e521-456e-bd77-3771f47ee29f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:45.635430 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c627474-e521-456e-bd77-3771f47ee29f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:45.636283 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c627474-e521-456e-bd77-3771f47ee29f None admin] RBAC: Adding query filter params (role.id=7bab53c1ac3d4e04b18c87286e2ab0aa, scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user.id=ff592d9ebd4241019625828ddd41aee8) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:45.636602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c627474-e521-456e-bd77-3771f47ee29f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:45.638087 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c627474-e521-456e-bd77-3771f47ee29f None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:45.647332 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 361/708] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:40:45 2022] GET /identity/v3/role_assignments?user.id=ff592d9ebd4241019625828ddd41aee8&scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e&role.id=7bab53c1ac3d4e04b18c87286e2ab0aa => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:45.648836 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e932d7-dfa6-4a40-8235-80e3d8cf7e26 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:45.649131 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e932d7-dfa6-4a40-8235-80e3d8cf7e26 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:45.649414 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e932d7-dfa6-4a40-8235-80e3d8cf7e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:45.669602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-c1e932d7-dfa6-4a40-8235-80e3d8cf7e26 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:45.671502 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c1e932d7-dfa6-4a40-8235-80e3d8cf7e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:45.676803 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17505e-db1e-442b-9cdb-7e1923fd6a71 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:45.686892 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:45.725365 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9af221-b7a1-4519-a1c4-79beb294b9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:45.726714 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9af221-b7a1-4519-a1c4-79beb294b9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:45.727089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9af221-b7a1-4519-a1c4-79beb294b9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:45.727491 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9af221-b7a1-4519-a1c4-79beb294b9e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:45.728412 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9af221-b7a1-4519-a1c4-79beb294b9e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:45.728812 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9af221-b7a1-4519-a1c4-79beb294b9e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:45.731255 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9af221-b7a1-4519-a1c4-79beb294b9e8 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:45.751267 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 348/709] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:40:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:45.754916 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9af221-b7a1-4519-a1c4-79beb294b9e8 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:45.763170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 362/710] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:45.801091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e932d7-dfa6-4a40-8235-80e3d8cf7e26 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:45.906296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9af221-b7a1-4519-a1c4-79beb294b9e8 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:45.943020 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e932d7-dfa6-4a40-8235-80e3d8cf7e26 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:45.945323 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e6832-8472-46eb-a0d3-dc2c2282642e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:45.946005 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e6832-8472-46eb-a0d3-dc2c2282642e None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:45.946287 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e6832-8472-46eb-a0d3-dc2c2282642e None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:45.946563 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e6832-8472-46eb-a0d3-dc2c2282642e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:45.948091 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e6832-8472-46eb-a0d3-dc2c2282642e None admin] RBAC: Adding query filter params (role.id=4867b69c45554ce18e23167c05a02175, scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user.id=e8034bad51144002a7386c975e412992) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:45.948091 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e6832-8472-46eb-a0d3-dc2c2282642e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:45.949330 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e6832-8472-46eb-a0d3-dc2c2282642e None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:45.955995 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 349/711] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:40:45 2022] GET /identity/v3/role_assignments?user.id=e8034bad51144002a7386c975e412992&scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e&role.id=4867b69c45554ce18e23167c05a02175 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:45.973740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:45.985849 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c41b0c-e485-41d9-9f4b-a72ca8b1d7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:45.987103 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c41b0c-e485-41d9-9f4b-a72ca8b1d7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:45.987596 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c41b0c-e485-41d9-9f4b-a72ca8b1d7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:45.988074 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c41b0c-e485-41d9-9f4b-a72ca8b1d7f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:46.000850 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c41b0c-e485-41d9-9f4b-a72ca8b1d7f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:46.002691 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c41b0c-e485-41d9-9f4b-a72ca8b1d7f6 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:46.029827 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-53c41b0c-e485-41d9-9f4b-a72ca8b1d7f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:46.029827 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:46.029827 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:46.029827 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:46.029827 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:46.029827 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:46.029827 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:46.029827 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:46.029827 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:46.029827 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:46.029827 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:46.029827 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:46.029827 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:46.029827 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:46.029827 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:46.030867 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:46.030867 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:46.030867 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:46.030867 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:46.030867 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:46.030867 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:46.030867 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:46.030867 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:46.030867 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:46.030867 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:46.030867 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:46.030867 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:46.030867 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:46.030867 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:46.030867 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:46.030867 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:46.030867 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:46.031919 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:46.031919 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:46.031919 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:46.031919 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:46.034041 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 363/712] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:46.040037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e6832-8472-46eb-a0d3-dc2c2282642e None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:46.080884 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:46.151377 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f264a2c-dcaf-4e6b-89f8-59fc0b8947a1 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:46.152285 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f264a2c-dcaf-4e6b-89f8-59fc0b8947a1 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:46.152772 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f264a2c-dcaf-4e6b-89f8-59fc0b8947a1 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:46.156639 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e6832-8472-46eb-a0d3-dc2c2282642e None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:46.156923 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 364/713] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:40:46.160301 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a162a2e-6f58-4675-8ed1-b95598ff9a15 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:46.160583 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a162a2e-6f58-4675-8ed1-b95598ff9a15 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:46.160854 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a162a2e-6f58-4675-8ed1-b95598ff9a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:46.183382 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-2a162a2e-6f58-4675-8ed1-b95598ff9a15 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:46.184582 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-2a162a2e-6f58-4675-8ed1-b95598ff9a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:46.198619 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc374b1-38d0-4639-9f7e-85cace05cd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:46.200401 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc374b1-38d0-4639-9f7e-85cace05cd83 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:46.200874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc374b1-38d0-4639-9f7e-85cace05cd83 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:46.201355 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc374b1-38d0-4639-9f7e-85cace05cd83 None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:46.202554 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc374b1-38d0-4639-9f7e-85cace05cd83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:46.203514 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc374b1-38d0-4639-9f7e-85cace05cd83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:46.205609 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc374b1-38d0-4639-9f7e-85cace05cd83 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:46.222964 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 350/714] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:46.230176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc374b1-38d0-4639-9f7e-85cace05cd83 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:46.263009 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 365/715] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:40:46.285999 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a162a2e-6f58-4675-8ed1-b95598ff9a15 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:46.383533 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:46.391366 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc374b1-38d0-4639-9f7e-85cace05cd83 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:46.398941 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:46.403629 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a162a2e-6f58-4675-8ed1-b95598ff9a15 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:46.441734 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f87634-f442-4f31-b67b-4c9b9c19adf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:46.442798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f87634-f442-4f31-b67b-4c9b9c19adf4 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:46.443270 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f87634-f442-4f31-b67b-4c9b9c19adf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:46.443685 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f87634-f442-4f31-b67b-4c9b9c19adf4 None admin] PATH_INFO: `/v3/services/network` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:46.445245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f87634-f442-4f31-b67b-4c9b9c19adf4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:46.446776 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f87634-f442-4f31-b67b-4c9b9c19adf4 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:46.447708 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b20278-8d71-4f44-84eb-2a82bb1fac11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:46.448402 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b20278-8d71-4f44-84eb-2a82bb1fac11 None admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:46.448692 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b20278-8d71-4f44-84eb-2a82bb1fac11 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:46.448974 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b20278-8d71-4f44-84eb-2a82bb1fac11 None admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:46.449691 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b20278-8d71-4f44-84eb-2a82bb1fac11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:46.451121 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b20278-8d71-4f44-84eb-2a82bb1fac11 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:46.460833 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-09f87634-f442-4f31-b67b-4c9b9c19adf4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 10:40:46.460833 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:46.460833 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:40:46.460833 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:40:46.460833 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:40:46.460833 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:40:46.460833 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:40:46.460833 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:40:46.460833 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 10:40:46.460833 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:46.460833 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:40:46.460833 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:46.460833 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:46.460833 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:46.460833 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:46.460833 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:46.460833 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:46.462098 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:46.462098 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:46.462098 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:46.462098 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:46.462098 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:46.462098 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:46.462098 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:40:46.462098 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:40:46.462098 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:40:46.462098 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:40:46.462098 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:46.462098 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:46.462098 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:46.462098 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:46.462098 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:46.462098 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:46.463138 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:46.463138 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:46.463138 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:46.463138 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:46.463138 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:46.463138 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:46.463138 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:46.463138 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:46.463138 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:46.463138 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:46.463138 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:40:46.463138 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:40:46.463138 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 10:40:46.463138 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:46.465495 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 366/716] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:40:46 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:40:46.471360 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f87634-f442-4f31-b67b-4c9b9c19adf4 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:46.512434 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 351/717] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 10:40:46 2022] POST /identity/v3/users => generated 254 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:40:46.589239 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f87634-f442-4f31-b67b-4c9b9c19adf4 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:46.629892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53e1b5-e92a-4538-bc0a-2cd58572c48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:46.630888 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53e1b5-e92a-4538-bc0a-2cd58572c48d None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:46.631502 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53e1b5-e92a-4538-bc0a-2cd58572c48d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:46.632564 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53e1b5-e92a-4538-bc0a-2cd58572c48d None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:46.633445 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53e1b5-e92a-4538-bc0a-2cd58572c48d None admin] RBAC: Adding query filter params (name=network) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:46.633895 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53e1b5-e92a-4538-bc0a-2cd58572c48d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:46.635462 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53e1b5-e92a-4538-bc0a-2cd58572c48d None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:46.641260 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 367/718] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jun 24 10:40:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:40:46.647505 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b20278-8d71-4f44-84eb-2a82bb1fac11 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:46.785358 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b20278-8d71-4f44-84eb-2a82bb1fac11 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:46.821786 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5dd2f2-bfd1-4bee-8b56-115a60eeff27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:46.822465 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5dd2f2-bfd1-4bee-8b56-115a60eeff27 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:46.822750 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5dd2f2-bfd1-4bee-8b56-115a60eeff27 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:46.823022 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5dd2f2-bfd1-4bee-8b56-115a60eeff27 None admin] PATH_INFO: `/v3/services` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:46.823778 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5dd2f2-bfd1-4bee-8b56-115a60eeff27 None admin] RBAC: Adding query filter params (type=network) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:46.824078 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5dd2f2-bfd1-4bee-8b56-115a60eeff27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:46.825454 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5dd2f2-bfd1-4bee-8b56-115a60eeff27 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:46.831636 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 352/719] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jun 24 10:40:46 2022] GET /identity/v3/services?type=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:48.094211 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b50f7b-9918-47d5-9d64-4cf292986b60 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:48.094722 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b50f7b-9918-47d5-9d64-4cf292986b60 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:48.094799 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b50f7b-9918-47d5-9d64-4cf292986b60 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:48.096395 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 368/720] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:48.101920 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6946d-cd1d-4713-a21d-c3ee60bff768 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:48.102359 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6946d-cd1d-4713-a21d-c3ee60bff768 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:48.102574 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6946d-cd1d-4713-a21d-c3ee60bff768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:48.128156 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-90f6946d-cd1d-4713-a21d-c3ee60bff768 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:48.129376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-90f6946d-cd1d-4713-a21d-c3ee60bff768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:48.132499 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:48.225965 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 353/721] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:40:48.260184 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133af059-750f-4971-b45b-545ae6e3ff7a None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:48.260812 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133af059-750f-4971-b45b-545ae6e3ff7a None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:48.261516 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133af059-750f-4971-b45b-545ae6e3ff7a None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:48.262192 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f6946d-cd1d-4713-a21d-c3ee60bff768 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:48.263550 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 369/722] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:48.269034 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c160205-8fb7-4e26-8682-614a000d4b59 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:48.269612 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c160205-8fb7-4e26-8682-614a000d4b59 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:48.270102 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c160205-8fb7-4e26-8682-614a000d4b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:48.295991 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-2c160205-8fb7-4e26-8682-614a000d4b59 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:48.300732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-2c160205-8fb7-4e26-8682-614a000d4b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:48.342311 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:48.395206 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 370/723] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:40:48.421692 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c160205-8fb7-4e26-8682-614a000d4b59 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:48.471672 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f6946d-cd1d-4713-a21d-c3ee60bff768 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:48.509049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96533dc2-f9e4-4338-be39-58bde72bd437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:48.509731 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96533dc2-f9e4-4338-be39-58bde72bd437 None admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:48.510014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96533dc2-f9e4-4338-be39-58bde72bd437 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:48.510293 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96533dc2-f9e4-4338-be39-58bde72bd437 None admin] PATH_INFO: `/v3/services` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:48.511046 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96533dc2-f9e4-4338-be39-58bde72bd437 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:48.512591 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96533dc2-f9e4-4338-be39-58bde72bd437 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:48.527895 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:48.536293 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 354/724] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jun 24 10:40:48 2022] POST /identity/v3/services => generated 251 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:40:48.543176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139c110-1e89-458f-9721-72e07bfb5c0f None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:48.543176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139c110-1e89-458f-9721-72e07bfb5c0f None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:48.543176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139c110-1e89-458f-9721-72e07bfb5c0f None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:48.543176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 355/725] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:48.557488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a8889-bd58-4c19-8f58-f9039b4a33cb None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:48.557815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a8889-bd58-4c19-8f58-f9039b4a33cb None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:48.558048 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a8889-bd58-4c19-8f58-f9039b4a33cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:48.594428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-539a8889-bd58-4c19-8f58-f9039b4a33cb None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:48.597187 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-539a8889-bd58-4c19-8f58-f9039b4a33cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:48.600639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c160205-8fb7-4e26-8682-614a000d4b59 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:48.666501 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc147324-7fb4-4d6c-a3ab-86fb35b22173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:48.668190 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc147324-7fb4-4d6c-a3ab-86fb35b22173 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:48.668490 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc147324-7fb4-4d6c-a3ab-86fb35b22173 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:48.668773 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc147324-7fb4-4d6c-a3ab-86fb35b22173 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:48.695675 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc147324-7fb4-4d6c-a3ab-86fb35b22173 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:48.707554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-cc147324-7fb4-4d6c-a3ab-86fb35b22173 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:40:48.707554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:48.707554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:48.707554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:48.707554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:48.707554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:48.707554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:48.707554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:48.707554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:48.707554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:48.707554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:48.707554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:48.707554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:48.707554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:48.707554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:48.707554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:48.708572 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:48.708572 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:48.708572 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:48.708572 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:48.708572 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:48.708572 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:48.708572 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:48.708572 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:48.708572 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:48.708572 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:48.708572 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:48.708572 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:48.708572 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:48.708572 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:48.708572 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:48.708572 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:48.709463 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:48.709463 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:48.709463 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:48.709463 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:48.709463 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:48.709463 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:48.709463 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:48.709463 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:48.709463 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:48.709463 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:48.709463 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:40:48.709463 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:48.712733 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 371/726] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:40:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:40:48.724532 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc147324-7fb4-4d6c-a3ab-86fb35b22173 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:48.742817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:48.744820 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 356/727] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:48 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:40:48.768456 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a8889-bd58-4c19-8f58-f9039b4a33cb None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:48.853865 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc147324-7fb4-4d6c-a3ab-86fb35b22173 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:48.892807 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a8889-bd58-4c19-8f58-f9039b4a33cb None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:48.900845 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c3eda-9a17-48a8-81ba-f0de59d186ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:48.901643 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c3eda-9a17-48a8-81ba-f0de59d186ce None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:48.901934 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c3eda-9a17-48a8-81ba-f0de59d186ce None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:48.902213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c3eda-9a17-48a8-81ba-f0de59d186ce None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:48.903056 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c3eda-9a17-48a8-81ba-f0de59d186ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:48.903314 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c3eda-9a17-48a8-81ba-f0de59d186ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:48.904817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c3eda-9a17-48a8-81ba-f0de59d186ce None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:48.920249 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 372/728] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:40:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:48.925627 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c3eda-9a17-48a8-81ba-f0de59d186ce None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:48.931630 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:48.940051 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f130e9-12ef-4dfd-a7c2-d31d71dbcc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:48.941068 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f130e9-12ef-4dfd-a7c2-d31d71dbcc22 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:48.941181 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f130e9-12ef-4dfd-a7c2-d31d71dbcc22 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:48.941414 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f130e9-12ef-4dfd-a7c2-d31d71dbcc22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:48.954344 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f130e9-12ef-4dfd-a7c2-d31d71dbcc22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:48.962695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-66f130e9-12ef-4dfd-a7c2-d31d71dbcc22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:40:48.962695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:48.962695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:48.962695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:48.962695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:48.962695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:48.962695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:48.962695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:48.962695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:48.962695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:48.962695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:48.962695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:48.962695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:48.962695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:48.962695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:48.962695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:48.963683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:48.963683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:48.963683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:48.963683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:48.963683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:48.963683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:48.963683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:48.963683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:48.963683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:48.963683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:48.963683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:48.963683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:48.963683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:48.963683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:48.963683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:48.963683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:48.964523 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:48.964523 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:48.964523 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:48.964523 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:48.964523 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:48.964523 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:48.964523 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:48.964523 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:48.964523 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:48.964523 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:48.964523 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:40:48.964523 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:48.964523 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 357/729] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:40:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:40:48.973045 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f130e9-12ef-4dfd-a7c2-d31d71dbcc22 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:49.027962 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:49.074681 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c3eda-9a17-48a8-81ba-f0de59d186ce None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:49.141766 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be563d-0225-47a0-84c7-f80efd3c8fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:49.143335 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be563d-0225-47a0-84c7-f80efd3c8fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:49.143768 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be563d-0225-47a0-84c7-f80efd3c8fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:49.144211 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be563d-0225-47a0-84c7-f80efd3c8fc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:49.150475 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f130e9-12ef-4dfd-a7c2-d31d71dbcc22 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:49.164550 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be563d-0225-47a0-84c7-f80efd3c8fc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:49.166145 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be563d-0225-47a0-84c7-f80efd3c8fc3 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:49.194472 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-75be563d-0225-47a0-84c7-f80efd3c8fc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:49.194472 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:49.194472 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:49.194472 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:49.194472 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:49.194472 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:49.194472 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:49.194472 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:49.194472 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:49.194472 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:49.194472 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:49.194472 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:49.194472 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:49.194472 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:49.194472 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:49.195639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:49.195639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:49.195639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:49.195639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:49.195639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:49.195639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:49.195639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:49.195639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:49.195639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:49.195639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:49.195639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:49.195639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:49.195639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:49.195639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:49.195639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:49.195639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:49.195639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:49.196748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:49.196748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:49.196748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:49.196748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:49.198754 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965fb57-3e71-4875-bddd-aebb8e484576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:49.199648 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965fb57-3e71-4875-bddd-aebb8e484576 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:49.200072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965fb57-3e71-4875-bddd-aebb8e484576 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:49.200503 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965fb57-3e71-4875-bddd-aebb8e484576 None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:49.201410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9965fb57-3e71-4875-bddd-aebb8e484576 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:49.201858 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9965fb57-3e71-4875-bddd-aebb8e484576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:49.203409 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9965fb57-3e71-4875-bddd-aebb8e484576 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:49.211060 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 373/730] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:40:49.214657 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 358/731] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:40:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:49.224229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be563d-0225-47a0-84c7-f80efd3c8fc3 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:49.224383 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965fb57-3e71-4875-bddd-aebb8e484576 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:49.286861 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:49.345342 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965fb57-3e71-4875-bddd-aebb8e484576 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:49.380384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be563d-0225-47a0-84c7-f80efd3c8fc3 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:49.382040 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8eee2-a84c-4b3a-8917-6e970c9be3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:49.383192 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8eee2-a84c-4b3a-8917-6e970c9be3ba None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:49.383192 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8eee2-a84c-4b3a-8917-6e970c9be3ba None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:49.383362 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8eee2-a84c-4b3a-8917-6e970c9be3ba None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:49.384026 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e8eee2-a84c-4b3a-8917-6e970c9be3ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:49.384333 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e8eee2-a84c-4b3a-8917-6e970c9be3ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:49.385694 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e8eee2-a84c-4b3a-8917-6e970c9be3ba None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:49.403027 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 359/732] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:49.404312 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894701c-6071-4ece-8684-2bac295e7e70 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:49.404603 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894701c-6071-4ece-8684-2bac295e7e70 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:49.404881 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894701c-6071-4ece-8684-2bac295e7e70 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:49.411268 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 360/733] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:49.411268 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb3b9a-89e6-46d6-bcee-b0d6093b54f9 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:49.411268 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb3b9a-89e6-46d6-bcee-b0d6093b54f9 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:49.411268 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb3b9a-89e6-46d6-bcee-b0d6093b54f9 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:49.411268 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 361/734] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:49.411268 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb3b9a-89e6-46d6-bcee-b0d6093b54f9 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:49.412791 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:49.418793 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f876996-dead-4c3f-8787-f01b49a186da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:49.419637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f876996-dead-4c3f-8787-f01b49a186da None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:49.421811 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f876996-dead-4c3f-8787-f01b49a186da None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:49.421811 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f876996-dead-4c3f-8787-f01b49a186da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:49.431823 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f876996-dead-4c3f-8787-f01b49a186da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:49.432770 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f876996-dead-4c3f-8787-f01b49a186da None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:49.450948 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-7f876996-dead-4c3f-8787-f01b49a186da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:49.450948 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:49.450948 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:49.450948 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:49.450948 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:49.450948 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:49.450948 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:49.450948 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:49.450948 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:49.450948 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:49.450948 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:49.450948 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:49.450948 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:49.450948 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:49.450948 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:49.452095 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:49.452095 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:49.452095 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:49.452095 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:49.452095 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:49.452095 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:49.452095 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:49.452095 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:49.452095 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:49.452095 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:49.452095 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:49.452095 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:49.452095 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:49.452095 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:49.452095 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:49.452095 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:49.452095 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:49.453171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:49.453171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:49.453171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:49.453171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:49.456667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 374/735] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:49.457857 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453aac3-1b41-4489-af71-3133dc03b49d None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:49.458213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453aac3-1b41-4489-af71-3133dc03b49d None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:49.458423 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453aac3-1b41-4489-af71-3133dc03b49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:49.477624 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-c453aac3-1b41-4489-af71-3133dc03b49d None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:49.478881 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c453aac3-1b41-4489-af71-3133dc03b49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:49.546996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb3b9a-89e6-46d6-bcee-b0d6093b54f9 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:49.553448 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 375/736] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:49.554585 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63996d-628b-442f-828a-a88837087a25 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:49.554879 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63996d-628b-442f-828a-a88837087a25 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:49.555176 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63996d-628b-442f-828a-a88837087a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:49.569383 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:49.572884 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-6f63996d-628b-442f-828a-a88837087a25 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:49.574096 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6f63996d-628b-442f-828a-a88837087a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:49.598008 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30edbc-d10f-4d48-bce3-f97faad101ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:49.599705 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30edbc-d10f-4d48-bce3-f97faad101ca None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:49.600308 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30edbc-d10f-4d48-bce3-f97faad101ca None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:49.600755 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30edbc-d10f-4d48-bce3-f97faad101ca None admin] PATH_INFO: `/v3/users/swift` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:49.609562 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30edbc-d10f-4d48-bce3-f97faad101ca None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:49.611377 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30edbc-d10f-4d48-bce3-f97faad101ca None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:49.626985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-ba30edbc-d10f-4d48-bce3-f97faad101ca None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 10:40:49.626985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:49.626985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:49.626985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:49.626985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:49.626985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:49.626985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:49.626985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:49.626985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:49.626985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:49.626985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:49.626985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:49.626985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:40:49.626985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:40:49.626985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:40:49.626985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:40:49.628184 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:49.628184 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:49.628184 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:40:49.628184 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:49.628184 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:40:49.628184 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:49.628184 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:49.628184 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:49.628184 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:49.628184 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:49.628184 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:49.628184 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:49.628184 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:49.628184 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:49.628184 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:49.628184 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:49.628184 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:49.628184 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:49.629206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:49.629206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:49.629206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:40:49.629206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:40:49.629206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:40:49.629206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:40:49.629206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:40:49.629206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:40:49.629206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 10:40:49.629206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:49.629206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 362/737] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:40:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:49.629206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30edbc-d10f-4d48-bce3-f97faad101ca None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:49.667313 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 376/738] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:49.667313 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63996d-628b-442f-828a-a88837087a25 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:49.713917 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:49.742158 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30edbc-d10f-4d48-bce3-f97faad101ca None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:49.777306 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63996d-628b-442f-828a-a88837087a25 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:49.778384 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5da20-024c-481b-acd3-9051f18c37e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:49.779066 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5da20-024c-481b-acd3-9051f18c37e2 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:49.779376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5da20-024c-481b-acd3-9051f18c37e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:49.779658 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5da20-024c-481b-acd3-9051f18c37e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:49.780384 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf5da20-024c-481b-acd3-9051f18c37e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:49.780693 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf5da20-024c-481b-acd3-9051f18c37e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:49.782077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf5da20-024c-481b-acd3-9051f18c37e2 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:49.794683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 363/739] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:49.795576 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5da20-024c-481b-acd3-9051f18c37e2 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:49.822219 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c4b484-9f25-4bb5-ba9f-1cab63a99061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:49.822888 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4b484-9f25-4bb5-ba9f-1cab63a99061 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:49.823196 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4b484-9f25-4bb5-ba9f-1cab63a99061 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:49.823474 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4b484-9f25-4bb5-ba9f-1cab63a99061 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:49.824197 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c4b484-9f25-4bb5-ba9f-1cab63a99061 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:49.825576 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c4b484-9f25-4bb5-ba9f-1cab63a99061 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:49.834750 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:49.847187 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 377/740] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jun 24 10:40:49 2022] POST /identity/v3/services => generated 240 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:40:49.847187 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c4b484-9f25-4bb5-ba9f-1cab63a99061 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:49.913724 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5da20-024c-481b-acd3-9051f18c37e2 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:49.961115 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b20e3e-cbc7-49ba-a1e4-298ba1ac8a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:49.961922 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b20e3e-cbc7-49ba-a1e4-298ba1ac8a26 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:49.962210 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b20e3e-cbc7-49ba-a1e4-298ba1ac8a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:49.962596 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b20e3e-cbc7-49ba-a1e4-298ba1ac8a26 None admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:49.963505 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b20e3e-cbc7-49ba-a1e4-298ba1ac8a26 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:49.963816 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b20e3e-cbc7-49ba-a1e4-298ba1ac8a26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:49.965343 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b20e3e-cbc7-49ba-a1e4-298ba1ac8a26 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:49.976417 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:49.982826 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c4b484-9f25-4bb5-ba9f-1cab63a99061 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:49.988891 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 364/741] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Jun 24 10:40:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:49.989787 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b20e3e-cbc7-49ba-a1e4-298ba1ac8a26 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:50.037176 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e1e4a-57dd-4e95-8ef3-facad5b43d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:50.038408 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e1e4a-57dd-4e95-8ef3-facad5b43d07 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:50.038852 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e1e4a-57dd-4e95-8ef3-facad5b43d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:50.039297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e1e4a-57dd-4e95-8ef3-facad5b43d07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:50.055934 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e1e4a-57dd-4e95-8ef3-facad5b43d07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:50.064190 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-9c6e1e4a-57dd-4e95-8ef3-facad5b43d07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:40:50.064190 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:50.064190 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:50.064190 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:50.064190 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:50.064190 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:50.064190 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:50.064190 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:50.064190 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:50.064190 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:50.064190 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:50.064190 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:50.064190 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:50.064190 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:50.064190 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:50.064190 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:50.065127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:50.065127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:50.065127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:50.065127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:50.065127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:50.065127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:50.065127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:50.065127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:50.065127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:50.065127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:50.065127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:50.065127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:50.065127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:50.065127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:50.065127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:50.065127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:50.065969 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:50.065969 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:50.065969 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:50.065969 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:50.065969 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:50.065969 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:50.065969 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:50.065969 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:50.065969 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:50.065969 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:50.065969 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:40:50.065969 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:50.065969 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 378/742] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 10:40:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:50.066667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e1e4a-57dd-4e95-8ef3-facad5b43d07 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:50.098928 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:50.117520 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b20e3e-cbc7-49ba-a1e4-298ba1ac8a26 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:50.154800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131784e5-5c34-4c26-b698-1c1f40b407a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:50.155643 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131784e5-5c34-4c26-b698-1c1f40b407a1 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:50.155926 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131784e5-5c34-4c26-b698-1c1f40b407a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:50.156198 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131784e5-5c34-4c26-b698-1c1f40b407a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:50.165747 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131784e5-5c34-4c26-b698-1c1f40b407a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:50.167946 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131784e5-5c34-4c26-b698-1c1f40b407a1 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:50.185857 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-131784e5-5c34-4c26-b698-1c1f40b407a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:40:50.185857 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:50.185857 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:50.185857 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:50.185857 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:50.185857 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:50.185857 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:50.185857 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:50.185857 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:50.185857 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:50.185857 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:50.185857 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:50.185857 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:40:50.185857 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:40:50.185857 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:40:50.185857 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:40:50.186847 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:50.186847 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:50.186847 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:40:50.186847 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:50.186847 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:40:50.186847 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:50.186847 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:50.186847 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:50.186847 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:50.186847 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:50.186847 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:50.186847 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:50.186847 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:50.186847 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:50.186847 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:50.186847 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:50.186847 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:50.186847 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:50.188229 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:50.188229 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:50.188229 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:40:50.188229 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:40:50.188229 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:40:50.188229 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:40:50.188229 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:40:50.188229 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:40:50.188229 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:40:50.188229 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:50.188782 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e1e4a-57dd-4e95-8ef3-facad5b43d07 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:50.189179 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 365/743] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Jun 24 10:40:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:50.189179 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131784e5-5c34-4c26-b698-1c1f40b407a1 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:50.229699 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da693e25-2717-43a1-b033-79e30de3df39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:50.230636 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da693e25-2717-43a1-b033-79e30de3df39 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:50.231311 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da693e25-2717-43a1-b033-79e30de3df39 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:50.231814 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da693e25-2717-43a1-b033-79e30de3df39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:50.262727 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:50.308685 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da693e25-2717-43a1-b033-79e30de3df39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:50.310525 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da693e25-2717-43a1-b033-79e30de3df39 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:50.317372 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131784e5-5c34-4c26-b698-1c1f40b407a1 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:50.361254 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e0e44-3f48-440f-b23e-fb29f821e3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:50.362439 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e0e44-3f48-440f-b23e-fb29f821e3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:50.362899 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e0e44-3f48-440f-b23e-fb29f821e3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:50.363695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e0e44-3f48-440f-b23e-fb29f821e3b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:50.364601 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e0e44-3f48-440f-b23e-fb29f821e3b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:50.365053 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e0e44-3f48-440f-b23e-fb29f821e3b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:50.367181 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e0e44-3f48-440f-b23e-fb29f821e3b6 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:50.379201 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 366/744] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 10:40:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:50.380298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e0e44-3f48-440f-b23e-fb29f821e3b6 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:50.394563 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:50.433957 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 379/745] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:40:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:40:50.435043 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da693e25-2717-43a1-b033-79e30de3df39 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:50.504867 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:50.511543 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e0e44-3f48-440f-b23e-fb29f821e3b6 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:50.547624 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ed5ce-8f1a-4ee7-b27d-b201fc1becaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:50.548464 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ed5ce-8f1a-4ee7-b27d-b201fc1becaa None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:50.548850 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ed5ce-8f1a-4ee7-b27d-b201fc1becaa None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:50.549284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ed5ce-8f1a-4ee7-b27d-b201fc1becaa None admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:50.550324 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ed5ce-8f1a-4ee7-b27d-b201fc1becaa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:50.550716 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ed5ce-8f1a-4ee7-b27d-b201fc1becaa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:50.552279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ed5ce-8f1a-4ee7-b27d-b201fc1becaa None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:50.561576 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da693e25-2717-43a1-b033-79e30de3df39 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:50.577606 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 367/746] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jun 24 10:40:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:50.577606 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ed5ce-8f1a-4ee7-b27d-b201fc1becaa None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:50.603899 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de0d5e-ed56-448f-ab5a-148a27ef7804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:50.604984 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de0d5e-ed56-448f-ab5a-148a27ef7804 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:50.605380 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de0d5e-ed56-448f-ab5a-148a27ef7804 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:50.605922 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de0d5e-ed56-448f-ab5a-148a27ef7804 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:50.617312 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de0d5e-ed56-448f-ab5a-148a27ef7804 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:50.624566 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de0d5e-ed56-448f-ab5a-148a27ef7804 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:50.644127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-59de0d5e-ed56-448f-ab5a-148a27ef7804 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:50.644127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:50.644127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:50.644127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:50.644127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:50.644127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:50.644127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:50.644127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:50.644127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:50.644127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:50.644127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:50.644127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:50.644127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:50.644127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:50.644127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:50.645296 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:50.645296 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:50.645296 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:50.645296 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:50.645296 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:50.645296 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:50.645296 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:50.645296 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:50.645296 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:50.645296 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:50.645296 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:50.645296 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:50.645296 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:50.645296 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:50.645296 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:50.645296 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:50.645296 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:50.646401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:50.646401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:50.646401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:50.646401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:50.648313 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 380/747] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:50.649235 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de0d5e-ed56-448f-ab5a-148a27ef7804 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:50.661520 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:50.709002 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ed5ce-8f1a-4ee7-b27d-b201fc1becaa None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:50.747873 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584d6a2-6ced-40e1-add5-adcc89432deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:50.749078 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584d6a2-6ced-40e1-add5-adcc89432deb None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:50.749594 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584d6a2-6ced-40e1-add5-adcc89432deb None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:50.750128 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584d6a2-6ced-40e1-add5-adcc89432deb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:50.761433 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584d6a2-6ced-40e1-add5-adcc89432deb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:50.763364 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584d6a2-6ced-40e1-add5-adcc89432deb None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:50.773654 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de0d5e-ed56-448f-ab5a-148a27ef7804 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:50.782755 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-0584d6a2-6ced-40e1-add5-adcc89432deb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:50.782755 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:50.782755 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:50.782755 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:50.782755 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:50.782755 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:50.782755 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:50.782755 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:50.782755 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:50.782755 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:50.782755 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:50.782755 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:50.782755 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:50.782755 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:50.782755 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:50.783854 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:50.783854 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:50.783854 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:50.783854 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:50.783854 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:50.783854 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:50.783854 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:50.783854 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:50.783854 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:50.783854 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:50.783854 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:50.783854 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:50.783854 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:50.783854 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:50.783854 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:50.783854 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:50.783854 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:50.784757 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:50.784757 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:50.784757 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:50.784757 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:50.785913 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:50.791782 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 368/748] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:50.793737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584d6a2-6ced-40e1-add5-adcc89432deb None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:50.817389 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59dc97-9462-4d65-b04a-aa5f386cd86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:50.818266 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59dc97-9462-4d65-b04a-aa5f386cd86a None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:50.818587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59dc97-9462-4d65-b04a-aa5f386cd86a None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:50.818980 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59dc97-9462-4d65-b04a-aa5f386cd86a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:50.833215 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a59dc97-9462-4d65-b04a-aa5f386cd86a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:50.834841 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a59dc97-9462-4d65-b04a-aa5f386cd86a None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:50.858114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-2a59dc97-9462-4d65-b04a-aa5f386cd86a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:50.858114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:50.858114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:50.858114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:50.858114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:50.858114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:50.858114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:50.858114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:50.858114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:50.858114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:50.858114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:50.858114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:50.858114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:50.858114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:50.858114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:50.859065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:50.859065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:50.859065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:50.859065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:50.859065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:50.859065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:50.859065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:50.859065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:50.859065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:50.859065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:50.859065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:50.859065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:50.859065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:50.859065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:50.859065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:50.859065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:50.859065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:50.860285 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:50.860285 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:50.860285 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:50.860285 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:50.863225 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 381/749] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:50.864253 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59dc97-9462-4d65-b04a-aa5f386cd86a None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:50.913567 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584d6a2-6ced-40e1-add5-adcc89432deb None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:50.933565 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:50.955989 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8d21c-d6f4-4f66-8fcf-7a03ef822302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:50.956676 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8d21c-d6f4-4f66-8fcf-7a03ef822302 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:50.956962 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8d21c-d6f4-4f66-8fcf-7a03ef822302 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:50.957245 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8d21c-d6f4-4f66-8fcf-7a03ef822302 None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:50.957980 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8d21c-d6f4-4f66-8fcf-7a03ef822302 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:50.958290 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8d21c-d6f4-4f66-8fcf-7a03ef822302 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:50.959812 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8d21c-d6f4-4f66-8fcf-7a03ef822302 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:50.971752 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 369/750] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:50.972557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8d21c-d6f4-4f66-8fcf-7a03ef822302 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:50.993474 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59dc97-9462-4d65-b04a-aa5f386cd86a None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:51.029270 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8619b1e-cd86-4629-aaa9-2f965de1446b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:51.029890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8619b1e-cd86-4629-aaa9-2f965de1446b None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:51.030179 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8619b1e-cd86-4629-aaa9-2f965de1446b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:51.030458 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8619b1e-cd86-4629-aaa9-2f965de1446b None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:51.031216 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8619b1e-cd86-4629-aaa9-2f965de1446b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:51.031532 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8619b1e-cd86-4629-aaa9-2f965de1446b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:51.032910 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8619b1e-cd86-4629-aaa9-2f965de1446b None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:51.044668 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 382/751] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:51.046325 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbad399-0ebd-4fc7-b5be-37744d6bac56 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:51.046683 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbad399-0ebd-4fc7-b5be-37744d6bac56 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:51.047036 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbad399-0ebd-4fc7-b5be-37744d6bac56 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:51.048522 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 383/752] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:51.053314 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbad399-0ebd-4fc7-b5be-37744d6bac56 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:51.084503 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:51.088716 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8d21c-d6f4-4f66-8fcf-7a03ef822302 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:51.124850 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3d305-e8da-415d-9036-d3bccf0c3014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:51.125591 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3d305-e8da-415d-9036-d3bccf0c3014 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:51.125877 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3d305-e8da-415d-9036-d3bccf0c3014 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:51.126157 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3d305-e8da-415d-9036-d3bccf0c3014 None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:51.126940 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3d305-e8da-415d-9036-d3bccf0c3014 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:51.127422 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3d305-e8da-415d-9036-d3bccf0c3014 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:51.128781 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3d305-e8da-415d-9036-d3bccf0c3014 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:51.145736 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 370/753] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:51.145736 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3d305-e8da-415d-9036-d3bccf0c3014 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:51.174848 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbad399-0ebd-4fc7-b5be-37744d6bac56 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:51.188068 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:51.211767 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d23719-fb98-4cc8-b882-46393f0048f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:51.212606 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d23719-fb98-4cc8-b882-46393f0048f3 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:51.212895 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d23719-fb98-4cc8-b882-46393f0048f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:51.213177 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d23719-fb98-4cc8-b882-46393f0048f3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:51.220895 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d23719-fb98-4cc8-b882-46393f0048f3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:51.222375 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d23719-fb98-4cc8-b882-46393f0048f3 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:51.238297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-e9d23719-fb98-4cc8-b882-46393f0048f3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 10:40:51.238297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:51.238297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:51.238297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:51.238297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:51.238297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:51.238297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:51.238297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:51.238297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:51.238297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:51.238297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:51.238297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:51.238297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:40:51.238297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:40:51.238297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:40:51.238297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:40:51.239511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:51.239511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:51.239511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:40:51.239511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:51.239511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:40:51.239511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:51.239511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:51.239511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:51.239511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:51.239511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:51.239511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:51.239511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:51.239511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:51.239511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:51.239511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:51.239511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:51.239511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:51.239511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:51.240733 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:51.240733 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:51.240733 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:40:51.240733 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:40:51.240733 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:40:51.240733 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:40:51.240733 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:40:51.240733 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:40:51.240733 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 10:40:51.240733 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:51.240733 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 384/754] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jun 24 10:40:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:51.241527 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9fc0c-efd7-418b-babe-22960d395d2a None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:51.241827 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9fc0c-efd7-418b-babe-22960d395d2a None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:51.242114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9fc0c-efd7-418b-babe-22960d395d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:51.258305 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-99c9fc0c-efd7-418b-babe-22960d395d2a None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:51.259546 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-99c9fc0c-efd7-418b-babe-22960d395d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:51.260584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3d305-e8da-415d-9036-d3bccf0c3014 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:51.299541 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc1f90-f541-44e4-919a-d7f64b4fdb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:51.300586 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc1f90-f541-44e4-919a-d7f64b4fdb43 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:51.301066 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc1f90-f541-44e4-919a-d7f64b4fdb43 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:51.301488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc1f90-f541-44e4-919a-d7f64b4fdb43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:51.309423 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc1f90-f541-44e4-919a-d7f64b4fdb43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:51.310903 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc1f90-f541-44e4-919a-d7f64b4fdb43 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:51.325131 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-7dbc1f90-f541-44e4-919a-d7f64b4fdb43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:51.325131 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:51.325131 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:51.325131 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:51.325131 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:51.325131 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:51.325131 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:51.325131 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:51.325131 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:51.325131 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:51.325131 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:51.325131 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:51.325131 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:40:51.325131 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:40:51.325131 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:40:51.326160 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:40:51.326160 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:51.326160 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:51.326160 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:51.326160 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:51.326160 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:51.326160 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:51.326160 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:51.326160 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:51.326160 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:51.326160 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:51.326160 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:51.326160 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:51.326160 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:51.326160 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:51.326160 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:51.326160 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:51.327089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:40:51.327089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:40:51.327089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:40:51.327089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:40:51.327089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:40:51.327089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:40:51.327089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:51.327089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:51.327089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 371/755] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:40:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:51.327619 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc1f90-f541-44e4-919a-d7f64b4fdb43 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:51.333453 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 385/756] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:40:51.334393 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9fc0c-efd7-418b-babe-22960d395d2a None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:51.350811 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:51.437040 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:51.441110 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9fc0c-efd7-418b-babe-22960d395d2a None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:51.441696 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc1f90-f541-44e4-919a-d7f64b4fdb43 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:51.478694 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424b0d7-af58-4c76-9de5-3757c07ca135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:51.479406 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424b0d7-af58-4c76-9de5-3757c07ca135 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:51.479696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424b0d7-af58-4c76-9de5-3757c07ca135 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:51.479859 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71bf7cd-63c5-4b04-abea-e53fabdd531a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:51.479969 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424b0d7-af58-4c76-9de5-3757c07ca135 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:51.480658 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71bf7cd-63c5-4b04-abea-e53fabdd531a None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:51.480818 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424b0d7-af58-4c76-9de5-3757c07ca135 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:51.480932 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71bf7cd-63c5-4b04-abea-e53fabdd531a None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:51.481130 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424b0d7-af58-4c76-9de5-3757c07ca135 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:51.481224 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71bf7cd-63c5-4b04-abea-e53fabdd531a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:51.482579 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424b0d7-af58-4c76-9de5-3757c07ca135 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:51.488282 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71bf7cd-63c5-4b04-abea-e53fabdd531a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:51.489732 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71bf7cd-63c5-4b04-abea-e53fabdd531a None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:51.504828 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 386/757] 10.222.0.16 () {56 vars in 1149 bytes} [Fri Jun 24 10:40:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:51.504828 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424b0d7-af58-4c76-9de5-3757c07ca135 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:51.505459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-a71bf7cd-63c5-4b04-abea-e53fabdd531a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:51.505459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:51.505459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:51.505459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:51.505459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:51.505459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:51.505459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:51.505459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:51.505459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:51.505459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:51.505459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:51.505459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:51.505459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:40:51.505459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:40:51.505459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:40:51.506438 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:40:51.506438 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:51.506438 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:51.506438 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:51.506438 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:51.506438 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:51.506438 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:51.506438 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:51.506438 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:51.506438 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:51.506438 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:51.506438 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:51.506438 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:51.506438 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:51.506438 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:51.506438 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:51.506438 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:51.512303 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:40:51.512303 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:40:51.512303 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:40:51.512303 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:40:51.512303 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:40:51.512303 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:40:51.512303 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:51.512303 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:51.512303 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 372/758] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:40:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:51.512303 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71bf7cd-63c5-4b04-abea-e53fabdd531a None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:51.588886 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:51.622074 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424b0d7-af58-4c76-9de5-3757c07ca135 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:51.627220 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71bf7cd-63c5-4b04-abea-e53fabdd531a None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:51.661257 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc570b2-9f07-4bbe-b31e-4df2c73704ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:51.661942 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc570b2-9f07-4bbe-b31e-4df2c73704ab None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:51.662274 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc570b2-9f07-4bbe-b31e-4df2c73704ab None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:51.662576 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc570b2-9f07-4bbe-b31e-4df2c73704ab None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:51.663406 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc570b2-9f07-4bbe-b31e-4df2c73704ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:51.663505 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c1245-7ec6-48fe-b8fb-d64dfd3ec93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:51.663726 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc570b2-9f07-4bbe-b31e-4df2c73704ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:51.664305 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c1245-7ec6-48fe-b8fb-d64dfd3ec93e None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:51.664591 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c1245-7ec6-48fe-b8fb-d64dfd3ec93e None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:51.664866 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c1245-7ec6-48fe-b8fb-d64dfd3ec93e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:51.665185 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc570b2-9f07-4bbe-b31e-4df2c73704ab None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:51.665528 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c1245-7ec6-48fe-b8fb-d64dfd3ec93e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:51.667002 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c1245-7ec6-48fe-b8fb-d64dfd3ec93e None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:51.682151 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 387/759] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:40:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:51.682151 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc570b2-9f07-4bbe-b31e-4df2c73704ab None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:51.682397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-538c1245-7ec6-48fe-b8fb-d64dfd3ec93e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 10:40:51.682397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:51.682397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:40:51.682397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:40:51.682397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:40:51.682397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:40:51.682397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:40:51.682397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:40:51.682397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 10:40:51.682397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:51.682397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:40:51.682397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:51.682397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:51.682397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:51.682397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:51.682397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:51.683350 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:51.683350 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:51.683350 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:51.683350 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:51.683350 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:51.683350 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:51.683350 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:51.683350 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:40:51.683350 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:40:51.683350 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:40:51.683350 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:40:51.683350 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:51.683350 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:51.683350 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:51.683350 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:51.683350 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:51.684896 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:51.684896 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:51.684896 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:51.684896 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:51.684896 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:51.684896 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:51.684896 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:51.684896 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:51.684896 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:51.684896 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:51.684896 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:51.684896 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:40:51.684896 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:40:51.684896 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 10:40:51.684896 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:51.688341 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 373/760] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jun 24 10:40:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:51.689211 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c1245-7ec6-48fe-b8fb-d64dfd3ec93e None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:51.714707 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:51.787994 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc570b2-9f07-4bbe-b31e-4df2c73704ab None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:51.795799 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c1245-7ec6-48fe-b8fb-d64dfd3ec93e None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:51.817301 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:51.824328 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68f9d6-c171-455d-958e-efb4930f8624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:51.825247 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68f9d6-c171-455d-958e-efb4930f8624 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:51.825536 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68f9d6-c171-455d-958e-efb4930f8624 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:51.825817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68f9d6-c171-455d-958e-efb4930f8624 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:51.834836 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26faf0b8-4081-4791-bf8e-58f9e28ae1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:51.835741 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26faf0b8-4081-4791-bf8e-58f9e28ae1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:51.836175 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26faf0b8-4081-4791-bf8e-58f9e28ae1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:51.836992 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26faf0b8-4081-4791-bf8e-58f9e28ae1a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:51.837952 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26faf0b8-4081-4791-bf8e-58f9e28ae1a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:51.838694 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26faf0b8-4081-4791-bf8e-58f9e28ae1a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:51.840691 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26faf0b8-4081-4791-bf8e-58f9e28ae1a5 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:51.862413 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 374/761] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:40:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:51.862413 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26faf0b8-4081-4791-bf8e-58f9e28ae1a5 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:51.904482 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68f9d6-c171-455d-958e-efb4930f8624 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:51.906195 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68f9d6-c171-455d-958e-efb4930f8624 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:51.953088 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:51.973077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26faf0b8-4081-4791-bf8e-58f9e28ae1a5 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:52.010328 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 388/762] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:40:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:40:52.010328 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68f9d6-c171-455d-958e-efb4930f8624 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:52.010644 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2e0d9-555a-4ca3-8abe-125d0b2f9c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:52.010762 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2e0d9-555a-4ca3-8abe-125d0b2f9c07 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:52.011048 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2e0d9-555a-4ca3-8abe-125d0b2f9c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:52.011360 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2e0d9-555a-4ca3-8abe-125d0b2f9c07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:52.012200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2e0d9-555a-4ca3-8abe-125d0b2f9c07 None admin] RBAC: Adding query filter params (role.id=4867b69c45554ce18e23167c05a02175, scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user.id=ff592d9ebd4241019625828ddd41aee8) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:52.012515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2e0d9-555a-4ca3-8abe-125d0b2f9c07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:52.013954 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2e0d9-555a-4ca3-8abe-125d0b2f9c07 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:52.027253 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 375/763] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:40:51 2022] GET /identity/v3/role_assignments?user.id=ff592d9ebd4241019625828ddd41aee8&scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e&role.id=4867b69c45554ce18e23167c05a02175 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:52.027253 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2e0d9-555a-4ca3-8abe-125d0b2f9c07 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:52.054544 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:52.135104 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2e0d9-555a-4ca3-8abe-125d0b2f9c07 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:52.139353 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68f9d6-c171-455d-958e-efb4930f8624 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:52.175917 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45db80e-53d5-4c86-983f-777f5fad3bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:52.176844 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45db80e-53d5-4c86-983f-777f5fad3bb5 None admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:52.177125 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45db80e-53d5-4c86-983f-777f5fad3bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:52.177399 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45db80e-53d5-4c86-983f-777f5fad3bb5 None admin] PATH_INFO: `/v3/projects/61b2f5f9674c4fd3a1ec5db2f3b4b26e/users/e8034bad51144002a7386c975e412992/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:52.180552 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45db80e-53d5-4c86-983f-777f5fad3bb5 None admin] RBAC: Authorizing `identity:create_grant(project_id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user_id=e8034bad51144002a7386c975e412992, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:52.181945 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45db80e-53d5-4c86-983f-777f5fad3bb5 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:52.184203 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8418a5-ee84-4dff-ae37-16392c10f9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:52.184958 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8418a5-ee84-4dff-ae37-16392c10f9e4 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:52.185348 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8418a5-ee84-4dff-ae37-16392c10f9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:52.185697 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8418a5-ee84-4dff-ae37-16392c10f9e4 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:52.186424 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8418a5-ee84-4dff-ae37-16392c10f9e4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:52.186807 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8418a5-ee84-4dff-ae37-16392c10f9e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:52.188526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8418a5-ee84-4dff-ae37-16392c10f9e4 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:52.194017 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 389/764] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jun 24 10:40:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:52.196149 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f9196-f9b1-45ff-8a6e-e191fe970b4d None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:52.196445 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f9196-f9b1-45ff-8a6e-e191fe970b4d None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:52.196775 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f9196-f9b1-45ff-8a6e-e191fe970b4d None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:52.202113 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 390/765] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:52.202113 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f9196-f9b1-45ff-8a6e-e191fe970b4d None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:52.205830 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 376/766] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 10:40:52 2022] PUT /identity/v3/projects/61b2f5f9674c4fd3a1ec5db2f3b4b26e/users/e8034bad51144002a7386c975e412992/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:40:52.215297 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45db80e-53d5-4c86-983f-777f5fad3bb5 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:52.226090 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:52.335266 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:52.346677 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f9196-f9b1-45ff-8a6e-e191fe970b4d None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:52.348599 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45db80e-53d5-4c86-983f-777f5fad3bb5 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:52.395282 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e0f64-250d-468f-8c34-4182aaf949ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:52.395477 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d72435-a904-4ad6-8043-6e7b99ca4629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:52.395849 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d72435-a904-4ad6-8043-6e7b99ca4629 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:52.395962 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e0f64-250d-468f-8c34-4182aaf949ca None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:52.396125 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d72435-a904-4ad6-8043-6e7b99ca4629 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:52.396307 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e0f64-250d-468f-8c34-4182aaf949ca None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:52.396410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d72435-a904-4ad6-8043-6e7b99ca4629 None admin] PATH_INFO: `/v3/services` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:52.396556 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e0f64-250d-468f-8c34-4182aaf949ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:52.397212 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d72435-a904-4ad6-8043-6e7b99ca4629 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:52.397517 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d72435-a904-4ad6-8043-6e7b99ca4629 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:52.398891 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d72435-a904-4ad6-8043-6e7b99ca4629 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:52.404966 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 377/767] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jun 24 10:40:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:52.406212 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3eff2-7773-41c6-a13b-1649ecbdff5f None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:52.406501 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3eff2-7773-41c6-a13b-1649ecbdff5f None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:52.406782 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3eff2-7773-41c6-a13b-1649ecbdff5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:52.413367 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e0f64-250d-468f-8c34-4182aaf949ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:52.414836 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e0f64-250d-468f-8c34-4182aaf949ca None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:52.426692 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-e7b3eff2-7773-41c6-a13b-1649ecbdff5f None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:52.427981 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-e7b3eff2-7773-41c6-a13b-1649ecbdff5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:52.437053 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-2e3e0f64-250d-468f-8c34-4182aaf949ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:52.437053 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:52.437053 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:52.437053 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:52.437053 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:52.437053 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:52.437053 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:52.437053 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:52.437053 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:52.437053 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:52.437053 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:52.437053 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:52.437053 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:52.437053 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:52.437053 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:52.438346 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:52.438346 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:52.438346 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:52.438346 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:52.438346 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:52.438346 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:52.438346 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:52.438346 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:52.438346 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:52.438346 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:52.438346 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:52.438346 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:52.438346 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:52.438346 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:52.438346 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:52.438346 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:52.438346 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:52.439277 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:52.439277 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:52.439277 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:52.439277 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:52.439277 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 391/768] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:52.443253 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e0f64-250d-468f-8c34-4182aaf949ca None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:52.509474 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:52.519304 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 378/769] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:40:52.520214 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3eff2-7773-41c6-a13b-1649ecbdff5f None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:52.573806 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e0f64-250d-468f-8c34-4182aaf949ca None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:52.617738 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fda53b-210a-4a07-b45b-184e32c79ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:52.618675 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fda53b-210a-4a07-b45b-184e32c79ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:52.618960 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fda53b-210a-4a07-b45b-184e32c79ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:52.619266 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fda53b-210a-4a07-b45b-184e32c79ff2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:52.620221 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fda53b-210a-4a07-b45b-184e32c79ff2 None admin] RBAC: Adding query filter params (interface=public, service_id=729547fd766e4abdb9ea179495e71b9a, region_id=RegionOne) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:52.620538 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fda53b-210a-4a07-b45b-184e32c79ff2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:52.622591 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fda53b-210a-4a07-b45b-184e32c79ff2 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:52.634612 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 392/770] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Jun 24 10:40:52 2022] GET /identity/v3/endpoints?service_id=729547fd766e4abdb9ea179495e71b9a&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:52.635693 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fda53b-210a-4a07-b45b-184e32c79ff2 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:52.651552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:52.657392 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3eff2-7773-41c6-a13b-1649ecbdff5f None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:52.695687 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c5e5e-b14f-4424-88f4-ead7ed24c223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:52.696372 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c5e5e-b14f-4424-88f4-ead7ed24c223 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:52.696703 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c5e5e-b14f-4424-88f4-ead7ed24c223 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:52.696984 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c5e5e-b14f-4424-88f4-ead7ed24c223 None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:52.697718 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c5e5e-b14f-4424-88f4-ead7ed24c223 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:52.698024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c5e5e-b14f-4424-88f4-ead7ed24c223 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:52.699508 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c5e5e-b14f-4424-88f4-ead7ed24c223 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:52.712176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 379/771] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:52.713415 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c5e5e-b14f-4424-88f4-ead7ed24c223 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:52.762515 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fda53b-210a-4a07-b45b-184e32c79ff2 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:52.776599 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:52.798882 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db073a4-9de6-4de5-9a45-968b6f83fce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:52.799970 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db073a4-9de6-4de5-9a45-968b6f83fce9 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:52.800403 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db073a4-9de6-4de5-9a45-968b6f83fce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:52.800858 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db073a4-9de6-4de5-9a45-968b6f83fce9 None admin] PATH_INFO: `/v3/services/network` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:52.801664 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db073a4-9de6-4de5-9a45-968b6f83fce9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:52.803292 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db073a4-9de6-4de5-9a45-968b6f83fce9 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:52.815808 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-9db073a4-9de6-4de5-9a45-968b6f83fce9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 10:40:52.815808 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:52.815808 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:40:52.815808 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:40:52.815808 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:40:52.815808 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:40:52.815808 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:40:52.815808 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:40:52.815808 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 10:40:52.815808 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:52.815808 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:40:52.815808 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:52.815808 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:52.815808 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:52.815808 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:52.815808 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:52.815808 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:52.817039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:52.817039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:52.817039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:52.817039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:52.817039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:52.817039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:52.817039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:40:52.817039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:40:52.817039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:40:52.817039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:40:52.817039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:52.817039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:52.817039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:52.817039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:52.817039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:52.817039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:52.818083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:52.818083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:52.818083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:52.818083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:52.818083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:52.818083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:52.818083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:52.818083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:52.818083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:52.818083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:52.818083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:40:52.818083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:40:52.818083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 10:40:52.818083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:52.825265 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c5e5e-b14f-4424-88f4-ead7ed24c223 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:52.825464 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 393/772] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:40:52 2022] GET /identity/v3/services/network => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:52.826470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db073a4-9de6-4de5-9a45-968b6f83fce9 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:52.860126 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51644573-5d7c-4705-98b8-3f46af512ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:52.860856 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51644573-5d7c-4705-98b8-3f46af512ade None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:52.861177 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51644573-5d7c-4705-98b8-3f46af512ade None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:52.861459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51644573-5d7c-4705-98b8-3f46af512ade None admin] PATH_INFO: `/v3/services` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:52.862141 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51644573-5d7c-4705-98b8-3f46af512ade None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:52.863568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51644573-5d7c-4705-98b8-3f46af512ade None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:52.868977 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 380/773] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Jun 24 10:40:52 2022] GET /identity/v3/services => generated 772 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:52.876233 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51644573-5d7c-4705-98b8-3f46af512ade None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:52.908571 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:52.937778 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db073a4-9de6-4de5-9a45-968b6f83fce9 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:52.976024 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c03014-57c8-4451-ba26-b5f10db20359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:52.977205 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c03014-57c8-4451-ba26-b5f10db20359 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:52.977640 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c03014-57c8-4451-ba26-b5f10db20359 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:52.978110 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c03014-57c8-4451-ba26-b5f10db20359 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:52.986291 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c03014-57c8-4451-ba26-b5f10db20359 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:52.988219 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c03014-57c8-4451-ba26-b5f10db20359 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:53.004831 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-76c03014-57c8-4451-ba26-b5f10db20359 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:53.004831 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:53.004831 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:53.004831 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:53.004831 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:53.004831 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:53.004831 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:53.004831 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:53.004831 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:53.004831 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:53.004831 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:53.004831 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:53.004831 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:40:53.004831 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:40:53.004831 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:40:53.006049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:40:53.006049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:53.006049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:53.006049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:53.006049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:53.006049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:53.006049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:53.006049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:53.006049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:53.006049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:53.006049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:53.006049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:53.006049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:53.006049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:53.006049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:53.006049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:53.006049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:53.007383 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:40:53.007383 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:40:53.007383 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:40:53.007383 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:40:53.007383 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:40:53.007383 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:40:53.007383 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:53.007383 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:53.009704 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 394/774] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:40:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:53.018171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c03014-57c8-4451-ba26-b5f10db20359 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:53.085728 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51644573-5d7c-4705-98b8-3f46af512ade None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:53.134373 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:53.150671 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356577bc-c5bc-46d7-bbe2-980dc4f12644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:53.151395 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356577bc-c5bc-46d7-bbe2-980dc4f12644 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:53.151683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356577bc-c5bc-46d7-bbe2-980dc4f12644 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:53.151968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356577bc-c5bc-46d7-bbe2-980dc4f12644 None admin] PATH_INFO: `/v3/services` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:53.152689 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356577bc-c5bc-46d7-bbe2-980dc4f12644 None admin] RBAC: Adding query filter params (name=network) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:53.152995 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356577bc-c5bc-46d7-bbe2-980dc4f12644 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:53.154375 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356577bc-c5bc-46d7-bbe2-980dc4f12644 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:53.162728 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 381/775] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jun 24 10:40:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:53.168567 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356577bc-c5bc-46d7-bbe2-980dc4f12644 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:53.189543 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c03014-57c8-4451-ba26-b5f10db20359 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:53.231261 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267dd85-b510-4a44-a8c1-fb21ea212088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:53.231968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267dd85-b510-4a44-a8c1-fb21ea212088 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:53.232410 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267dd85-b510-4a44-a8c1-fb21ea212088 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:53.232693 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267dd85-b510-4a44-a8c1-fb21ea212088 None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:53.233787 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267dd85-b510-4a44-a8c1-fb21ea212088 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:53.234103 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267dd85-b510-4a44-a8c1-fb21ea212088 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:53.235579 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267dd85-b510-4a44-a8c1-fb21ea212088 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:53.238062 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:53.257046 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 395/776] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:40:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:53.259337 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267dd85-b510-4a44-a8c1-fb21ea212088 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:53.289719 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356577bc-c5bc-46d7-bbe2-980dc4f12644 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:53.325777 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfc5c5-da19-486c-9870-5fe7d61b1a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:53.326841 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfc5c5-da19-486c-9870-5fe7d61b1a99 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:53.327372 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfc5c5-da19-486c-9870-5fe7d61b1a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:53.327844 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfc5c5-da19-486c-9870-5fe7d61b1a99 None admin] PATH_INFO: `/v3/services` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:53.328749 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bfc5c5-da19-486c-9870-5fe7d61b1a99 None admin] RBAC: Adding query filter params (type=network) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:53.329265 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bfc5c5-da19-486c-9870-5fe7d61b1a99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:53.330862 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bfc5c5-da19-486c-9870-5fe7d61b1a99 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:53.336795 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 382/777] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jun 24 10:40:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:53.344116 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfc5c5-da19-486c-9870-5fe7d61b1a99 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:53.413516 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267dd85-b510-4a44-a8c1-fb21ea212088 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:53.450946 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:53.477431 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46016f-35eb-4650-ae57-3bcf3973a5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:53.478428 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46016f-35eb-4650-ae57-3bcf3973a5a0 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:53.478722 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46016f-35eb-4650-ae57-3bcf3973a5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:53.479006 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46016f-35eb-4650-ae57-3bcf3973a5a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:53.479895 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46016f-35eb-4650-ae57-3bcf3973a5a0 None admin] RBAC: Adding query filter params (role.id=7bab53c1ac3d4e04b18c87286e2ab0aa, scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user.id=4dfddd72dfa84ce39fe62112224b425d) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:53.480216 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46016f-35eb-4650-ae57-3bcf3973a5a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:53.482390 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46016f-35eb-4650-ae57-3bcf3973a5a0 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:53.489246 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 396/778] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:40:53 2022] GET /identity/v3/role_assignments?user.id=4dfddd72dfa84ce39fe62112224b425d&scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e&role.id=7bab53c1ac3d4e04b18c87286e2ab0aa => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:53.571897 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfc5c5-da19-486c-9870-5fe7d61b1a99 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:53.629685 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a0de4-eb41-4f09-bab7-2137544ede66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:53.630387 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a0de4-eb41-4f09-bab7-2137544ede66 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:53.630674 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a0de4-eb41-4f09-bab7-2137544ede66 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:53.631186 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a0de4-eb41-4f09-bab7-2137544ede66 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:53.632655 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a0de4-eb41-4f09-bab7-2137544ede66 None admin] RBAC: Adding query filter params (interface=public, service_id=ea8470374bda4a279ffa566fe11969bb, region_id=RegionOne) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:53.632980 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a0de4-eb41-4f09-bab7-2137544ede66 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:53.634403 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a0de4-eb41-4f09-bab7-2137544ede66 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:53.643360 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 383/779] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Jun 24 10:40:53 2022] GET /identity/v3/endpoints?service_id=ea8470374bda4a279ffa566fe11969bb&interface=public®ion_id=RegionOne => generated 194 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:53.649097 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46016f-35eb-4650-ae57-3bcf3973a5a0 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:53.723664 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:53.783921 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46016f-35eb-4650-ae57-3bcf3973a5a0 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:53.818737 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3cc7f-20fc-46e4-b175-aaf2b508c838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:53.819446 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3cc7f-20fc-46e4-b175-aaf2b508c838 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:53.819734 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3cc7f-20fc-46e4-b175-aaf2b508c838 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:53.820015 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3cc7f-20fc-46e4-b175-aaf2b508c838 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:53.820702 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3cc7f-20fc-46e4-b175-aaf2b508c838 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:53.822099 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3cc7f-20fc-46e4-b175-aaf2b508c838 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:53.827725 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 397/780] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Jun 24 10:40:53 2022] GET /identity/v3/services => generated 772 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:54.317237 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a55041-3844-4d61-ab3d-7cea653bbde3 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:54.317767 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a55041-3844-4d61-ab3d-7cea653bbde3 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:54.318088 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a55041-3844-4d61-ab3d-7cea653bbde3 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:54.320343 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 384/781] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:54.325848 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83742ad-5bc6-43ee-a53d-f5e6e3725d55 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:54.326256 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83742ad-5bc6-43ee-a53d-f5e6e3725d55 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:54.326640 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83742ad-5bc6-43ee-a53d-f5e6e3725d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:54.352589 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-e83742ad-5bc6-43ee-a53d-f5e6e3725d55 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:54.353834 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e83742ad-5bc6-43ee-a53d-f5e6e3725d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:54.444172 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 398/782] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:40:54.478747 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a55041-3844-4d61-ab3d-7cea653bbde3 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:54.509901 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51e0b8-6498-4c29-8687-36fb9391a588 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:54.510219 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51e0b8-6498-4c29-8687-36fb9391a588 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:54.510666 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51e0b8-6498-4c29-8687-36fb9391a588 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:54.512152 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 399/783] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:54.517090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621bfde-c283-42e5-a21b-3d4e822d9a14 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:54.517379 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621bfde-c283-42e5-a21b-3d4e822d9a14 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:54.517660 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621bfde-c283-42e5-a21b-3d4e822d9a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:54.535359 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-5621bfde-c283-42e5-a21b-3d4e822d9a14 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:54.536602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5621bfde-c283-42e5-a21b-3d4e822d9a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:54.618149 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:54.643839 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 400/784] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:40:54.655695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a55041-3844-4d61-ab3d-7cea653bbde3 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:54.678213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621bfde-c283-42e5-a21b-3d4e822d9a14 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:54.680910 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:54.722130 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c010b-6bd7-4984-850e-0e6faf272254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:54.722998 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c010b-6bd7-4984-850e-0e6faf272254 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:54.723312 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c010b-6bd7-4984-850e-0e6faf272254 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:54.723595 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c010b-6bd7-4984-850e-0e6faf272254 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:54.746961 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c010b-6bd7-4984-850e-0e6faf272254 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:54.758180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-960c010b-6bd7-4984-850e-0e6faf272254 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:40:54.758180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:54.758180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:54.758180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:54.758180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:54.758180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:54.758180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:54.758180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:54.758180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:54.758180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:54.758180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:54.758180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:54.758180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:54.758180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:54.758180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:54.758180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:54.759113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:54.759113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:54.759113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:54.759113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:54.759113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:54.759113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:54.759113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:54.759113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:54.759113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:54.759113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:54.759113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:54.759113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:54.759113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:54.759113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:54.759113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:54.759113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:54.759983 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:54.759983 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:54.759983 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:54.759983 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:54.759983 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:54.759983 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:54.759983 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:54.759983 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:54.759983 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:54.759983 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:54.759983 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:40:54.759983 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:54.762968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 385/785] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:40:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:54.769434 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c010b-6bd7-4984-850e-0e6faf272254 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:54.850205 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621bfde-c283-42e5-a21b-3d4e822d9a14 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:54.913056 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46025e38-0f49-4e6f-9691-478073991607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:54.915013 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46025e38-0f49-4e6f-9691-478073991607 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:54.919441 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46025e38-0f49-4e6f-9691-478073991607 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:54.920018 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46025e38-0f49-4e6f-9691-478073991607 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:54.937900 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46025e38-0f49-4e6f-9691-478073991607 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:54.947602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-46025e38-0f49-4e6f-9691-478073991607 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:40:54.947602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:54.947602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:54.947602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:54.947602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:54.947602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:54.947602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:54.947602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:54.947602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:54.947602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:54.947602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:54.947602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:54.947602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:54.947602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:54.947602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:54.947602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:54.948554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:54.948554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:54.948554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:54.948554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:54.948554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:54.948554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:54.948554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:54.948554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:54.948554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:54.948554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:54.948554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:54.948554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:54.948554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:54.948554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:54.948554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:54.948554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:54.949384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:54.949384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:54.949384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:54.949384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:54.949384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:54.949384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:54.949384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:54.949384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:54.949384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:54.949384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:54.949384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:40:54.949384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:54.952234 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 401/786] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:40:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:40:54.958682 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46025e38-0f49-4e6f-9691-478073991607 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:54.983462 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c010b-6bd7-4984-850e-0e6faf272254 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:55.039803 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:55.050735 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b6dda-c508-4950-917e-ee8c6cabcf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:55.051749 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b6dda-c508-4950-917e-ee8c6cabcf80 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:55.052239 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b6dda-c508-4950-917e-ee8c6cabcf80 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:55.053552 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b6dda-c508-4950-917e-ee8c6cabcf80 None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:55.054526 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b6dda-c508-4950-917e-ee8c6cabcf80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:55.057774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b6dda-c508-4950-917e-ee8c6cabcf80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:55.059406 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b6dda-c508-4950-917e-ee8c6cabcf80 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:55.073748 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 386/787] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:40:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:55.081762 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b6dda-c508-4950-917e-ee8c6cabcf80 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:55.153813 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46025e38-0f49-4e6f-9691-478073991607 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:55.155934 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:55.223834 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52a935-0d7a-4d36-ab69-bcfa3da3634e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:55.225244 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52a935-0d7a-4d36-ab69-bcfa3da3634e None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:55.225763 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52a935-0d7a-4d36-ab69-bcfa3da3634e None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:55.226244 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52a935-0d7a-4d36-ab69-bcfa3da3634e None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:55.227222 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52a935-0d7a-4d36-ab69-bcfa3da3634e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:55.229793 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52a935-0d7a-4d36-ab69-bcfa3da3634e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:55.231438 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52a935-0d7a-4d36-ab69-bcfa3da3634e None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:55.246992 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 402/788] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:40:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:40:55.254873 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52a935-0d7a-4d36-ab69-bcfa3da3634e None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:55.260681 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b6dda-c508-4950-917e-ee8c6cabcf80 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:55.296362 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33c208-ee85-4e6e-9f8e-82d4238f8809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:55.297559 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33c208-ee85-4e6e-9f8e-82d4238f8809 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:55.298070 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33c208-ee85-4e6e-9f8e-82d4238f8809 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:55.298548 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33c208-ee85-4e6e-9f8e-82d4238f8809 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:55.310858 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33c208-ee85-4e6e-9f8e-82d4238f8809 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:55.314384 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33c208-ee85-4e6e-9f8e-82d4238f8809 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:55.336666 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-6a33c208-ee85-4e6e-9f8e-82d4238f8809 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:55.336666 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:55.336666 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:55.336666 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:55.336666 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:55.336666 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:55.336666 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:55.336666 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:55.336666 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:55.336666 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:55.336666 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:55.336666 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:55.336666 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:55.336666 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:55.336666 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:55.338075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:55.338075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:55.338075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:55.338075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:55.338075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:55.338075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:55.338075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:55.338075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:55.338075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:55.338075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:55.338075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:55.338075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:55.338075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:55.338075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:55.338075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:55.338075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:55.338075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:55.338975 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:55.338975 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:55.338975 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:55.338975 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:55.341321 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 387/789] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:55.350395 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33c208-ee85-4e6e-9f8e-82d4238f8809 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:55.452697 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52a935-0d7a-4d36-ab69-bcfa3da3634e None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:55.454048 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:55.464545 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33c208-ee85-4e6e-9f8e-82d4238f8809 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:55.472951 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:55.501424 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67578a25-1aab-4cc4-bbbf-272c3da7e014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:55.502583 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67578a25-1aab-4cc4-bbbf-272c3da7e014 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:55.503134 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67578a25-1aab-4cc4-bbbf-272c3da7e014 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:55.503551 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67578a25-1aab-4cc4-bbbf-272c3da7e014 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:55.505428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e910467-c6c3-45e4-9df1-f86419a99901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:55.506458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e910467-c6c3-45e4-9df1-f86419a99901 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:55.507238 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e910467-c6c3-45e4-9df1-f86419a99901 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:55.507683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e910467-c6c3-45e4-9df1-f86419a99901 None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:55.508661 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e910467-c6c3-45e4-9df1-f86419a99901 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:55.509124 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e910467-c6c3-45e4-9df1-f86419a99901 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:55.510654 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e910467-c6c3-45e4-9df1-f86419a99901 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:55.516616 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67578a25-1aab-4cc4-bbbf-272c3da7e014 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:55.518181 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67578a25-1aab-4cc4-bbbf-272c3da7e014 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:55.525819 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 388/790] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:55.532038 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09272760-32b9-480d-af55-55a02cc577a0 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:55.532536 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09272760-32b9-480d-af55-55a02cc577a0 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:55.532958 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09272760-32b9-480d-af55-55a02cc577a0 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:55.534665 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 389/791] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:55.535612 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09272760-32b9-480d-af55-55a02cc577a0 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:55.539922 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-67578a25-1aab-4cc4-bbbf-272c3da7e014 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:55.539922 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:55.539922 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:55.539922 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:55.539922 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:55.539922 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:55.539922 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:55.539922 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:55.539922 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:55.539922 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:55.539922 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:55.539922 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:55.539922 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:55.539922 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:55.539922 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:55.540817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:55.540817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:55.540817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:55.540817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:55.540817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:55.540817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:55.540817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:55.540817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:55.540817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:55.540817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:55.540817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:55.540817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:55.540817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:55.540817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:55.540817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:55.540817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:55.540817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:55.541708 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:55.541708 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:55.541708 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:55.541708 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:55.542465 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 403/792] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:55.543739 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93e852-e10d-4ec3-8897-12f8422d6f58 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:55.544033 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93e852-e10d-4ec3-8897-12f8422d6f58 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:55.544317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93e852-e10d-4ec3-8897-12f8422d6f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:55.568156 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-5f93e852-e10d-4ec3-8897-12f8422d6f58 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:55.569859 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5f93e852-e10d-4ec3-8897-12f8422d6f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:55.651079 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09272760-32b9-480d-af55-55a02cc577a0 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:55.668618 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 404/793] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:40:55.669302 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93e852-e10d-4ec3-8897-12f8422d6f58 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:55.708393 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834a776-2d4c-492f-b859-806d092fd20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:55.709401 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834a776-2d4c-492f-b859-806d092fd20c None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:55.709896 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834a776-2d4c-492f-b859-806d092fd20c None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:55.709896 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834a776-2d4c-492f-b859-806d092fd20c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:55.719242 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2834a776-2d4c-492f-b859-806d092fd20c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:55.720709 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2834a776-2d4c-492f-b859-806d092fd20c None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:55.739826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-2834a776-2d4c-492f-b859-806d092fd20c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 10:40:55.739826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:55.739826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:55.739826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:55.739826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:55.739826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:55.739826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:55.739826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:55.739826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:55.739826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:55.739826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:55.739826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:55.739826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:40:55.739826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:40:55.739826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:40:55.739826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:40:55.741459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:55.741459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:55.741459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:40:55.741459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:55.741459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:40:55.741459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:55.741459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:55.741459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:55.741459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:55.741459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:55.741459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:55.741459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:55.741459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:55.741459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:55.741459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:55.741459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:55.741459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:55.741459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:55.742875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:55.742875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:55.742875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:40:55.742875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:40:55.742875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:40:55.742875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:40:55.742875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:40:55.742875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:40:55.742875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 10:40:55.742875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:55.746164 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 390/794] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:40:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:55.747448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834a776-2d4c-492f-b859-806d092fd20c None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:55.763357 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:55.777833 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:55.796002 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93e852-e10d-4ec3-8897-12f8422d6f58 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:55.833625 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9254d-4197-4658-b44d-2b342ec89388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:55.835509 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9254d-4197-4658-b44d-2b342ec89388 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:55.836063 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9254d-4197-4658-b44d-2b342ec89388 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:55.836533 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9254d-4197-4658-b44d-2b342ec89388 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:55.837474 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9254d-4197-4658-b44d-2b342ec89388 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:55.837978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9254d-4197-4658-b44d-2b342ec89388 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:55.839607 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9254d-4197-4658-b44d-2b342ec89388 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:55.857805 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 405/795] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:55.859192 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9254d-4197-4658-b44d-2b342ec89388 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:55.870686 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834a776-2d4c-492f-b859-806d092fd20c None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:55.917452 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10f83b-b508-411a-8223-803e91e7e709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:55.918295 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10f83b-b508-411a-8223-803e91e7e709 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:55.918581 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10f83b-b508-411a-8223-803e91e7e709 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:55.918863 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10f83b-b508-411a-8223-803e91e7e709 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:55.919556 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10f83b-b508-411a-8223-803e91e7e709 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:55.921390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10f83b-b508-411a-8223-803e91e7e709 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:55.938036 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-2a10f83b-b508-411a-8223-803e91e7e709 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 10:40:55.938036 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:55.938036 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:40:55.938036 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:40:55.938036 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:40:55.938036 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:40:55.938036 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:40:55.938036 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:40:55.938036 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 10:40:55.938036 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:55.938036 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:40:55.938036 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:55.938036 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:55.938036 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:55.938036 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:55.938036 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:55.939014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:55.939014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:55.939014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:55.939014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:55.939014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:55.939014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:55.939014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:55.939014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:40:55.939014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:40:55.939014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:40:55.939014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:40:55.939014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:55.939014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:55.939014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:55.939014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:55.939014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:55.939873 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:55.939873 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:55.939873 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:55.939873 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:55.939873 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:55.939873 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:55.939873 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:55.939873 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:55.939873 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:55.939873 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:55.939873 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:55.939873 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:40:55.939873 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:40:55.939873 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 10:40:55.939873 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:55.943217 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 391/796] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jun 24 10:40:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:55.945027 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10f83b-b508-411a-8223-803e91e7e709 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:55.987239 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9254d-4197-4658-b44d-2b342ec89388 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:56.027192 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:56.027513 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca001b-a560-4e05-929e-904c0f0b2674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:56.028377 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca001b-a560-4e05-929e-904c0f0b2674 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:56.028679 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca001b-a560-4e05-929e-904c0f0b2674 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:56.028938 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca001b-a560-4e05-929e-904c0f0b2674 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:56.029894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca001b-a560-4e05-929e-904c0f0b2674 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:56.030237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca001b-a560-4e05-929e-904c0f0b2674 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:56.031772 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca001b-a560-4e05-929e-904c0f0b2674 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:56.049361 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 406/797] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Jun 24 10:40:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:56.050222 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca001b-a560-4e05-929e-904c0f0b2674 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:56.055031 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:56.063487 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10f83b-b508-411a-8223-803e91e7e709 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:56.100221 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1bf0c-ef84-4342-9864-1199d5eb8e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:56.101044 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1bf0c-ef84-4342-9864-1199d5eb8e32 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:56.101333 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1bf0c-ef84-4342-9864-1199d5eb8e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:56.101614 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1bf0c-ef84-4342-9864-1199d5eb8e32 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:56.110005 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c1bf0c-ef84-4342-9864-1199d5eb8e32 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:56.111512 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c1bf0c-ef84-4342-9864-1199d5eb8e32 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:56.129680 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-e3c1bf0c-ef84-4342-9864-1199d5eb8e32 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:40:56.129680 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:56.129680 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:56.129680 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:56.129680 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:56.129680 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:56.129680 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:56.129680 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:56.129680 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:56.129680 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:56.129680 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:56.129680 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:56.129680 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:40:56.129680 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:40:56.129680 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:40:56.129680 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:40:56.130664 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:56.130664 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:56.130664 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:40:56.130664 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:56.130664 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:40:56.130664 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:56.130664 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:56.130664 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:56.130664 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:56.130664 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:56.130664 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:56.130664 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:56.130664 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:56.130664 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:56.130664 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:56.130664 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:56.130664 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:56.130664 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:56.131932 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:56.131932 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:56.131932 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:40:56.131932 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:40:56.131932 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:40:56.131932 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:40:56.131932 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:40:56.131932 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:40:56.131932 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:40:56.131932 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:56.133196 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 392/798] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Jun 24 10:40:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:56.134490 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcd498-6540-4eea-b8be-8bd74cb46bae None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:56.134780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcd498-6540-4eea-b8be-8bd74cb46bae None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:56.135062 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcd498-6540-4eea-b8be-8bd74cb46bae None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:56.136462 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 393/799] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:56.137164 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcd498-6540-4eea-b8be-8bd74cb46bae None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:56.164677 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca001b-a560-4e05-929e-904c0f0b2674 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:56.201806 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17e688-3439-4a00-9611-3a1e2662447e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:56.202488 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17e688-3439-4a00-9611-3a1e2662447e None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:56.202780 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17e688-3439-4a00-9611-3a1e2662447e None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:56.203066 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17e688-3439-4a00-9611-3a1e2662447e None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:56.203821 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17e688-3439-4a00-9611-3a1e2662447e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:56.204138 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17e688-3439-4a00-9611-3a1e2662447e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:56.205549 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17e688-3439-4a00-9611-3a1e2662447e None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:56.210467 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 407/800] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jun 24 10:40:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:56.211784 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17e688-3439-4a00-9611-3a1e2662447e None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:56.247273 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcd498-6540-4eea-b8be-8bd74cb46bae None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:56.283537 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a811e2-db3a-4cd2-8970-e570f1370d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:56.284479 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a811e2-db3a-4cd2-8970-e570f1370d57 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:56.284767 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a811e2-db3a-4cd2-8970-e570f1370d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:56.285051 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a811e2-db3a-4cd2-8970-e570f1370d57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:56.286113 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:56.287381 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:56.298615 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a811e2-db3a-4cd2-8970-e570f1370d57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:56.300110 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a811e2-db3a-4cd2-8970-e570f1370d57 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:56.318281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-e0a811e2-db3a-4cd2-8970-e570f1370d57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:56.318281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:56.318281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:56.318281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:56.318281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:56.318281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:56.318281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:56.318281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:56.318281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:56.318281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:56.318281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:56.318281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:56.318281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:56.318281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:56.318281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:56.319354 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:56.319354 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:56.319354 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:56.319354 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:56.319354 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:56.319354 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:56.319354 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:56.319354 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:56.319354 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:56.319354 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:56.319354 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:56.319354 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:56.319354 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:56.319354 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:56.319354 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:56.319354 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:56.319354 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:56.320248 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:56.320248 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:56.320248 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:56.320248 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:56.320248 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 394/801] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:56.320958 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc05c9-9e47-4778-b2e1-f9f6cd5e2cd1 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:56.321061 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc05c9-9e47-4778-b2e1-f9f6cd5e2cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:56.321323 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc05c9-9e47-4778-b2e1-f9f6cd5e2cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:56.328083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17e688-3439-4a00-9611-3a1e2662447e None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:56.340011 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-d4bc05c9-9e47-4778-b2e1-f9f6cd5e2cd1 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:56.341522 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-d4bc05c9-9e47-4778-b2e1-f9f6cd5e2cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:56.362881 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc1685-5e10-48f5-9ea8-15837ae45d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:56.363588 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc1685-5e10-48f5-9ea8-15837ae45d44 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:56.363847 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc1685-5e10-48f5-9ea8-15837ae45d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:56.364121 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc1685-5e10-48f5-9ea8-15837ae45d44 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:56.364988 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc1685-5e10-48f5-9ea8-15837ae45d44 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:56.365327 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc1685-5e10-48f5-9ea8-15837ae45d44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:56.366774 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc1685-5e10-48f5-9ea8-15837ae45d44 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:56.383841 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 408/802] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jun 24 10:40:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:56.384652 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc1685-5e10-48f5-9ea8-15837ae45d44 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:56.411122 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 395/803] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:40:56.412055 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc05c9-9e47-4778-b2e1-f9f6cd5e2cd1 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:56.485330 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc1685-5e10-48f5-9ea8-15837ae45d44 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:56.510412 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:56.519212 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc05c9-9e47-4778-b2e1-f9f6cd5e2cd1 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:56.520158 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e25da-365b-46c2-b19c-03e313ea9490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:56.520837 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e25da-365b-46c2-b19c-03e313ea9490 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:56.521122 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e25da-365b-46c2-b19c-03e313ea9490 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:56.521400 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e25da-365b-46c2-b19c-03e313ea9490 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:56.522429 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e25da-365b-46c2-b19c-03e313ea9490 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:56.522758 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e25da-365b-46c2-b19c-03e313ea9490 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:56.524175 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e25da-365b-46c2-b19c-03e313ea9490 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:56.529010 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 409/804] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jun 24 10:40:56 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:56.530232 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e6f80-4ed7-4890-8388-c277b6f4d2aa None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:56.530528 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e6f80-4ed7-4890-8388-c277b6f4d2aa None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:56.530811 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e6f80-4ed7-4890-8388-c277b6f4d2aa None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:56.532060 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 410/805] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:56.536022 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e6f80-4ed7-4890-8388-c277b6f4d2aa None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:56.537908 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:56.556839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092dbfe-f0ca-4307-b52e-f0eb591a6507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:56.557535 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092dbfe-f0ca-4307-b52e-f0eb591a6507 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:56.557824 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092dbfe-f0ca-4307-b52e-f0eb591a6507 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:56.558101 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092dbfe-f0ca-4307-b52e-f0eb591a6507 None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:56.558839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092dbfe-f0ca-4307-b52e-f0eb591a6507 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:56.559175 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092dbfe-f0ca-4307-b52e-f0eb591a6507 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:56.560569 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092dbfe-f0ca-4307-b52e-f0eb591a6507 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:56.572565 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 396/806] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:56.573363 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092dbfe-f0ca-4307-b52e-f0eb591a6507 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:56.643395 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e6f80-4ed7-4890-8388-c277b6f4d2aa None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:56.673565 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092dbfe-f0ca-4307-b52e-f0eb591a6507 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:56.677134 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424e3cc-1e25-41ff-bf80-fcf06e2fa578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:56.677934 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424e3cc-1e25-41ff-bf80-fcf06e2fa578 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:56.678139 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424e3cc-1e25-41ff-bf80-fcf06e2fa578 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:56.678503 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424e3cc-1e25-41ff-bf80-fcf06e2fa578 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:56.706820 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec0afb-0dde-4745-a3c0-39f0e91c54a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:56.707656 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec0afb-0dde-4745-a3c0-39f0e91c54a3 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:56.707944 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec0afb-0dde-4745-a3c0-39f0e91c54a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:56.708219 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec0afb-0dde-4745-a3c0-39f0e91c54a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:56.718352 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec0afb-0dde-4745-a3c0-39f0e91c54a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:40:56.726089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-0aec0afb-0dde-4745-a3c0-39f0e91c54a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:40:56.726089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:56.726089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:56.726089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:56.726089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:56.726089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:56.726089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:56.726089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:56.726089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:56.726089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:56.726089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:56.726089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:56.726089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:40:56.726089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:40:56.726089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:40:56.726089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:40:56.727016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:40:56.727016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:40:56.727016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:40:56.727016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:40:56.727016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:56.727016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:56.727016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:56.727016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:56.727016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:56.727016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:56.727016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:56.727016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:56.727016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:56.727016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:56.727016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:56.727016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:56.727901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:56.727901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:56.727901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:56.727901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:56.727901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:40:56.727901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:40:56.727901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:40:56.727901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:40:56.727901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:40:56.727901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:40:56.727901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:40:56.727901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:56.727901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 397/807] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 10:40:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:56.728581 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec0afb-0dde-4745-a3c0-39f0e91c54a3 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:56.734833 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:56.746636 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424e3cc-1e25-41ff-bf80-fcf06e2fa578 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:56.748129 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424e3cc-1e25-41ff-bf80-fcf06e2fa578 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:56.767110 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:56.832988 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec0afb-0dde-4745-a3c0-39f0e91c54a3 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:56.845826 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 411/808] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:40:56 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:40:56.847113 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5e889-440e-4a13-8b0d-a9105a95e556 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:56.847431 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5e889-440e-4a13-8b0d-a9105a95e556 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:56.847769 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5e889-440e-4a13-8b0d-a9105a95e556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:56.863765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-18a5e889-440e-4a13-8b0d-a9105a95e556 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:56.864957 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-18a5e889-440e-4a13-8b0d-a9105a95e556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:56.868156 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e25e0-3561-4714-942e-fc10b6f80ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:56.868828 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e25e0-3561-4714-942e-fc10b6f80ac1 None admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:56.869113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e25e0-3561-4714-942e-fc10b6f80ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:56.869391 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e25e0-3561-4714-942e-fc10b6f80ac1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:56.870130 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e25e0-3561-4714-942e-fc10b6f80ac1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:56.871535 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e25e0-3561-4714-942e-fc10b6f80ac1 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:56.891706 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 398/809] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Jun 24 10:40:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:40:56.892721 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e25e0-3561-4714-942e-fc10b6f80ac1 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:56.942858 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 412/810] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:40:56.943652 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5e889-440e-4a13-8b0d-a9105a95e556 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:56.966589 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:57.019439 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:57.030755 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e25e0-3561-4714-942e-fc10b6f80ac1 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:57.060364 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5e889-440e-4a13-8b0d-a9105a95e556 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:57.074137 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac58d2-2ce0-40ac-a440-6df1774b65f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:57.074963 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac58d2-2ce0-40ac-a440-6df1774b65f4 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:57.075281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac58d2-2ce0-40ac-a440-6df1774b65f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:57.075564 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac58d2-2ce0-40ac-a440-6df1774b65f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:57.083221 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac58d2-2ce0-40ac-a440-6df1774b65f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:57.084670 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac58d2-2ce0-40ac-a440-6df1774b65f4 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:57.098987 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b6c57-5f75-4ef8-b7aa-c2aed523421a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:57.099271 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-63ac58d2-2ce0-40ac-a440-6df1774b65f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:57.099271 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:57.099271 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:57.099271 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:57.099271 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:57.099271 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:57.099271 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:57.099271 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:57.099271 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:57.099271 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:57.099271 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:57.099271 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:57.099271 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:40:57.099271 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:40:57.099271 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:40:57.100901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:40:57.100901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:57.100901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:57.100901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:57.100901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:57.100901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:57.100901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:57.100901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:57.100901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:57.100901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:57.100901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:57.100901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:57.100901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:57.100901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:57.100901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:57.100901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:57.100901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:57.101869 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:40:57.101869 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:40:57.101869 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:40:57.101869 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:40:57.101869 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:40:57.101869 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:40:57.101869 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:57.101869 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:57.102295 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b6c57-5f75-4ef8-b7aa-c2aed523421a None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:57.102295 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b6c57-5f75-4ef8-b7aa-c2aed523421a None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:57.102295 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b6c57-5f75-4ef8-b7aa-c2aed523421a None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:57.102495 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 399/811] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:40:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:57.102564 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b6c57-5f75-4ef8-b7aa-c2aed523421a None admin] RBAC: Adding query filter params (name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:57.102564 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b6c57-5f75-4ef8-b7aa-c2aed523421a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:57.102700 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac58d2-2ce0-40ac-a440-6df1774b65f4 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:57.103408 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b6c57-5f75-4ef8-b7aa-c2aed523421a None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:57.112875 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 413/812] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 10:40:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:57.117252 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b6c57-5f75-4ef8-b7aa-c2aed523421a None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:57.202747 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:57.217519 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac58d2-2ce0-40ac-a440-6df1774b65f4 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:57.225747 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b6c57-5f75-4ef8-b7aa-c2aed523421a None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:57.256533 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6a0c8-1278-4f84-97ee-ff3f36ff900d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:57.257421 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6a0c8-1278-4f84-97ee-ff3f36ff900d None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:57.257713 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6a0c8-1278-4f84-97ee-ff3f36ff900d None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:57.257996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6a0c8-1278-4f84-97ee-ff3f36ff900d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:57.260589 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48665fb3-ac6c-44de-af1c-87c7691de2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:57.261461 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48665fb3-ac6c-44de-af1c-87c7691de2b8 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:57.261745 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48665fb3-ac6c-44de-af1c-87c7691de2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:57.262020 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48665fb3-ac6c-44de-af1c-87c7691de2b8 None admin] PATH_INFO: `/v3/services/network` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:57.262674 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48665fb3-ac6c-44de-af1c-87c7691de2b8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:57.264079 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48665fb3-ac6c-44de-af1c-87c7691de2b8 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:57.269123 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc6a0c8-1278-4f84-97ee-ff3f36ff900d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:57.270569 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc6a0c8-1278-4f84-97ee-ff3f36ff900d None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:57.276994 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-48665fb3-ac6c-44de-af1c-87c7691de2b8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 10:40:57.276994 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:57.276994 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:40:57.276994 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:40:57.276994 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:40:57.276994 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:40:57.276994 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:40:57.276994 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:40:57.276994 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 10:40:57.276994 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:57.276994 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:40:57.276994 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:57.276994 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:57.276994 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:57.276994 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:57.276994 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:57.276994 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:57.277958 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:57.277958 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:57.277958 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:57.277958 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:57.277958 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:57.277958 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:57.277958 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:40:57.277958 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:40:57.277958 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:40:57.277958 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:40:57.277958 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:57.277958 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:57.277958 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:57.277958 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:57.277958 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:57.277958 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:57.278798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:57.278798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:57.278798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:57.278798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:57.278798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:57.278798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:57.278798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:57.278798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:57.278798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:57.278798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:57.278798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:40:57.278798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:40:57.278798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 10:40:57.278798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:57.283512 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 414/813] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:40:57 2022] GET /identity/v3/services/network => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:57.284219 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48665fb3-ac6c-44de-af1c-87c7691de2b8 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:57.291730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-7dc6a0c8-1278-4f84-97ee-ff3f36ff900d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:57.291730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:57.291730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:57.291730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:57.291730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:57.291730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:57.291730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:57.291730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:57.291730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:57.291730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:57.291730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:57.291730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:57.291730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:57.291730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:57.291730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:57.292638 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:57.292638 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:57.292638 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:57.292638 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:57.292638 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:57.292638 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:57.292638 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:57.292638 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:57.292638 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:57.292638 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:57.292638 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:57.292638 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:57.292638 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:57.292638 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:57.292638 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:57.292638 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:57.292638 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:57.295217 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:57.295217 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:57.295217 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:57.295217 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:57.297853 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 400/814] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:57.298295 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6a0c8-1278-4f84-97ee-ff3f36ff900d None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:57.302031 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:57.397275 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48665fb3-ac6c-44de-af1c-87c7691de2b8 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:57.404880 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6a0c8-1278-4f84-97ee-ff3f36ff900d None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:57.434700 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b959152-d30f-478e-9c23-76faba9af9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:57.435403 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b959152-d30f-478e-9c23-76faba9af9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:57.435693 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b959152-d30f-478e-9c23-76faba9af9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:57.435978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b959152-d30f-478e-9c23-76faba9af9a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:57.436770 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b959152-d30f-478e-9c23-76faba9af9a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:57.437085 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b959152-d30f-478e-9c23-76faba9af9a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:57.438879 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b959152-d30f-478e-9c23-76faba9af9a2 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:57.441428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560c562-c98c-437b-bd46-3e2988a243ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:57.442231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560c562-c98c-437b-bd46-3e2988a243ac None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:57.442514 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560c562-c98c-437b-bd46-3e2988a243ac None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:57.442787 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560c562-c98c-437b-bd46-3e2988a243ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:57.451843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 415/815] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:40:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:57.452651 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b959152-d30f-478e-9c23-76faba9af9a2 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:57.455394 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:57.458484 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1560c562-c98c-437b-bd46-3e2988a243ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:57.461077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1560c562-c98c-437b-bd46-3e2988a243ac None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:57.479796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-1560c562-c98c-437b-bd46-3e2988a243ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:57.479796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:57.479796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:57.479796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:57.479796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:57.479796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:57.479796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:57.479796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:57.479796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:57.479796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:57.479796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:57.479796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:57.479796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:57.479796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:57.479796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:57.480736 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:57.480736 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:57.480736 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:57.480736 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:57.480736 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:57.480736 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:57.480736 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:57.480736 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:57.480736 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:57.480736 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:57.480736 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:57.480736 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:57.480736 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:57.480736 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:57.480736 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:57.480736 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:57.480736 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:57.481622 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:57.481622 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:57.481622 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:57.481622 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:57.485583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 401/816] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:57.486399 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560c562-c98c-437b-bd46-3e2988a243ac None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:57.546639 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:57.568642 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b959152-d30f-478e-9c23-76faba9af9a2 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:57.602458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560c562-c98c-437b-bd46-3e2988a243ac None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:57.614872 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd71f41-d1af-4c9f-8fbd-5e7347f39f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:57.615901 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd71f41-d1af-4c9f-8fbd-5e7347f39f8b None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:57.616193 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd71f41-d1af-4c9f-8fbd-5e7347f39f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:57.616476 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd71f41-d1af-4c9f-8fbd-5e7347f39f8b None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:57.617202 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd71f41-d1af-4c9f-8fbd-5e7347f39f8b None admin] RBAC: Adding query filter params (name=network) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:57.617514 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd71f41-d1af-4c9f-8fbd-5e7347f39f8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:57.618898 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd71f41-d1af-4c9f-8fbd-5e7347f39f8b None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:57.631191 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 416/817] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jun 24 10:40:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:57.632063 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd71f41-d1af-4c9f-8fbd-5e7347f39f8b None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:57.642141 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b273115-a98d-47c7-b18e-60227bcfbc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:57.642923 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b273115-a98d-47c7-b18e-60227bcfbc81 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:57.643251 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b273115-a98d-47c7-b18e-60227bcfbc81 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:57.643725 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b273115-a98d-47c7-b18e-60227bcfbc81 None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:57.644262 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b273115-a98d-47c7-b18e-60227bcfbc81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:57.644573 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b273115-a98d-47c7-b18e-60227bcfbc81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:57.645962 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b273115-a98d-47c7-b18e-60227bcfbc81 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:57.665892 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 402/818] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:57.665892 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b273115-a98d-47c7-b18e-60227bcfbc81 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:57.722532 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:57.768270 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd71f41-d1af-4c9f-8fbd-5e7347f39f8b None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:57.769408 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b273115-a98d-47c7-b18e-60227bcfbc81 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:57.786266 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:57.807292 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff6797-1a08-496d-ae15-9adc4b6fe9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:57.807973 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff6797-1a08-496d-ae15-9adc4b6fe9fa None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:57.808258 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff6797-1a08-496d-ae15-9adc4b6fe9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:57.808358 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a20e71-ab9c-43d3-aa79-cdfb2e8d7278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:57.808531 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff6797-1a08-496d-ae15-9adc4b6fe9fa None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:57.809154 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a20e71-ab9c-43d3-aa79-cdfb2e8d7278 None admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:57.809250 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff6797-1a08-496d-ae15-9adc4b6fe9fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:57.809432 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a20e71-ab9c-43d3-aa79-cdfb2e8d7278 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:57.809612 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff6797-1a08-496d-ae15-9adc4b6fe9fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:57.809706 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a20e71-ab9c-43d3-aa79-cdfb2e8d7278 None admin] PATH_INFO: `/v3/projects/61b2f5f9674c4fd3a1ec5db2f3b4b26e/users/ff592d9ebd4241019625828ddd41aee8/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:57.810990 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff6797-1a08-496d-ae15-9adc4b6fe9fa None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:57.811726 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a20e71-ab9c-43d3-aa79-cdfb2e8d7278 None admin] RBAC: Authorizing `identity:create_grant(project_id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user_id=ff592d9ebd4241019625828ddd41aee8, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:57.814280 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a20e71-ab9c-43d3-aa79-cdfb2e8d7278 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:57.824588 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 403/819] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:57.825950 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff6797-1a08-496d-ae15-9adc4b6fe9fa None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:57.830311 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 417/820] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 10:40:57 2022] PUT /identity/v3/projects/61b2f5f9674c4fd3a1ec5db2f3b4b26e/users/ff592d9ebd4241019625828ddd41aee8/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:40:57.831413 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a20e71-ab9c-43d3-aa79-cdfb2e8d7278 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:57.949792 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff6797-1a08-496d-ae15-9adc4b6fe9fa None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:57.982777 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a20e71-ab9c-43d3-aa79-cdfb2e8d7278 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:57.997460 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695338c-66b5-41f4-a077-f15fd7d37b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:57.998660 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695338c-66b5-41f4-a077-f15fd7d37b81 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:57.999695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695338c-66b5-41f4-a077-f15fd7d37b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:58.000170 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695338c-66b5-41f4-a077-f15fd7d37b81 None admin] PATH_INFO: `/v3/services` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:58.001313 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695338c-66b5-41f4-a077-f15fd7d37b81 None admin] RBAC: Adding query filter params (type=network) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:58.001796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695338c-66b5-41f4-a077-f15fd7d37b81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:58.003819 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695338c-66b5-41f4-a077-f15fd7d37b81 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:58.012811 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 404/821] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jun 24 10:40:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:58.013878 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695338c-66b5-41f4-a077-f15fd7d37b81 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:58.015702 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:58.029531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b6c66-0bc6-48cb-940a-2a34d42d5244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:58.030403 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b6c66-0bc6-48cb-940a-2a34d42d5244 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:58.030687 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b6c66-0bc6-48cb-940a-2a34d42d5244 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:58.030962 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b6c66-0bc6-48cb-940a-2a34d42d5244 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:58.040965 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b6c66-0bc6-48cb-940a-2a34d42d5244 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:58.042588 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b6c66-0bc6-48cb-940a-2a34d42d5244 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:58.060936 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-af0b6c66-0bc6-48cb-940a-2a34d42d5244 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:58.060936 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:58.060936 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:58.060936 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:58.060936 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:58.060936 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:58.060936 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:58.060936 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:58.060936 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:58.060936 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:58.060936 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:58.060936 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:58.060936 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:40:58.060936 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:40:58.060936 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:40:58.061909 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:40:58.061909 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:58.061909 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:58.061909 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:58.061909 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:58.061909 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:58.061909 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:58.061909 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:58.061909 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:58.061909 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:58.061909 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:58.061909 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:58.061909 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:58.061909 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:58.061909 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:58.061909 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:58.061909 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:58.063133 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:40:58.063133 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:40:58.063133 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:40:58.063133 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:40:58.063133 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:40:58.063133 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:40:58.063133 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:58.063133 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:58.070085 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 418/822] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:40:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:58.071409 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b6c66-0bc6-48cb-940a-2a34d42d5244 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:58.153012 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695338c-66b5-41f4-a077-f15fd7d37b81 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:58.183566 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:58.191788 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a48d1f-bd13-4414-a346-069d0e72bbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:58.192625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a48d1f-bd13-4414-a346-069d0e72bbeb None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:58.192909 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a48d1f-bd13-4414-a346-069d0e72bbeb None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:58.193186 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a48d1f-bd13-4414-a346-069d0e72bbeb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:58.202230 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a48d1f-bd13-4414-a346-069d0e72bbeb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:58.203729 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a48d1f-bd13-4414-a346-069d0e72bbeb None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:58.209475 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b6c66-0bc6-48cb-940a-2a34d42d5244 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:58.219823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-f9a48d1f-bd13-4414-a346-069d0e72bbeb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 10:40:58.219823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:58.219823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:58.219823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:58.219823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:58.219823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:58.219823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:58.219823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:58.219823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:58.219823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:58.219823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:58.219823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:58.219823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:40:58.219823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:40:58.219823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:40:58.219823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:40:58.220780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:58.220780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:58.220780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:40:58.220780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:58.220780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:40:58.220780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:40:58.220780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:58.220780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:58.220780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:58.220780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:58.220780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:58.220780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:58.220780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:58.220780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:58.220780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:58.220780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:58.220780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:58.220780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:58.222336 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:58.222336 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:58.222336 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:40:58.222336 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:40:58.222336 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:40:58.222336 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:40:58.222336 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:40:58.222336 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:40:58.222336 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 10:40:58.222336 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:58.222336 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 405/823] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jun 24 10:40:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:58.222336 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a48d1f-bd13-4414-a346-069d0e72bbeb None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:58.254544 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132140f1-75a6-4c30-b01e-000bb584d884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:58.256062 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132140f1-75a6-4c30-b01e-000bb584d884 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:58.256449 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132140f1-75a6-4c30-b01e-000bb584d884 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:58.256741 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132140f1-75a6-4c30-b01e-000bb584d884 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:58.257819 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132140f1-75a6-4c30-b01e-000bb584d884 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:58.259389 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132140f1-75a6-4c30-b01e-000bb584d884 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:58.288334 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 419/824] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Jun 24 10:40:58 2022] POST /identity/v3/endpoints => generated 327 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:40:58.288334 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132140f1-75a6-4c30-b01e-000bb584d884 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:58.387629 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:58.420087 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:58.430414 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a48d1f-bd13-4414-a346-069d0e72bbeb None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:58.461552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132140f1-75a6-4c30-b01e-000bb584d884 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:58.494244 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61977b-43cd-4bb7-89ef-d3c9de2b7d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:58.495458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61977b-43cd-4bb7-89ef-d3c9de2b7d43 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:58.495458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61977b-43cd-4bb7-89ef-d3c9de2b7d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:58.495631 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61977b-43cd-4bb7-89ef-d3c9de2b7d43 None admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:58.496337 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b61977b-43cd-4bb7-89ef-d3c9de2b7d43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:58.496648 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b61977b-43cd-4bb7-89ef-d3c9de2b7d43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:58.498092 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b61977b-43cd-4bb7-89ef-d3c9de2b7d43 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:58.513831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 406/825] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:40:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:58.518986 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61977b-43cd-4bb7-89ef-d3c9de2b7d43 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:58.523848 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176cb0ff-9393-4e67-a40f-7ab6d6311127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:58.524562 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cb0ff-9393-4e67-a40f-7ab6d6311127 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:58.524966 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cb0ff-9393-4e67-a40f-7ab6d6311127 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:58.525250 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cb0ff-9393-4e67-a40f-7ab6d6311127 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:58.526118 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176cb0ff-9393-4e67-a40f-7ab6d6311127 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:58.526429 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176cb0ff-9393-4e67-a40f-7ab6d6311127 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:58.527921 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176cb0ff-9393-4e67-a40f-7ab6d6311127 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:58.549150 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 420/826] 10.222.0.16 () {56 vars in 1149 bytes} [Fri Jun 24 10:40:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:58.554785 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176cb0ff-9393-4e67-a40f-7ab6d6311127 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:58.640966 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61977b-43cd-4bb7-89ef-d3c9de2b7d43 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:58.681455 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e3815-1ef8-43b6-9e07-8719f9a1de40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:58.682134 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e3815-1ef8-43b6-9e07-8719f9a1de40 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:58.682414 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e3815-1ef8-43b6-9e07-8719f9a1de40 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:58.682687 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e3815-1ef8-43b6-9e07-8719f9a1de40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:58.682876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:58.683561 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e3815-1ef8-43b6-9e07-8719f9a1de40 None admin] RBAC: Adding query filter params (role.id=4867b69c45554ce18e23167c05a02175, scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user.id=e8034bad51144002a7386c975e412992) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:58.684151 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e3815-1ef8-43b6-9e07-8719f9a1de40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:58.685316 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e3815-1ef8-43b6-9e07-8719f9a1de40 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:58.691130 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176cb0ff-9393-4e67-a40f-7ab6d6311127 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:58.694448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 407/827] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:40:58 2022] GET /identity/v3/role_assignments?user.id=e8034bad51144002a7386c975e412992&scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e&role.id=4867b69c45554ce18e23167c05a02175 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:40:58.732109 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78755522-dffe-4331-9d41-b612ad04a6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:58.733250 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78755522-dffe-4331-9d41-b612ad04a6ba None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:58.733680 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78755522-dffe-4331-9d41-b612ad04a6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:58.734098 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78755522-dffe-4331-9d41-b612ad04a6ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:58.746150 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78755522-dffe-4331-9d41-b612ad04a6ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:58.747924 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78755522-dffe-4331-9d41-b612ad04a6ba None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:58.768537 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-78755522-dffe-4331-9d41-b612ad04a6ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:58.768537 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:58.768537 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:58.768537 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:58.768537 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:58.768537 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:58.768537 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:58.768537 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:58.768537 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:58.768537 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:58.768537 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:58.768537 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:58.768537 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:40:58.768537 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:40:58.768537 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:40:58.770531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:40:58.770531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:58.770531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:58.770531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:58.770531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:58.770531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:58.770531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:58.770531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:58.770531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:58.770531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:58.770531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:58.770531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:58.770531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:58.770531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:58.770531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:58.770531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:58.770531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:58.772618 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:40:58.772618 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:40:58.772618 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:40:58.772618 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:58.775646 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 421/828] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:40:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:58.781618 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e3815-1ef8-43b6-9e07-8719f9a1de40 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:58.810277 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:58.900919 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e3815-1ef8-43b6-9e07-8719f9a1de40 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:58.936913 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425351b3-3dd1-4300-98c3-14d9a87920e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:58.937961 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425351b3-3dd1-4300-98c3-14d9a87920e2 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:58.938237 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425351b3-3dd1-4300-98c3-14d9a87920e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:58.938510 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425351b3-3dd1-4300-98c3-14d9a87920e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:58.939280 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425351b3-3dd1-4300-98c3-14d9a87920e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:58.939642 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425351b3-3dd1-4300-98c3-14d9a87920e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:58.941072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425351b3-3dd1-4300-98c3-14d9a87920e2 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:58.953340 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 408/829] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:58.958890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78755522-dffe-4331-9d41-b612ad04a6ba None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:59.059575 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87650c27-da13-483a-9c36-23c552adb823 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:59.059756 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87650c27-da13-483a-9c36-23c552adb823 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:59.060324 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87650c27-da13-483a-9c36-23c552adb823 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:59.061678 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 409/830] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:40:59.067185 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78755522-dffe-4331-9d41-b612ad04a6ba None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:59.067354 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfac77e-e725-4cb2-9adb-638233b8b6dc None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:59.067588 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfac77e-e725-4cb2-9adb-638233b8b6dc None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:59.067874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfac77e-e725-4cb2-9adb-638233b8b6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:59.088974 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-dcfac77e-e725-4cb2-9adb-638233b8b6dc None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:59.090351 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-dcfac77e-e725-4cb2-9adb-638233b8b6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:59.119659 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fcde43-6690-4cfd-8068-7aee36632160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:59.120714 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcde43-6690-4cfd-8068-7aee36632160 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:59.121599 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcde43-6690-4cfd-8068-7aee36632160 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:59.121905 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcde43-6690-4cfd-8068-7aee36632160 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:59.133437 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fcde43-6690-4cfd-8068-7aee36632160 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:59.136481 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fcde43-6690-4cfd-8068-7aee36632160 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:59.157267 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-e3fcde43-6690-4cfd-8068-7aee36632160 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:59.157267 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:59.157267 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:59.157267 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:59.157267 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:59.157267 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:59.157267 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:59.157267 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:59.157267 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:59.157267 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:59.157267 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:59.157267 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:59.157267 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:40:59.157267 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:40:59.157267 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:40:59.158409 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:40:59.158409 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:59.158409 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:59.158409 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:59.158409 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:59.158409 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:59.158409 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:59.158409 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:59.158409 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:59.158409 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:59.158409 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:59.158409 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:59.158409 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:59.158409 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:59.158409 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:59.158409 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:59.158409 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:59.163769 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:40:59.163769 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:40:59.163769 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:40:59.163769 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:40:59.163769 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:40:59.163769 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:40:59.163769 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:40:59.163769 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:40:59.163769 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 422/831] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:40:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:40:59.166831 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fcde43-6690-4cfd-8068-7aee36632160 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:59.182497 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 410/832] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:40:59.183597 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:59.209412 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfac77e-e725-4cb2-9adb-638233b8b6dc None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:59.228564 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:59.309881 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fcde43-6690-4cfd-8068-7aee36632160 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:59.341230 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfac77e-e725-4cb2-9adb-638233b8b6dc None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:59.354480 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724f3e8-68fc-4277-bec9-4f1e675fbc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:59.355568 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724f3e8-68fc-4277-bec9-4f1e675fbc61 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:59.356076 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724f3e8-68fc-4277-bec9-4f1e675fbc61 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:59.356552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724f3e8-68fc-4277-bec9-4f1e675fbc61 None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:59.357647 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724f3e8-68fc-4277-bec9-4f1e675fbc61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:59.358156 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724f3e8-68fc-4277-bec9-4f1e675fbc61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:59.359924 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724f3e8-68fc-4277-bec9-4f1e675fbc61 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:59.373902 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 423/833] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:40:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:59.379556 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724f3e8-68fc-4277-bec9-4f1e675fbc61 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:59.392219 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a933c21-6038-4161-8ada-71b2db783afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:59.393458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a933c21-6038-4161-8ada-71b2db783afa None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:59.393736 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a933c21-6038-4161-8ada-71b2db783afa None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:59.394016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a933c21-6038-4161-8ada-71b2db783afa None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:59.394964 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a933c21-6038-4161-8ada-71b2db783afa None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:59.396695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a933c21-6038-4161-8ada-71b2db783afa None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:59.412937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-3a933c21-6038-4161-8ada-71b2db783afa None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 10:40:59.412937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:59.412937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:40:59.412937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:40:59.412937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:40:59.412937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:40:59.412937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:40:59.412937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:40:59.412937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 10:40:59.412937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:59.412937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:40:59.412937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:59.412937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:40:59.412937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:40:59.412937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:40:59.412937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:40:59.412937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:40:59.414021 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:40:59.414021 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:40:59.414021 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:40:59.414021 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:40:59.414021 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:40:59.414021 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:40:59.414021 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:40:59.414021 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:40:59.414021 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:40:59.414021 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:40:59.414021 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:40:59.414021 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:40:59.414021 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:40:59.414021 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:40:59.414021 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:40:59.414021 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:40:59.420080 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:40:59.420080 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:40:59.420080 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:40:59.420080 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:40:59.420080 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:40:59.420080 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:40:59.420080 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:40:59.420080 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:40:59.420080 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:40:59.420080 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:40:59.420080 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:40:59.420080 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:40:59.420080 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 10:40:59.420080 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:40:59.420080 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 411/834] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 10:40:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:40:59.422867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a933c21-6038-4161-8ada-71b2db783afa None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:59.460330 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:59.501645 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724f3e8-68fc-4277-bec9-4f1e675fbc61 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:59.532321 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:59.545618 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc73517-c174-4573-aaca-009cda33120b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:59.546957 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc73517-c174-4573-aaca-009cda33120b None admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:59.547467 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc73517-c174-4573-aaca-009cda33120b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:59.547938 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc73517-c174-4573-aaca-009cda33120b None admin] PATH_INFO: `/v3/projects/61b2f5f9674c4fd3a1ec5db2f3b4b26e/users/4dfddd72dfa84ce39fe62112224b425d/roles/7bab53c1ac3d4e04b18c87286e2ab0aa` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:59.560687 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a933c21-6038-4161-8ada-71b2db783afa None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:59.600486 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad310e-395f-4b08-a43b-b01234d12d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:59.601134 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad310e-395f-4b08-a43b-b01234d12d36 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:59.601423 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad310e-395f-4b08-a43b-b01234d12d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:59.601711 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad310e-395f-4b08-a43b-b01234d12d36 None admin] PATH_INFO: `/v3/services` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:59.602435 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad310e-395f-4b08-a43b-b01234d12d36 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:59.602755 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad310e-395f-4b08-a43b-b01234d12d36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:59.604203 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad310e-395f-4b08-a43b-b01234d12d36 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:59.609966 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 412/835] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 10:40:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:40:59.616651 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad310e-395f-4b08-a43b-b01234d12d36 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:59.720678 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc73517-c174-4573-aaca-009cda33120b None admin] RBAC: Authorizing `identity:create_grant(project_id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user_id=4dfddd72dfa84ce39fe62112224b425d, role_id=7bab53c1ac3d4e04b18c87286e2ab0aa)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:59.724317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc73517-c174-4573-aaca-009cda33120b None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:59.748890 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad310e-395f-4b08-a43b-b01234d12d36 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:59.749392 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 424/836] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 10:40:59 2022] PUT /identity/v3/projects/61b2f5f9674c4fd3a1ec5db2f3b4b26e/users/4dfddd72dfa84ce39fe62112224b425d/roles/7bab53c1ac3d4e04b18c87286e2ab0aa => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:40:59.788863 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d7b80-b2ba-4d76-b907-769c3b9a0f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:59.789568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d7b80-b2ba-4d76-b907-769c3b9a0f82 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:59.789912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d7b80-b2ba-4d76-b907-769c3b9a0f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:59.790195 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d7b80-b2ba-4d76-b907-769c3b9a0f82 None admin] PATH_INFO: `/v3/services` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:59.790983 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d7b80-b2ba-4d76-b907-769c3b9a0f82 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:59.791336 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d7b80-b2ba-4d76-b907-769c3b9a0f82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:59.792741 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d7b80-b2ba-4d76-b907-769c3b9a0f82 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:59.798528 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 413/837] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 10:40:59 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:40:59.992711 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dc3c3-0dd9-4911-be23-5068d3a08c05 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:59.993097 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dc3c3-0dd9-4911-be23-5068d3a08c05 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:59.993301 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dc3c3-0dd9-4911-be23-5068d3a08c05 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:59.994632 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 425/838] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:41:00.000344 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138a2c7-70c3-4f59-bf11-7398d0e25a59 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:00.000641 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138a2c7-70c3-4f59-bf11-7398d0e25a59 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:00.000922 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138a2c7-70c3-4f59-bf11-7398d0e25a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:00.013726 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:00.021014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-7138a2c7-70c3-4f59-bf11-7398d0e25a59 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:00.023852 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-7138a2c7-70c3-4f59-bf11-7398d0e25a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:00.095236 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 414/839] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:40:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:41:00.119941 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252dc3c3-0dd9-4911-be23-5068d3a08c05 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:00.229182 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252dc3c3-0dd9-4911-be23-5068d3a08c05 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:00.248334 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:00.265975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a03668-4fb3-455c-83e4-6909f150b873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:00.266855 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a03668-4fb3-455c-83e4-6909f150b873 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:00.267142 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a03668-4fb3-455c-83e4-6909f150b873 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:00.267442 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a03668-4fb3-455c-83e4-6909f150b873 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:00.279560 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a03668-4fb3-455c-83e4-6909f150b873 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:41:00.287968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-27a03668-4fb3-455c-83e4-6909f150b873 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:41:00.287968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:00.287968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:00.287968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:00.287968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:00.287968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:00.287968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:00.287968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:00.287968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:00.287968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:00.287968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:00.287968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:00.287968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:41:00.287968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:41:00.287968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:41:00.287968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:41:00.288917 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:41:00.288917 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:41:00.288917 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:41:00.288917 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:41:00.288917 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:00.288917 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:00.288917 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:00.288917 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:00.288917 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:00.288917 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:00.288917 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:00.288917 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:00.288917 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:00.288917 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:00.288917 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:00.288917 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:00.289786 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:00.289786 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:00.289786 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:00.289786 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:00.289786 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:41:00.289786 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:41:00.289786 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:41:00.289786 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:41:00.289786 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:41:00.289786 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:41:00.289786 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:41:00.289786 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:00.293022 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 426/840] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:41:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:00.295679 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138a2c7-70c3-4f59-bf11-7398d0e25a59 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:00.408663 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138a2c7-70c3-4f59-bf11-7398d0e25a59 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:00.446488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b727b-3e18-4596-b8ad-1781945eea9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:00.447276 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b727b-3e18-4596-b8ad-1781945eea9d None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:00.447474 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b727b-3e18-4596-b8ad-1781945eea9d None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:00.447737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b727b-3e18-4596-b8ad-1781945eea9d None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:00.448492 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b727b-3e18-4596-b8ad-1781945eea9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:00.448798 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b727b-3e18-4596-b8ad-1781945eea9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:00.450168 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b727b-3e18-4596-b8ad-1781945eea9d None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:00.452545 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:00.465096 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 415/841] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:41:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:00.467005 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a03668-4fb3-455c-83e4-6909f150b873 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:00.574399 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a03668-4fb3-455c-83e4-6909f150b873 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:00.609851 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a1e54-4063-487d-8fd9-5364cd1dd6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:00.610660 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a1e54-4063-487d-8fd9-5364cd1dd6be None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:00.610939 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a1e54-4063-487d-8fd9-5364cd1dd6be None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:00.611234 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a1e54-4063-487d-8fd9-5364cd1dd6be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:00.622371 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a1e54-4063-487d-8fd9-5364cd1dd6be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:00.623856 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a1e54-4063-487d-8fd9-5364cd1dd6be None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:00.642587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-0a9a1e54-4063-487d-8fd9-5364cd1dd6be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:41:00.642587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:00.642587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:00.642587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:00.642587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:00.642587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:00.642587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:00.642587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:00.642587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:00.642587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:00.642587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:00.642587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:00.642587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:41:00.642587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:41:00.642587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:41:00.643626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:41:00.643626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:00.643626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:00.643626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:00.643626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:00.643626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:00.643626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:00.643626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:00.643626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:00.643626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:00.643626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:00.643626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:00.643626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:00.643626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:00.643626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:00.643626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:00.643626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:00.644504 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:41:00.644504 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:41:00.644504 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:41:00.644504 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:00.649191 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 427/842] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:41:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:00.650616 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b727b-3e18-4596-b8ad-1781945eea9d None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:00.757588 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b727b-3e18-4596-b8ad-1781945eea9d None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:00.792925 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbcd7d1-395e-49b0-b256-32eba06b4f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:00.793653 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcd7d1-395e-49b0-b256-32eba06b4f51 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:00.793938 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcd7d1-395e-49b0-b256-32eba06b4f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:00.794214 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcd7d1-395e-49b0-b256-32eba06b4f51 None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:00.794933 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbcd7d1-395e-49b0-b256-32eba06b4f51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:00.795261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbcd7d1-395e-49b0-b256-32eba06b4f51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:00.796760 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbcd7d1-395e-49b0-b256-32eba06b4f51 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:00.814608 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 416/843] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:00.816036 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a1e54-4063-487d-8fd9-5364cd1dd6be None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:00.843390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c5da6-1290-4170-8feb-5cb3553b63ca None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:00.843708 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c5da6-1290-4170-8feb-5cb3553b63ca None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:00.843966 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c5da6-1290-4170-8feb-5cb3553b63ca None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:00.845611 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 417/844] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:41:00.849113 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:00.852181 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39651689-423f-4bc8-a320-11e51ec6563c None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:00.852476 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39651689-423f-4bc8-a320-11e51ec6563c None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:00.852761 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39651689-423f-4bc8-a320-11e51ec6563c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:00.872436 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-39651689-423f-4bc8-a320-11e51ec6563c None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:00.873856 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-39651689-423f-4bc8-a320-11e51ec6563c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:00.940741 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:00.941920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a1e54-4063-487d-8fd9-5364cd1dd6be None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:00.957932 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 418/845] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:41:00.982988 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39651689-423f-4bc8-a320-11e51ec6563c None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:00.983242 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accd19a-ec4a-4233-b1c8-b0df3bebd35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:00.984037 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accd19a-ec4a-4233-b1c8-b0df3bebd35f None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:00.984319 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accd19a-ec4a-4233-b1c8-b0df3bebd35f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:00.984596 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accd19a-ec4a-4233-b1c8-b0df3bebd35f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:00.995568 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2accd19a-ec4a-4233-b1c8-b0df3bebd35f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:00.997040 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2accd19a-ec4a-4233-b1c8-b0df3bebd35f None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:01.015725 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-2accd19a-ec4a-4233-b1c8-b0df3bebd35f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 10:41:01.015725 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:01.015725 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:01.015725 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:01.015725 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:01.015725 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:01.015725 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:01.015725 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:01.015725 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:01.015725 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:01.015725 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:01.015725 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:01.015725 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:41:01.015725 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:41:01.015725 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:41:01.015725 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:41:01.016918 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:01.016918 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:01.016918 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:41:01.016918 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:41:01.016918 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:41:01.016918 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:41:01.016918 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:01.016918 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:01.016918 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:01.016918 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:01.016918 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:01.016918 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:01.016918 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:01.016918 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:01.016918 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:01.016918 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:01.016918 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:01.016918 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:01.018412 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:01.018412 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:01.018412 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:41:01.018412 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:41:01.018412 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:41:01.018412 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:41:01.018412 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:41:01.018412 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:41:01.018412 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 10:41:01.018412 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:01.023168 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 428/846] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:41:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:01.024132 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accd19a-ec4a-4233-b1c8-b0df3bebd35f None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:01.102604 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39651689-423f-4bc8-a320-11e51ec6563c None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:01.140766 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1e53f-4d57-4f7d-bbdc-b1de649d5cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:01.141642 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1e53f-4d57-4f7d-bbdc-b1de649d5cff None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:01.141931 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1e53f-4d57-4f7d-bbdc-b1de649d5cff None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:01.142210 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1e53f-4d57-4f7d-bbdc-b1de649d5cff None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:01.142874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1e53f-4d57-4f7d-bbdc-b1de649d5cff None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:01.144452 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1e53f-4d57-4f7d-bbdc-b1de649d5cff None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:01.148357 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:01.158449 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accd19a-ec4a-4233-b1c8-b0df3bebd35f None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:01.162196 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-7ef1e53f-4d57-4f7d-bbdc-b1de649d5cff None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 10:41:01.162196 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:01.162196 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:41:01.162196 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:41:01.162196 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:41:01.162196 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:41:01.162196 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:41:01.162196 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:41:01.162196 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 10:41:01.162196 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:01.162196 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:41:01.162196 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:01.162196 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:01.162196 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:01.162196 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:01.162196 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:01.163721 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:01.163721 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:01.163721 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:01.163721 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:01.163721 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:01.163721 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:01.163721 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:01.163721 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:41:01.163721 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:41:01.163721 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:41:01.163721 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:41:01.163721 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:01.163721 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:01.163721 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:01.163721 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:01.163721 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:01.164552 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:01.164552 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:01.164552 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:01.164552 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:01.164552 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:01.164552 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:01.164552 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:01.164552 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:01.164552 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:01.164552 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:01.164552 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:01.164552 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:41:01.164552 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:41:01.164552 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 10:41:01.164552 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:01.169182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 419/847] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jun 24 10:41:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:01.170324 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1e53f-4d57-4f7d-bbdc-b1de649d5cff None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:01.207395 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280fbaf-8b25-4ada-9e46-6258416d8151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:01.208126 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280fbaf-8b25-4ada-9e46-6258416d8151 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:01.208411 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280fbaf-8b25-4ada-9e46-6258416d8151 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:01.208693 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280fbaf-8b25-4ada-9e46-6258416d8151 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:01.209652 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280fbaf-8b25-4ada-9e46-6258416d8151 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:01.209967 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280fbaf-8b25-4ada-9e46-6258416d8151 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:01.211436 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280fbaf-8b25-4ada-9e46-6258416d8151 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:01.233544 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 429/848] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Jun 24 10:41:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:41:01.235507 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280fbaf-8b25-4ada-9e46-6258416d8151 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:01.243273 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:01.305079 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1e53f-4d57-4f7d-bbdc-b1de649d5cff None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:01.345982 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873cb57-8bd2-45d6-a0ea-ef31bd479286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:01.346594 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873cb57-8bd2-45d6-a0ea-ef31bd479286 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:01.347047 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873cb57-8bd2-45d6-a0ea-ef31bd479286 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:01.347397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873cb57-8bd2-45d6-a0ea-ef31bd479286 None admin] PATH_INFO: `/v3/services` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:01.348205 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873cb57-8bd2-45d6-a0ea-ef31bd479286 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:01.348615 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873cb57-8bd2-45d6-a0ea-ef31bd479286 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:01.350386 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873cb57-8bd2-45d6-a0ea-ef31bd479286 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:01.353920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280fbaf-8b25-4ada-9e46-6258416d8151 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:01.360071 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 420/849] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Jun 24 10:41:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:01.361133 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873cb57-8bd2-45d6-a0ea-ef31bd479286 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:01.402370 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce6493-1309-4b3c-b2ee-c65c426b205f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:01.403316 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce6493-1309-4b3c-b2ee-c65c426b205f None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:01.403740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce6493-1309-4b3c-b2ee-c65c426b205f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:01.404192 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce6493-1309-4b3c-b2ee-c65c426b205f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:01.430612 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:01.475901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873cb57-8bd2-45d6-a0ea-ef31bd479286 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:01.493982 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:01.500351 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce6493-1309-4b3c-b2ee-c65c426b205f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:01.502893 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce6493-1309-4b3c-b2ee-c65c426b205f None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:01.519940 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c936e9-716d-47e6-9a93-50e6bd283c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:01.520588 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c936e9-716d-47e6-9a93-50e6bd283c63 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:01.520886 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c936e9-716d-47e6-9a93-50e6bd283c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:01.521174 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c936e9-716d-47e6-9a93-50e6bd283c63 None admin] PATH_INFO: `/v3/services` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:01.522135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c936e9-716d-47e6-9a93-50e6bd283c63 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:01.522439 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c936e9-716d-47e6-9a93-50e6bd283c63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:01.523918 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c936e9-716d-47e6-9a93-50e6bd283c63 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:01.529383 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 421/850] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Jun 24 10:41:01 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:01.633879 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 430/851] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:41:01 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:41:01.635676 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c936e9-716d-47e6-9a93-50e6bd283c63 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:01.749483 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c936e9-716d-47e6-9a93-50e6bd283c63 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:01.785006 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929d73c-8482-427d-92ce-e9548f605fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:01.785822 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929d73c-8482-427d-92ce-e9548f605fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:01.786107 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929d73c-8482-427d-92ce-e9548f605fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:01.786385 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929d73c-8482-427d-92ce-e9548f605fc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:01.798070 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929d73c-8482-427d-92ce-e9548f605fc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:01.799639 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929d73c-8482-427d-92ce-e9548f605fc6 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:01.818028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-b929d73c-8482-427d-92ce-e9548f605fc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:41:01.818028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:01.818028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:01.818028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:01.818028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:01.818028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:01.818028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:01.818028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:01.818028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:01.818028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:01.818028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:01.818028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:01.818028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:41:01.818028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:41:01.818028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:41:01.819135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:41:01.819135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:01.819135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:01.819135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:01.819135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:01.819135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:01.819135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:01.819135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:01.819135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:01.819135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:01.819135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:01.819135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:01.819135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:01.819135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:01.819135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:01.819135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:01.819135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:01.820064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:41:01.820064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:41:01.820064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:41:01.820064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:01.820064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 422/852] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:41:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:01.825325 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce6493-1309-4b3c-b2ee-c65c426b205f None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:01.871893 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34eaa2-871c-4340-8a49-e031b66a1f91 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:01.872239 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34eaa2-871c-4340-8a49-e031b66a1f91 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:01.872546 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34eaa2-871c-4340-8a49-e031b66a1f91 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:01.877511 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 423/853] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:41:01.878875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935190c-9f85-44da-b5ab-7399b3b4218b None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:01.879201 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935190c-9f85-44da-b5ab-7399b3b4218b None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:01.879467 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935190c-9f85-44da-b5ab-7399b3b4218b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:01.884712 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:01.898394 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-2935190c-9f85-44da-b5ab-7399b3b4218b None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:01.899636 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-2935190c-9f85-44da-b5ab-7399b3b4218b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:01.927584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:01.942325 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce6493-1309-4b3c-b2ee-c65c426b205f None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:01.971400 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 424/854] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:41:01.972627 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857f4fc-e0b2-4bb9-b9ea-f9990115a42b None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:01.972920 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857f4fc-e0b2-4bb9-b9ea-f9990115a42b None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:01.973197 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857f4fc-e0b2-4bb9-b9ea-f9990115a42b None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:01.975271 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 425/855] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:41:01.980290 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb605c-11ba-417f-9167-b01f86e48ea0 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:01.980582 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb605c-11ba-417f-9167-b01f86e48ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:01.980860 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb605c-11ba-417f-9167-b01f86e48ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:01.993645 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b15386-c81a-4095-a75f-405da47b036c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:01.994374 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b15386-c81a-4095-a75f-405da47b036c None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:01.994661 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b15386-c81a-4095-a75f-405da47b036c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:01.994939 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b15386-c81a-4095-a75f-405da47b036c None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:01.995705 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b15386-c81a-4095-a75f-405da47b036c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:01.996013 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b15386-c81a-4095-a75f-405da47b036c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:01.997699 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b15386-c81a-4095-a75f-405da47b036c None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:02.001983 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-a3eb605c-11ba-417f-9167-b01f86e48ea0 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:02.003211 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-a3eb605c-11ba-417f-9167-b01f86e48ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:02.010776 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 431/856] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:02.013156 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b15386-c81a-4095-a75f-405da47b036c None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:02.079315 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 426/857] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:41:02.085641 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb605c-11ba-417f-9167-b01f86e48ea0 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:02.116860 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b15386-c81a-4095-a75f-405da47b036c None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:02.126722 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:02.153569 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e1959-dfe6-47cc-aaa7-7e722c6124c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:02.154298 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e1959-dfe6-47cc-aaa7-7e722c6124c6 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:02.154584 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e1959-dfe6-47cc-aaa7-7e722c6124c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:02.154862 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e1959-dfe6-47cc-aaa7-7e722c6124c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:02.165701 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e1959-dfe6-47cc-aaa7-7e722c6124c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:41:02.173340 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-658e1959-dfe6-47cc-aaa7-7e722c6124c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:41:02.173340 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:02.173340 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:02.173340 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:02.173340 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:02.173340 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:02.173340 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:02.173340 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:02.173340 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:02.173340 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:02.173340 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:02.173340 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:02.173340 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:41:02.173340 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:41:02.173340 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:41:02.173340 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:41:02.174422 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:41:02.174422 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:41:02.174422 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:41:02.174422 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:41:02.174422 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:02.174422 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:02.174422 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:02.174422 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:02.174422 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:02.174422 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:02.174422 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:02.174422 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:02.174422 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:02.174422 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:02.174422 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:02.174422 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:02.176068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:02.176068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:02.176068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:02.176068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:02.176068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:41:02.176068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:41:02.176068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:41:02.176068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:41:02.176068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:41:02.176068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:41:02.176068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:41:02.176068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:02.176068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 432/858] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 10:41:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:02.176068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e1959-dfe6-47cc-aaa7-7e722c6124c6 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:02.194528 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:02.204242 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb605c-11ba-417f-9167-b01f86e48ea0 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:02.241208 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed1e9f-b2fe-4f95-b3f7-d056613512dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:02.242073 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed1e9f-b2fe-4f95-b3f7-d056613512dc None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:02.242359 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed1e9f-b2fe-4f95-b3f7-d056613512dc None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:02.242643 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed1e9f-b2fe-4f95-b3f7-d056613512dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:02.249743 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed1e9f-b2fe-4f95-b3f7-d056613512dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:02.251221 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed1e9f-b2fe-4f95-b3f7-d056613512dc None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:02.265013 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-12ed1e9f-b2fe-4f95-b3f7-d056613512dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:41:02.265013 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:02.265013 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:02.265013 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:02.265013 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:02.265013 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:02.265013 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:02.265013 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:02.265013 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:02.265013 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:02.265013 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:02.265013 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:02.265013 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:41:02.265013 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:41:02.265013 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:41:02.266135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:41:02.266135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:02.266135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:02.266135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:02.266135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:02.266135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:02.266135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:02.266135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:02.266135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:02.266135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:02.266135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:02.266135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:02.266135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:02.266135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:02.266135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:02.266135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:02.266135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:02.267067 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:41:02.267067 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:41:02.267067 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:41:02.267067 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:41:02.267067 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:41:02.267067 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:41:02.267067 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:41:02.267067 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:02.267067 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 427/859] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:41:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:02.267604 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed1e9f-b2fe-4f95-b3f7-d056613512dc None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:02.298578 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e1959-dfe6-47cc-aaa7-7e722c6124c6 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:02.333605 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3eb96-b7f6-4427-9ec6-8a130b79aef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:02.334309 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3eb96-b7f6-4427-9ec6-8a130b79aef9 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:02.334590 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3eb96-b7f6-4427-9ec6-8a130b79aef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:02.335027 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3eb96-b7f6-4427-9ec6-8a130b79aef9 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:02.335787 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b3eb96-b7f6-4427-9ec6-8a130b79aef9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:02.337149 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b3eb96-b7f6-4427-9ec6-8a130b79aef9 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:02.350595 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 433/860] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jun 24 10:41:02 2022] POST /identity/v3/services => generated 251 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:41:02.352688 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3eb96-b7f6-4427-9ec6-8a130b79aef9 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:02.382008 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed1e9f-b2fe-4f95-b3f7-d056613512dc None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:02.396618 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:02.431257 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c78757-b49d-4b8a-bd29-52c443052491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:02.431891 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c78757-b49d-4b8a-bd29-52c443052491 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:02.432176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c78757-b49d-4b8a-bd29-52c443052491 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:02.432450 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c78757-b49d-4b8a-bd29-52c443052491 None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:02.433215 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c78757-b49d-4b8a-bd29-52c443052491 None admin] RBAC: Adding query filter params (name=service) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:02.433524 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c78757-b49d-4b8a-bd29-52c443052491 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:02.434925 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c78757-b49d-4b8a-bd29-52c443052491 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:02.449910 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 428/861] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 10:41:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:02.451067 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c78757-b49d-4b8a-bd29-52c443052491 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:02.472719 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:02.508790 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3eb96-b7f6-4427-9ec6-8a130b79aef9 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:02.547410 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44ae2b-cc39-4c32-8eb1-9ddbb0fb1ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:02.548344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44ae2b-cc39-4c32-8eb1-9ddbb0fb1ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:02.548630 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44ae2b-cc39-4c32-8eb1-9ddbb0fb1ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:02.548909 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44ae2b-cc39-4c32-8eb1-9ddbb0fb1ef0 None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:02.549701 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44ae2b-cc39-4c32-8eb1-9ddbb0fb1ef0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:02.550015 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44ae2b-cc39-4c32-8eb1-9ddbb0fb1ef0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:02.551498 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44ae2b-cc39-4c32-8eb1-9ddbb0fb1ef0 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:02.564927 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 434/862] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:41:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:02.570882 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44ae2b-cc39-4c32-8eb1-9ddbb0fb1ef0 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:02.594207 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c78757-b49d-4b8a-bd29-52c443052491 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:02.648358 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ccb70-f9db-4d04-9c66-7c1cf94da161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:02.649444 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ccb70-f9db-4d04-9c66-7c1cf94da161 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:02.650662 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ccb70-f9db-4d04-9c66-7c1cf94da161 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:02.650954 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ccb70-f9db-4d04-9c66-7c1cf94da161 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:02.668951 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:02.674790 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ccb70-f9db-4d04-9c66-7c1cf94da161 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:02.677601 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ccb70-f9db-4d04-9c66-7c1cf94da161 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:02.684375 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44ae2b-cc39-4c32-8eb1-9ddbb0fb1ef0 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:02.701472 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-616ccb70-f9db-4d04-9c66-7c1cf94da161 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:41:02.701472 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:02.701472 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:02.701472 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:02.701472 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:02.701472 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:02.701472 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:02.701472 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:02.701472 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:02.701472 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:02.701472 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:02.701472 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:02.701472 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:41:02.701472 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:41:02.701472 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:41:02.702610 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:41:02.702610 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:02.702610 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:02.702610 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:02.702610 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:02.702610 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:02.702610 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:02.702610 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:02.702610 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:02.702610 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:02.702610 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:02.702610 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:02.702610 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:02.702610 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:02.702610 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:02.702610 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:02.702610 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:02.703862 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:41:02.703862 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:41:02.703862 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:41:02.703862 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:02.703862 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 429/863] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:41:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:02.708470 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ccb70-f9db-4d04-9c66-7c1cf94da161 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:02.727205 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da9004-e981-4926-974d-cdcf6f949858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:02.728090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da9004-e981-4926-974d-cdcf6f949858 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:02.728477 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da9004-e981-4926-974d-cdcf6f949858 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:02.728843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da9004-e981-4926-974d-cdcf6f949858 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:02.729808 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da9004-e981-4926-974d-cdcf6f949858 None admin] RBAC: Adding query filter params (role.id=4867b69c45554ce18e23167c05a02175, scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user.id=ff592d9ebd4241019625828ddd41aee8) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:02.730220 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da9004-e981-4926-974d-cdcf6f949858 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:02.731877 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da9004-e981-4926-974d-cdcf6f949858 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:02.738964 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 435/864] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:41:02 2022] GET /identity/v3/role_assignments?user.id=ff592d9ebd4241019625828ddd41aee8&scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e&role.id=4867b69c45554ce18e23167c05a02175 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:41:02.788983 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:02.832820 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ccb70-f9db-4d04-9c66-7c1cf94da161 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:02.870601 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e598ed3-890a-4159-bd83-f8fe6a029fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:02.871475 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e598ed3-890a-4159-bd83-f8fe6a029fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:02.871855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e598ed3-890a-4159-bd83-f8fe6a029fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:02.872230 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e598ed3-890a-4159-bd83-f8fe6a029fd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:02.873065 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e598ed3-890a-4159-bd83-f8fe6a029fd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:02.873486 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e598ed3-890a-4159-bd83-f8fe6a029fd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:02.874988 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e598ed3-890a-4159-bd83-f8fe6a029fd4 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:02.892267 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 430/865] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:41:02.897944 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da9004-e981-4926-974d-cdcf6f949858 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:03.008072 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da9004-e981-4926-974d-cdcf6f949858 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:03.042828 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc7e71-9dd4-4f7b-9f88-810d165ad309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:03.043689 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc7e71-9dd4-4f7b-9f88-810d165ad309 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:03.043976 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc7e71-9dd4-4f7b-9f88-810d165ad309 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:03.044257 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc7e71-9dd4-4f7b-9f88-810d165ad309 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:03.051695 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc7e71-9dd4-4f7b-9f88-810d165ad309 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:03.053230 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc7e71-9dd4-4f7b-9f88-810d165ad309 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:03.068894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-7dcc7e71-9dd4-4f7b-9f88-810d165ad309 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 10:41:03.068894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:03.068894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:03.068894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:03.068894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:03.068894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:03.068894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:03.068894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:03.068894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:03.068894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:03.068894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:03.068894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:03.068894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:41:03.068894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:41:03.068894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:41:03.068894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:41:03.070775 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:03.070775 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:03.070775 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:41:03.070775 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:41:03.070775 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:41:03.070775 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:41:03.070775 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:03.070775 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:03.070775 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:03.070775 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:03.070775 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:03.070775 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:03.070775 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:03.070775 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:03.070775 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:03.070775 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:03.070775 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:03.070775 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:03.072764 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:03.072764 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:03.072764 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:41:03.072764 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:41:03.072764 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:41:03.072764 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:41:03.072764 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:41:03.072764 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:41:03.072764 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 10:41:03.072764 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:03.072764 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 436/866] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jun 24 10:41:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:03.076247 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e598ed3-890a-4159-bd83-f8fe6a029fd4 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:03.181962 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e598ed3-890a-4159-bd83-f8fe6a029fd4 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:03.328644 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:03.341440 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559fb36-efda-43f4-ac01-c98b7073fd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:03.342141 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559fb36-efda-43f4-ac01-c98b7073fd2a None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:03.342428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559fb36-efda-43f4-ac01-c98b7073fd2a None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:03.342717 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559fb36-efda-43f4-ac01-c98b7073fd2a None admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:03.343819 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559fb36-efda-43f4-ac01-c98b7073fd2a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:03.344134 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559fb36-efda-43f4-ac01-c98b7073fd2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:03.345573 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559fb36-efda-43f4-ac01-c98b7073fd2a None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:03.364670 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 431/867] 10.222.0.16 () {56 vars in 1149 bytes} [Fri Jun 24 10:41:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:03.370316 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc7e71-9dd4-4f7b-9f88-810d165ad309 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:03.385522 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:03.478875 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc7e71-9dd4-4f7b-9f88-810d165ad309 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:03.513601 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888668e6-22e5-47ef-8c72-ced17fb6ff16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:03.514259 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888668e6-22e5-47ef-8c72-ced17fb6ff16 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:03.514540 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888668e6-22e5-47ef-8c72-ced17fb6ff16 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:03.514816 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888668e6-22e5-47ef-8c72-ced17fb6ff16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:03.588319 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888668e6-22e5-47ef-8c72-ced17fb6ff16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:03.589701 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888668e6-22e5-47ef-8c72-ced17fb6ff16 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:03.604414 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:03.688208 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01e217-160e-4403-b058-9b268c06edbf None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:03.688830 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01e217-160e-4403-b058-9b268c06edbf None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:03.688830 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01e217-160e-4403-b058-9b268c06edbf None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:03.690390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 432/868] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:41:03.691742 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 437/869] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:41:03 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:41:03.696675 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436e76a-5d86-434f-bea4-5ac593cd2dc7 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:03.696964 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436e76a-5d86-434f-bea4-5ac593cd2dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:03.697246 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436e76a-5d86-434f-bea4-5ac593cd2dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:03.700249 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888668e6-22e5-47ef-8c72-ced17fb6ff16 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:03.714701 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-9436e76a-5d86-434f-bea4-5ac593cd2dc7 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:03.715911 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-9436e76a-5d86-434f-bea4-5ac593cd2dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:03.806303 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 433/870] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:03 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:41:03.821246 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888668e6-22e5-47ef-8c72-ced17fb6ff16 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:03.829652 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436e76a-5d86-434f-bea4-5ac593cd2dc7 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:03.838685 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:03.862219 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9b9e6-cd1a-4ff8-91e3-35fed86d17dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:03.863358 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9b9e6-cd1a-4ff8-91e3-35fed86d17dd None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:03.863836 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9b9e6-cd1a-4ff8-91e3-35fed86d17dd None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:03.864328 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9b9e6-cd1a-4ff8-91e3-35fed86d17dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:03.876845 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9b9e6-cd1a-4ff8-91e3-35fed86d17dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:03.878596 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9b9e6-cd1a-4ff8-91e3-35fed86d17dd None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:03.897832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-78b9b9e6-cd1a-4ff8-91e3-35fed86d17dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:41:03.897832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:03.897832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:03.897832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:03.897832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:03.897832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:03.897832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:03.897832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:03.897832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:03.897832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:03.897832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:03.897832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:03.897832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:41:03.897832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:41:03.897832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:41:03.899515 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:41:03.899515 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:03.899515 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:03.899515 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:03.899515 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:03.899515 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:03.899515 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:03.899515 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:03.899515 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:03.899515 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:03.899515 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:03.899515 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:03.899515 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:03.899515 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:03.899515 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:03.899515 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:03.899515 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:03.900420 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:41:03.900420 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:41:03.900420 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:41:03.900420 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:03.902525 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 438/871] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:41:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:03.907897 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9b9e6-cd1a-4ff8-91e3-35fed86d17dd None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:03.952163 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436e76a-5d86-434f-bea4-5ac593cd2dc7 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:03.966942 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:04.000430 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bd4d3-01c9-453b-8082-40e3e07aee1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:04.001128 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bd4d3-01c9-453b-8082-40e3e07aee1d None admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:04.001861 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bd4d3-01c9-453b-8082-40e3e07aee1d None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:04.002155 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bd4d3-01c9-453b-8082-40e3e07aee1d None admin] PATH_INFO: `/v3/services` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:04.003317 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bd4d3-01c9-453b-8082-40e3e07aee1d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:04.004730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bd4d3-01c9-453b-8082-40e3e07aee1d None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:04.024967 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 434/872] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jun 24 10:41:03 2022] POST /identity/v3/services => generated 269 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:41:04.033499 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9b9e6-cd1a-4ff8-91e3-35fed86d17dd None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:04.082994 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e1931-0017-4c16-b1c8-f73515aef9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:04.084123 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e1931-0017-4c16-b1c8-f73515aef9ca None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:04.084736 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e1931-0017-4c16-b1c8-f73515aef9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:04.084736 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e1931-0017-4c16-b1c8-f73515aef9ca None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:04.085325 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e1931-0017-4c16-b1c8-f73515aef9ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:04.085632 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e1931-0017-4c16-b1c8-f73515aef9ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:04.087119 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e1931-0017-4c16-b1c8-f73515aef9ca None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:04.101026 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 439/873] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:04.106676 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bd4d3-01c9-453b-8082-40e3e07aee1d None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:04.224582 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bd4d3-01c9-453b-8082-40e3e07aee1d None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:04.261033 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58636c0-d07c-4321-bd9d-c9aac8a548de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:04.261851 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58636c0-d07c-4321-bd9d-c9aac8a548de None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:04.262133 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58636c0-d07c-4321-bd9d-c9aac8a548de None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:04.262401 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58636c0-d07c-4321-bd9d-c9aac8a548de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:04.270864 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58636c0-d07c-4321-bd9d-c9aac8a548de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:04.271064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58636c0-d07c-4321-bd9d-c9aac8a548de None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:04.290088 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-f58636c0-d07c-4321-bd9d-c9aac8a548de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:41:04.290088 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:04.290088 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:04.290088 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:04.290088 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:04.290088 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:04.290088 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:04.290088 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:04.290088 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:04.290088 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:04.290088 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:04.290088 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:04.290088 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:41:04.290088 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:41:04.290088 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:41:04.291010 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:41:04.291010 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:04.291010 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:04.291010 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:04.291010 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:04.291010 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:04.291010 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:04.291010 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:04.291010 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:04.291010 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:04.291010 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:04.291010 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:04.291010 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:04.291010 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:04.291010 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:04.291010 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:04.291010 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:04.292198 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:41:04.292198 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:41:04.292198 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:41:04.292198 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:41:04.292198 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:41:04.292198 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:41:04.292198 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:41:04.292198 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:04.295428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 435/874] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:41:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:04.301299 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e1931-0017-4c16-b1c8-f73515aef9ca None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:04.324947 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:04.412162 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e1931-0017-4c16-b1c8-f73515aef9ca None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:04.447296 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bac3a-0e64-4e5b-819c-f00e834528b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:04.447969 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bac3a-0e64-4e5b-819c-f00e834528b8 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:04.448249 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bac3a-0e64-4e5b-819c-f00e834528b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:04.448524 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bac3a-0e64-4e5b-819c-f00e834528b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:04.449311 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945bac3a-0e64-4e5b-819c-f00e834528b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:04.449618 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945bac3a-0e64-4e5b-819c-f00e834528b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:04.451050 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945bac3a-0e64-4e5b-819c-f00e834528b8 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:04.464239 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 440/875] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:41:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:04.472237 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58636c0-d07c-4321-bd9d-c9aac8a548de None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:04.483418 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc4a0f-0dc7-4b48-9169-55acbc1a1e4f None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:04.483713 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc4a0f-0dc7-4b48-9169-55acbc1a1e4f None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:04.483989 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc4a0f-0dc7-4b48-9169-55acbc1a1e4f None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:04.485584 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 441/876] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:41:04.490380 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612b95a-0a5d-408f-acfa-15c0bb13f0b5 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:04.490721 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612b95a-0a5d-408f-acfa-15c0bb13f0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:04.491032 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612b95a-0a5d-408f-acfa-15c0bb13f0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:04.507610 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:04.507916 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-7612b95a-0a5d-408f-acfa-15c0bb13f0b5 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:04.509034 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-7612b95a-0a5d-408f-acfa-15c0bb13f0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:04.586219 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58636c0-d07c-4321-bd9d-c9aac8a548de None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:04.591390 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 442/877] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:41:04.609721 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612b95a-0a5d-408f-acfa-15c0bb13f0b5 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:04.621955 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:04.633686 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaec2de-c35d-4469-bad7-2c8617a18ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:04.634775 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaec2de-c35d-4469-bad7-2c8617a18ebb None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:04.635562 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaec2de-c35d-4469-bad7-2c8617a18ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:04.635948 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaec2de-c35d-4469-bad7-2c8617a18ebb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:04.636907 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaec2de-c35d-4469-bad7-2c8617a18ebb None admin] RBAC: Adding query filter params (role.id=7bab53c1ac3d4e04b18c87286e2ab0aa, scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user.id=4dfddd72dfa84ce39fe62112224b425d) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:04.637338 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaec2de-c35d-4469-bad7-2c8617a18ebb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:04.639469 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaec2de-c35d-4469-bad7-2c8617a18ebb None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:04.648271 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 436/878] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:41:04 2022] GET /identity/v3/role_assignments?user.id=4dfddd72dfa84ce39fe62112224b425d&scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e&role.id=7bab53c1ac3d4e04b18c87286e2ab0aa => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:04.745780 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612b95a-0a5d-408f-acfa-15c0bb13f0b5 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:04.784490 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef99a72-af60-42de-918e-400850b15336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:04.785334 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef99a72-af60-42de-918e-400850b15336 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:04.785614 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef99a72-af60-42de-918e-400850b15336 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:04.785896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef99a72-af60-42de-918e-400850b15336 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:04.786577 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef99a72-af60-42de-918e-400850b15336 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:04.788539 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef99a72-af60-42de-918e-400850b15336 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:04.802092 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-2ef99a72-af60-42de-918e-400850b15336 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 10:41:04.802092 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:04.802092 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:41:04.802092 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:41:04.802092 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:41:04.802092 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:41:04.802092 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:41:04.802092 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:41:04.802092 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 10:41:04.802092 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:04.802092 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:41:04.802092 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:04.802092 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:04.802092 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:04.802092 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:04.802092 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:04.802092 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:04.803213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:04.803213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:04.803213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:04.803213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:04.803213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:04.803213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:04.803213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:41:04.803213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:41:04.803213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:41:04.803213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:41:04.803213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:04.803213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:04.803213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:04.803213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:04.803213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:04.803213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:04.804060 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:04.804060 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:04.804060 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:04.804060 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:04.804060 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:04.804060 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:04.804060 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:04.804060 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:04.804060 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:04.804060 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:04.804060 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:41:04.804060 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:41:04.804060 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 10:41:04.804060 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:04.804060 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 443/879] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 10:41:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:41:04.809749 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaec2de-c35d-4469-bad7-2c8617a18ebb None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:04.917090 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:04.925710 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaec2de-c35d-4469-bad7-2c8617a18ebb None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:04.964485 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7ebef-b357-40be-9e6a-8777c0388960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:04.965171 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7ebef-b357-40be-9e6a-8777c0388960 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:04.965453 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7ebef-b357-40be-9e6a-8777c0388960 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:04.965732 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7ebef-b357-40be-9e6a-8777c0388960 None admin] PATH_INFO: `/v3/services` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:04.966448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7ebef-b357-40be-9e6a-8777c0388960 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:04.966801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7ebef-b357-40be-9e6a-8777c0388960 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:04.968218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7ebef-b357-40be-9e6a-8777c0388960 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:04.973527 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 437/880] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 10:41:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:04.979282 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef99a72-af60-42de-918e-400850b15336 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:05.055830 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2a877-9490-4a7f-b9f2-0f1712264232 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:05.056471 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2a877-9490-4a7f-b9f2-0f1712264232 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:05.056950 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2a877-9490-4a7f-b9f2-0f1712264232 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:05.057409 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:05.059017 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 438/881] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:41:05.065031 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b060367-50eb-49b7-a096-e5250bc7adcd None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:05.065563 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b060367-50eb-49b7-a096-e5250bc7adcd None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:05.066034 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b060367-50eb-49b7-a096-e5250bc7adcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:05.084218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-3b060367-50eb-49b7-a096-e5250bc7adcd None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:05.085457 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-3b060367-50eb-49b7-a096-e5250bc7adcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:05.089137 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef99a72-af60-42de-918e-400850b15336 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:05.125634 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374d9ba-b340-47a8-98b9-a602a4f5a373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:05.126686 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374d9ba-b340-47a8-98b9-a602a4f5a373 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:05.127184 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374d9ba-b340-47a8-98b9-a602a4f5a373 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:05.128187 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374d9ba-b340-47a8-98b9-a602a4f5a373 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:05.129096 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d374d9ba-b340-47a8-98b9-a602a4f5a373 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:05.129594 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d374d9ba-b340-47a8-98b9-a602a4f5a373 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:05.132269 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d374d9ba-b340-47a8-98b9-a602a4f5a373 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:05.140143 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 444/882] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 10:41:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:05.147602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374d9ba-b340-47a8-98b9-a602a4f5a373 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:05.167183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 439/883] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:41:05.193104 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b060367-50eb-49b7-a096-e5250bc7adcd None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:05.264838 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374d9ba-b340-47a8-98b9-a602a4f5a373 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:05.288896 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:05.302368 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b060367-50eb-49b7-a096-e5250bc7adcd None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:05.303833 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254bd86e-3f14-4356-b5c6-4065a821f97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:05.304668 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bd86e-3f14-4356-b5c6-4065a821f97e None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:05.305094 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bd86e-3f14-4356-b5c6-4065a821f97e None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:05.305526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bd86e-3f14-4356-b5c6-4065a821f97e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:05.306519 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254bd86e-3f14-4356-b5c6-4065a821f97e None admin] RBAC: Adding query filter params (interface=public, service_id=d3c134019f494622840d60c38a6cfa00, region_id=RegionOne) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:05.306986 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254bd86e-3f14-4356-b5c6-4065a821f97e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:05.308514 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254bd86e-3f14-4356-b5c6-4065a821f97e None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:05.314776 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 445/884] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Jun 24 10:41:05 2022] GET /identity/v3/endpoints?service_id=d3c134019f494622840d60c38a6cfa00&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:05.320155 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254bd86e-3f14-4356-b5c6-4065a821f97e None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:05.342149 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b7444-6bc2-4726-90e0-c5b1a76f499f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:05.343006 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b7444-6bc2-4726-90e0-c5b1a76f499f None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:05.343373 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b7444-6bc2-4726-90e0-c5b1a76f499f None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:05.343656 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b7444-6bc2-4726-90e0-c5b1a76f499f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:05.344507 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b7444-6bc2-4726-90e0-c5b1a76f499f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:05.345911 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b7444-6bc2-4726-90e0-c5b1a76f499f None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:05.355501 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:05.359211 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-7c0b7444-6bc2-4726-90e0-c5b1a76f499f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 10:41:05.359211 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:05.359211 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:41:05.359211 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:41:05.359211 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:41:05.359211 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:41:05.359211 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:41:05.359211 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:41:05.359211 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 10:41:05.359211 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:05.359211 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:41:05.359211 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:05.359211 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:05.359211 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:05.359211 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:05.359211 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:05.359211 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:05.360190 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:05.360190 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:05.360190 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:05.360190 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:05.360190 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:05.360190 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:05.360190 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:41:05.360190 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:41:05.360190 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:41:05.360190 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:41:05.360190 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:05.360190 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:05.360190 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:05.360190 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:05.360190 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:05.360190 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:05.361027 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:05.361027 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:05.361027 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:05.361027 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:05.361027 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:05.361027 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:05.361027 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:05.361027 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:05.361027 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:05.361027 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:05.361027 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:41:05.361027 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:41:05.361027 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 10:41:05.361027 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:05.365781 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 440/885] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Jun 24 10:41:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:05.367738 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b7444-6bc2-4726-90e0-c5b1a76f499f None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:05.448038 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254bd86e-3f14-4356-b5c6-4065a821f97e None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:05.473668 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b7444-6bc2-4726-90e0-c5b1a76f499f None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:05.494264 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bff809-dba6-4dec-8b1c-d43c0f3eac68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:05.495830 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bff809-dba6-4dec-8b1c-d43c0f3eac68 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:05.496467 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bff809-dba6-4dec-8b1c-d43c0f3eac68 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:05.497021 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bff809-dba6-4dec-8b1c-d43c0f3eac68 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:05.498123 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bff809-dba6-4dec-8b1c-d43c0f3eac68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:05.500355 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bff809-dba6-4dec-8b1c-d43c0f3eac68 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:05.509039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 446/886] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Jun 24 10:41:05 2022] GET /identity/v3/services => generated 1268 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:41:05.510784 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbbb53e-6e58-4f57-a85e-3846edb17991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:05.519429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbb53e-6e58-4f57-a85e-3846edb17991 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:05.519429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbb53e-6e58-4f57-a85e-3846edb17991 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:05.519429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbb53e-6e58-4f57-a85e-3846edb17991 None admin] PATH_INFO: `/v3/services` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:05.519429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbbb53e-6e58-4f57-a85e-3846edb17991 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:05.519429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbbb53e-6e58-4f57-a85e-3846edb17991 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:05.519429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbbb53e-6e58-4f57-a85e-3846edb17991 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:05.528613 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 441/887] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jun 24 10:41:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:41:05.534592 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bff809-dba6-4dec-8b1c-d43c0f3eac68 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:05.613624 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:05.655321 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bff809-dba6-4dec-8b1c-d43c0f3eac68 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:05.691721 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34264521-28d5-4b8e-ab15-bcc3e546f6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:05.692582 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34264521-28d5-4b8e-ab15-bcc3e546f6ce None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:05.692869 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34264521-28d5-4b8e-ab15-bcc3e546f6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:05.693172 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34264521-28d5-4b8e-ab15-bcc3e546f6ce None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:05.694421 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34264521-28d5-4b8e-ab15-bcc3e546f6ce None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:05.694730 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34264521-28d5-4b8e-ab15-bcc3e546f6ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:05.696132 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34264521-28d5-4b8e-ab15-bcc3e546f6ce None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:05.700825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 447/888] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jun 24 10:41:05 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:06.237770 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af655c-0fa6-4be1-af4d-2cd355cc8b30 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:06.238303 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af655c-0fa6-4be1-af4d-2cd355cc8b30 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:06.238381 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af655c-0fa6-4be1-af4d-2cd355cc8b30 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:06.240004 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 442/889] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:41:06.245593 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1189c28-e8d7-4426-a84d-5a28a8aa9e25 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:06.246050 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1189c28-e8d7-4426-a84d-5a28a8aa9e25 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:06.246227 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1189c28-e8d7-4426-a84d-5a28a8aa9e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:06.264192 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-d1189c28-e8d7-4426-a84d-5a28a8aa9e25 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:06.265750 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-d1189c28-e8d7-4426-a84d-5a28a8aa9e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:06.337943 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 448/890] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:06 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:41:06.361703 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af655c-0fa6-4be1-af4d-2cd355cc8b30 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:06.381820 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:06.474084 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af655c-0fa6-4be1-af4d-2cd355cc8b30 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:06.509824 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8d8d6-34e3-40bc-8d8c-a1c0de697719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:06.510571 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8d8d6-34e3-40bc-8d8c-a1c0de697719 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:06.510854 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8d8d6-34e3-40bc-8d8c-a1c0de697719 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:06.511125 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8d8d6-34e3-40bc-8d8c-a1c0de697719 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:06.511802 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8d8d6-34e3-40bc-8d8c-a1c0de697719 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:06.513166 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8d8d6-34e3-40bc-8d8c-a1c0de697719 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:06.526200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-72c8d8d6-34e3-40bc-8d8c-a1c0de697719 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 10:41:06.526200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:06.526200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:41:06.526200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:41:06.526200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:41:06.526200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:41:06.526200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:41:06.526200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:41:06.526200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 10:41:06.526200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:06.526200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:41:06.526200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:06.526200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:06.526200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:06.526200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:06.526200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:06.527171 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:06.527171 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:06.527171 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:06.527171 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:06.527171 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:06.527171 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:06.527171 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:06.527171 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:41:06.527171 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:41:06.527171 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:41:06.527171 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:41:06.527171 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:06.527171 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:06.527171 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:06.527171 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:06.527171 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:06.528035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:06.528035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:06.528035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:06.528035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:06.528035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:06.528035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:06.528035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:06.528035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:06.528035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:06.528035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:06.528035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:06.528035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:41:06.528035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:41:06.528035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 10:41:06.528035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:06.528035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 443/891] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jun 24 10:41:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:06.534120 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1189c28-e8d7-4426-a84d-5a28a8aa9e25 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:06.594690 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:06.641809 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1189c28-e8d7-4426-a84d-5a28a8aa9e25 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:06.683943 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674c6e9-2285-4093-aeb0-64686c5a05e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:06.684642 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674c6e9-2285-4093-aeb0-64686c5a05e9 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:06.684977 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674c6e9-2285-4093-aeb0-64686c5a05e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:06.685259 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674c6e9-2285-4093-aeb0-64686c5a05e9 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:06.686010 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674c6e9-2285-4093-aeb0-64686c5a05e9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:06.686359 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674c6e9-2285-4093-aeb0-64686c5a05e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:06.688204 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674c6e9-2285-4093-aeb0-64686c5a05e9 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:06.694698 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 449/892] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Jun 24 10:41:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:06.700460 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8d8d6-34e3-40bc-8d8c-a1c0de697719 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:06.790423 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:06.810761 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8d8d6-34e3-40bc-8d8c-a1c0de697719 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:06.846090 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9a41e-c992-469a-b52f-6d939d3810ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:06.846765 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9a41e-c992-469a-b52f-6d939d3810ae None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:06.847049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9a41e-c992-469a-b52f-6d939d3810ae None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:06.847354 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9a41e-c992-469a-b52f-6d939d3810ae None admin] PATH_INFO: `/v3/services` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:06.848066 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9a41e-c992-469a-b52f-6d939d3810ae None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:06.848373 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9a41e-c992-469a-b52f-6d939d3810ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:06.850481 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9a41e-c992-469a-b52f-6d939d3810ae None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:06.856053 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 444/893] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Jun 24 10:41:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:06.862436 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674c6e9-2285-4093-aeb0-64686c5a05e9 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:06.869145 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787ae0f-5415-4dea-9dfd-157061f8a6cc None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:06.869473 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787ae0f-5415-4dea-9dfd-157061f8a6cc None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:06.869713 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787ae0f-5415-4dea-9dfd-157061f8a6cc None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:06.871465 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 445/894] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:41:06.877190 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c10cfc-6f19-4e6f-b053-078eba155663 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:06.877672 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c10cfc-6f19-4e6f-b053-078eba155663 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:06.877980 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c10cfc-6f19-4e6f-b053-078eba155663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:06.897480 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-02c10cfc-6f19-4e6f-b053-078eba155663 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:06.898763 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-02c10cfc-6f19-4e6f-b053-078eba155663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:06.976166 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 446/895] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:06 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:41:06.979460 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674c6e9-2285-4093-aeb0-64686c5a05e9 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:07.004387 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c10cfc-6f19-4e6f-b053-078eba155663 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:07.007235 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:07.018813 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a40bc-ff68-4b4c-989c-05a49fd1e0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:07.019889 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a40bc-ff68-4b4c-989c-05a49fd1e0be None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:07.020400 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a40bc-ff68-4b4c-989c-05a49fd1e0be None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:07.020908 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a40bc-ff68-4b4c-989c-05a49fd1e0be None admin] PATH_INFO: `/v3/endpoints` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:07.021981 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a40bc-ff68-4b4c-989c-05a49fd1e0be None admin] RBAC: Adding query filter params (interface=public, service_id=34aa0e0c5bd746adbe04f45d5100c91a, region_id=RegionOne) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:07.022499 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a40bc-ff68-4b4c-989c-05a49fd1e0be None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:07.024144 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a40bc-ff68-4b4c-989c-05a49fd1e0be None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:07.030122 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 450/896] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Jun 24 10:41:06 2022] GET /identity/v3/endpoints?service_id=34aa0e0c5bd746adbe04f45d5100c91a&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:07.036009 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a40bc-ff68-4b4c-989c-05a49fd1e0be None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:07.094298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:07.123437 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c10cfc-6f19-4e6f-b053-078eba155663 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:07.160363 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef681a71-1100-4774-a447-957301ae83a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:07.161394 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef681a71-1100-4774-a447-957301ae83a5 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:07.161728 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef681a71-1100-4774-a447-957301ae83a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:07.162140 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef681a71-1100-4774-a447-957301ae83a5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:07.164194 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a40bc-ff68-4b4c-989c-05a49fd1e0be None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:07.173819 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef681a71-1100-4774-a447-957301ae83a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:41:07.182583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-ef681a71-1100-4774-a447-957301ae83a5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 10:41:07.182583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:07.182583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:07.182583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:07.182583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:07.182583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:07.182583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:07.182583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:07.182583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:07.182583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:07.182583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:07.182583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:07.182583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:41:07.182583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:41:07.182583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:41:07.182583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:41:07.183572 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:41:07.183572 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:41:07.183572 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:41:07.183572 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:41:07.183572 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:07.183572 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:07.183572 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:07.183572 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:07.183572 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:07.183572 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:07.183572 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:07.183572 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:07.183572 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:07.183572 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:07.183572 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:07.183572 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:07.184429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:07.184429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:07.184429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:07.184429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:07.184429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:41:07.184429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:41:07.184429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:41:07.184429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:41:07.184429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:41:07.184429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:41:07.184429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 10:41:07.184429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:07.184429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 447/897] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jun 24 10:41:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:41:07.191175 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef681a71-1100-4774-a447-957301ae83a5 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:07.212388 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a661fed-9bd5-41bc-a2ab-8a89cbf6209c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:07.213061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a661fed-9bd5-41bc-a2ab-8a89cbf6209c None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:07.213347 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a661fed-9bd5-41bc-a2ab-8a89cbf6209c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:07.213622 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a661fed-9bd5-41bc-a2ab-8a89cbf6209c None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:07.214396 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a661fed-9bd5-41bc-a2ab-8a89cbf6209c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:07.215733 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a661fed-9bd5-41bc-a2ab-8a89cbf6209c None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:07.222186 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 451/898] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Jun 24 10:41:07 2022] GET /identity/v3/services => generated 1268 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:41:07.316923 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef681a71-1100-4774-a447-957301ae83a5 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:07.355828 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd6679-2322-4967-bd6c-9b9908fe5a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:07.356839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd6679-2322-4967-bd6c-9b9908fe5a27 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:07.357324 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd6679-2322-4967-bd6c-9b9908fe5a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:07.357765 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd6679-2322-4967-bd6c-9b9908fe5a27 None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:07.358682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd6679-2322-4967-bd6c-9b9908fe5a27 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:07.359163 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd6679-2322-4967-bd6c-9b9908fe5a27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:07.360735 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd6679-2322-4967-bd6c-9b9908fe5a27 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:07.362675 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:07.372991 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 448/899] 10.222.0.16 () {56 vars in 1115 bytes} [Fri Jun 24 10:41:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:07.380355 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a661fed-9bd5-41bc-a2ab-8a89cbf6209c None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:07.439571 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:07.487191 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a661fed-9bd5-41bc-a2ab-8a89cbf6209c None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:07.522615 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63299c06-7d5d-4ff7-bec4-13081e00d046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:07.523496 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63299c06-7d5d-4ff7-bec4-13081e00d046 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:07.524087 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63299c06-7d5d-4ff7-bec4-13081e00d046 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:07.524367 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63299c06-7d5d-4ff7-bec4-13081e00d046 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:07.534891 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63299c06-7d5d-4ff7-bec4-13081e00d046 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:07.536383 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63299c06-7d5d-4ff7-bec4-13081e00d046 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:07.555168 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-63299c06-7d5d-4ff7-bec4-13081e00d046 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:41:07.555168 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:07.555168 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:07.555168 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:07.555168 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:07.555168 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:07.555168 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:07.555168 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:07.555168 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:07.555168 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:07.555168 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:07.555168 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:07.555168 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:41:07.555168 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:41:07.555168 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:41:07.556229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:41:07.556229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:07.556229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:07.556229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:07.556229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:07.556229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:07.556229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:07.556229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:07.556229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:07.556229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:07.556229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:07.556229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:07.556229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:07.556229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:07.556229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:07.556229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:07.556229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:07.557120 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:41:07.557120 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:41:07.557120 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:41:07.557120 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:07.557120 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 452/900] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:41:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:07.562927 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd6679-2322-4967-bd6c-9b9908fe5a27 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:07.671266 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd6679-2322-4967-bd6c-9b9908fe5a27 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:07.700444 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b952b-ade7-4327-abaa-d3867a92aec5 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:07.700793 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b952b-ade7-4327-abaa-d3867a92aec5 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:07.701013 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b952b-ade7-4327-abaa-d3867a92aec5 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:07.702533 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 453/901] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:41:07.710025 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98efb02-9c71-46a3-be4e-b4e4f9d1bb6f None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:07.710703 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98efb02-9c71-46a3-be4e-b4e4f9d1bb6f None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:07.711227 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98efb02-9c71-46a3-be4e-b4e4f9d1bb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:07.711533 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd10d99-f3b1-4cbc-a4a8-fe426fa9b08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:07.712220 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd10d99-f3b1-4cbc-a4a8-fe426fa9b08e None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:07.712509 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd10d99-f3b1-4cbc-a4a8-fe426fa9b08e None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:07.712791 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd10d99-f3b1-4cbc-a4a8-fe426fa9b08e None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:07.713529 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd10d99-f3b1-4cbc-a4a8-fe426fa9b08e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:07.713839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd10d99-f3b1-4cbc-a4a8-fe426fa9b08e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:07.715444 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd10d99-f3b1-4cbc-a4a8-fe426fa9b08e None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:07.729842 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 449/902] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:07.734276 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-e98efb02-9c71-46a3-be4e-b4e4f9d1bb6f None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:07.734913 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd10d99-f3b1-4cbc-a4a8-fe426fa9b08e None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:07.736029 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e98efb02-9c71-46a3-be4e-b4e4f9d1bb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:07.804089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:07.831094 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 454/903] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:41:07.841173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f23aac-fa43-467d-a9ba-e16addc06905 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:07.841805 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f23aac-fa43-467d-a9ba-e16addc06905 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:07.842097 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f23aac-fa43-467d-a9ba-e16addc06905 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:07.847275 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 455/904] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:41:07.849737 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb5f65-a062-46d0-9a24-2a713ee165f6 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:07.850120 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb5f65-a062-46d0-9a24-2a713ee165f6 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:07.850412 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb5f65-a062-46d0-9a24-2a713ee165f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:07.859773 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd10d99-f3b1-4cbc-a4a8-fe426fa9b08e None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:07.868109 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-58eb5f65-a062-46d0-9a24-2a713ee165f6 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:07.869344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-58eb5f65-a062-46d0-9a24-2a713ee165f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:07.897909 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:07.901730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50054093-9318-47de-aba0-6b56b8e7a425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:07.902473 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50054093-9318-47de-aba0-6b56b8e7a425 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:07.902820 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50054093-9318-47de-aba0-6b56b8e7a425 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:07.903025 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50054093-9318-47de-aba0-6b56b8e7a425 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:07.912119 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50054093-9318-47de-aba0-6b56b8e7a425 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:07.913519 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50054093-9318-47de-aba0-6b56b8e7a425 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:07.932064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-50054093-9318-47de-aba0-6b56b8e7a425 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 10:41:07.932064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:07.932064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:07.932064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:07.932064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:07.932064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:07.932064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:07.932064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:07.932064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:07.932064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:07.932064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:07.932064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:07.932064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:41:07.932064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:41:07.932064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:41:07.932064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:41:07.933072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:07.933072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:07.933072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:41:07.933072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:41:07.933072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:41:07.933072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:41:07.933072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:07.933072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:07.933072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:07.933072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:07.933072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:07.933072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:07.933072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:07.933072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:07.933072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:07.933072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:07.933072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:07.933072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:07.933995 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:07.933995 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:07.933995 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:41:07.933995 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:41:07.933995 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:41:07.933995 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:41:07.933995 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:41:07.933995 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:41:07.933995 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 10:41:07.933995 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:07.933995 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 450/905] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jun 24 10:41:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:41:07.934583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50054093-9318-47de-aba0-6b56b8e7a425 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:07.955302 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 456/906] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:41:07.955302 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb5f65-a062-46d0-9a24-2a713ee165f6 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:08.051002 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50054093-9318-47de-aba0-6b56b8e7a425 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:08.055349 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb5f65-a062-46d0-9a24-2a713ee165f6 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:08.072258 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:08.091411 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94746b74-0826-4960-94a3-f4b76a812185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:08.092089 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94746b74-0826-4960-94a3-f4b76a812185 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:08.092373 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94746b74-0826-4960-94a3-f4b76a812185 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:08.092651 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94746b74-0826-4960-94a3-f4b76a812185 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:08.093012 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d548187-8636-48c1-bc5b-8cea8a7b186a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:08.093484 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94746b74-0826-4960-94a3-f4b76a812185 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:08.093794 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94746b74-0826-4960-94a3-f4b76a812185 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:08.093887 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d548187-8636-48c1-bc5b-8cea8a7b186a None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:08.094102 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d548187-8636-48c1-bc5b-8cea8a7b186a None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:08.094378 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d548187-8636-48c1-bc5b-8cea8a7b186a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:08.095038 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d548187-8636-48c1-bc5b-8cea8a7b186a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:08.095243 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94746b74-0826-4960-94a3-f4b76a812185 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:08.096459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d548187-8636-48c1-bc5b-8cea8a7b186a None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:08.109427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-7d548187-8636-48c1-bc5b-8cea8a7b186a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 10:41:08.109427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:08.109427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:41:08.109427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:41:08.109427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:41:08.109427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:41:08.109427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:41:08.109427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:41:08.109427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 10:41:08.109427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:08.109427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:41:08.109427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:08.109427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:08.109427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:08.109427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:08.109427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:08.109427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:08.110571 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:08.110571 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:08.110571 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:08.110571 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:08.110571 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:08.110571 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:08.110571 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:41:08.110571 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:41:08.110571 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:41:08.110571 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:41:08.110571 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:08.110571 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:08.110571 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:08.110571 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:08.110571 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:08.110571 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:08.111455 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:08.111455 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:08.111455 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:08.111455 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:08.111455 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:08.111455 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:08.111455 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:08.111455 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:08.111455 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:08.111455 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:08.111455 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:41:08.111455 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:41:08.111455 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 10:41:08.111455 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:08.111455 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 451/907] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 10:41:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:08.112246 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d548187-8636-48c1-bc5b-8cea8a7b186a None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:08.119423 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 457/908] 10.222.0.16 () {56 vars in 1149 bytes} [Fri Jun 24 10:41:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:08.120506 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94746b74-0826-4960-94a3-f4b76a812185 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:08.148553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:08.221974 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d548187-8636-48c1-bc5b-8cea8a7b186a None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:08.232810 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94746b74-0826-4960-94a3-f4b76a812185 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:08.258897 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f031d-4e38-4b93-b76f-bdadde9e5f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:08.259622 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f031d-4e38-4b93-b76f-bdadde9e5f10 None admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:08.259908 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f031d-4e38-4b93-b76f-bdadde9e5f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:08.260186 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f031d-4e38-4b93-b76f-bdadde9e5f10 None admin] PATH_INFO: `/v3/services` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:08.260916 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f031d-4e38-4b93-b76f-bdadde9e5f10 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:08.262300 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f031d-4e38-4b93-b76f-bdadde9e5f10 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:08.269797 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5e7b9-ddf0-4461-b363-7ec1b9cb1083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:08.270471 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5e7b9-ddf0-4461-b363-7ec1b9cb1083 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:08.270755 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5e7b9-ddf0-4461-b363-7ec1b9cb1083 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:08.271463 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5e7b9-ddf0-4461-b363-7ec1b9cb1083 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:08.272182 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a5e7b9-ddf0-4461-b363-7ec1b9cb1083 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:08.272451 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a5e7b9-ddf0-4461-b363-7ec1b9cb1083 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:08.273902 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a5e7b9-ddf0-4461-b363-7ec1b9cb1083 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:08.279219 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 452/909] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jun 24 10:41:08 2022] POST /identity/v3/services => generated 241 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:41:08.279219 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f031d-4e38-4b93-b76f-bdadde9e5f10 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:08.279445 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 458/910] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 10:41:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:08.290031 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5e7b9-ddf0-4461-b363-7ec1b9cb1083 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:08.340762 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:08.416677 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f031d-4e38-4b93-b76f-bdadde9e5f10 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:08.417967 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:08.435480 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5e7b9-ddf0-4461-b363-7ec1b9cb1083 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:08.463226 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2ae7c-3987-42c3-86ff-3803f62e1ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:08.464276 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2ae7c-3987-42c3-86ff-3803f62e1ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:08.464792 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2ae7c-3987-42c3-86ff-3803f62e1ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:08.465068 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2ae7c-3987-42c3-86ff-3803f62e1ff6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:08.487630 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04248bd-dc05-40be-b695-0f34c8e4ee89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:08.488363 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04248bd-dc05-40be-b695-0f34c8e4ee89 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:08.488650 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04248bd-dc05-40be-b695-0f34c8e4ee89 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:08.488931 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04248bd-dc05-40be-b695-0f34c8e4ee89 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:08.489818 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04248bd-dc05-40be-b695-0f34c8e4ee89 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:08.490537 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04248bd-dc05-40be-b695-0f34c8e4ee89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:08.492137 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04248bd-dc05-40be-b695-0f34c8e4ee89 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:08.497792 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 459/911] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 10:41:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:08.503403 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04248bd-dc05-40be-b695-0f34c8e4ee89 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:08.557559 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2ae7c-3987-42c3-86ff-3803f62e1ff6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:08.559051 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2ae7c-3987-42c3-86ff-3803f62e1ff6 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:08.599944 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:08.644690 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04248bd-dc05-40be-b695-0f34c8e4ee89 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:08.680429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 453/912] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:41:08 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:41:08.685736 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2ae7c-3987-42c3-86ff-3803f62e1ff6 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:08.694851 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df131917-fa2e-42ae-8de3-cb018cc9e954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:08.695834 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df131917-fa2e-42ae-8de3-cb018cc9e954 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:08.696336 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df131917-fa2e-42ae-8de3-cb018cc9e954 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:08.697226 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df131917-fa2e-42ae-8de3-cb018cc9e954 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:08.698612 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df131917-fa2e-42ae-8de3-cb018cc9e954 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:08.700488 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df131917-fa2e-42ae-8de3-cb018cc9e954 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:08.726482 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 460/913] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Jun 24 10:41:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:41:08.803062 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2ae7c-3987-42c3-86ff-3803f62e1ff6 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:08.847068 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:08.852247 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b1775-36fe-4d6c-9dd1-359b8fb335dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:08.853070 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b1775-36fe-4d6c-9dd1-359b8fb335dc None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:08.853352 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b1775-36fe-4d6c-9dd1-359b8fb335dc None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:08.853628 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b1775-36fe-4d6c-9dd1-359b8fb335dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:08.866164 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b1775-36fe-4d6c-9dd1-359b8fb335dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:08.867783 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b1775-36fe-4d6c-9dd1-359b8fb335dc None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:08.887849 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-d03b1775-36fe-4d6c-9dd1-359b8fb335dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:41:08.887849 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:08.887849 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:08.887849 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:08.887849 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:08.887849 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:08.887849 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:08.887849 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:08.887849 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:08.887849 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:08.887849 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:08.887849 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:08.887849 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:41:08.887849 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:41:08.887849 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:41:08.888809 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:41:08.888809 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:08.888809 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:08.888809 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:08.888809 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:08.888809 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:08.888809 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:08.888809 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:08.888809 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:08.888809 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:08.888809 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:08.888809 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:08.888809 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:08.888809 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:08.888809 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:08.888809 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:08.888809 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:08.889688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:41:08.889688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:41:08.889688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:41:08.889688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:08.893757 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 454/914] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:41:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:08.895074 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df131917-fa2e-42ae-8de3-cb018cc9e954 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:08.910992 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:09.015827 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df131917-fa2e-42ae-8de3-cb018cc9e954 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:09.051843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416bca2-9508-41e2-8262-c750d316d4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:09.052961 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416bca2-9508-41e2-8262-c750d316d4c1 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:09.053502 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416bca2-9508-41e2-8262-c750d316d4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:09.053976 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416bca2-9508-41e2-8262-c750d316d4c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:09.054934 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416bca2-9508-41e2-8262-c750d316d4c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:09.055479 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416bca2-9508-41e2-8262-c750d316d4c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:09.057065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416bca2-9508-41e2-8262-c750d316d4c1 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:09.074040 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 461/915] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:09.076993 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b1775-36fe-4d6c-9dd1-359b8fb335dc None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:09.184599 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b1775-36fe-4d6c-9dd1-359b8fb335dc None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:09.220753 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd84a44-4cd5-4b23-9063-deadbad4685a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:09.221560 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd84a44-4cd5-4b23-9063-deadbad4685a None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:09.221840 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd84a44-4cd5-4b23-9063-deadbad4685a None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:09.222109 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd84a44-4cd5-4b23-9063-deadbad4685a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:09.229373 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd84a44-4cd5-4b23-9063-deadbad4685a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:09.231006 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd84a44-4cd5-4b23-9063-deadbad4685a None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:09.245276 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-acd84a44-4cd5-4b23-9063-deadbad4685a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:41:09.245276 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:09.245276 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:09.245276 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:09.245276 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:09.245276 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:09.245276 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:09.245276 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:09.245276 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:09.245276 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:09.245276 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:09.245276 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:09.245276 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:41:09.245276 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:41:09.245276 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:41:09.246182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:41:09.246182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:09.246182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:09.246182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:09.246182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:09.246182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:09.246182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:09.246182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:09.246182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:09.246182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:09.246182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:09.246182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:09.246182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:09.246182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:09.246182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:09.246182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:09.246182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:09.247329 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:41:09.247329 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:41:09.247329 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:41:09.247329 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:41:09.247329 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:41:09.247329 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:41:09.247329 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:41:09.247329 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:09.247329 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 455/916] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:41:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:09.254046 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416bca2-9508-41e2-8262-c750d316d4c1 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:09.329755 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:09.366753 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416bca2-9508-41e2-8262-c750d316d4c1 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:09.385550 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee113b6-f9b2-4adb-af67-64fa132139aa None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:09.386106 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee113b6-f9b2-4adb-af67-64fa132139aa None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:09.386106 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee113b6-f9b2-4adb-af67-64fa132139aa None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:09.387588 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 456/917] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:41:09.392568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f11976-fcc2-48de-95ff-9ae33f3275af None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:09.392861 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f11976-fcc2-48de-95ff-9ae33f3275af None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:09.393147 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f11976-fcc2-48de-95ff-9ae33f3275af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:09.404790 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c535897-febe-4c7e-b304-3c263d37e33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:09.405906 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c535897-febe-4c7e-b304-3c263d37e33c None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:09.406402 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c535897-febe-4c7e-b304-3c263d37e33c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:09.406881 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c535897-febe-4c7e-b304-3c263d37e33c None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:09.407905 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c535897-febe-4c7e-b304-3c263d37e33c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:09.408440 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c535897-febe-4c7e-b304-3c263d37e33c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:09.410070 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c535897-febe-4c7e-b304-3c263d37e33c None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:09.410196 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-04f11976-fcc2-48de-95ff-9ae33f3275af None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:09.411397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-04f11976-fcc2-48de-95ff-9ae33f3275af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:09.427344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 462/918] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:41:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:09.429956 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c535897-febe-4c7e-b304-3c263d37e33c None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:09.457682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:09.483166 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 457/919] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:41:09.506978 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f11976-fcc2-48de-95ff-9ae33f3275af None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:09.536304 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c535897-febe-4c7e-b304-3c263d37e33c None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:09.565676 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:09.576598 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf3f2c-50ad-4a46-8a2d-93a3323aab40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:09.577564 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf3f2c-50ad-4a46-8a2d-93a3323aab40 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:09.578080 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf3f2c-50ad-4a46-8a2d-93a3323aab40 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:09.578562 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf3f2c-50ad-4a46-8a2d-93a3323aab40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:09.579677 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf3f2c-50ad-4a46-8a2d-93a3323aab40 None admin] RBAC: Adding query filter params (role.id=1ecedc947e994590ae954b1a812c3208, scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user.id=4dfddd72dfa84ce39fe62112224b425d) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:09.580260 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf3f2c-50ad-4a46-8a2d-93a3323aab40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:09.581897 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf3f2c-50ad-4a46-8a2d-93a3323aab40 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:09.595301 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 463/920] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:41:09 2022] GET /identity/v3/role_assignments?user.id=4dfddd72dfa84ce39fe62112224b425d&scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e&role.id=1ecedc947e994590ae954b1a812c3208 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:09.614274 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f11976-fcc2-48de-95ff-9ae33f3275af None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:09.662756 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a239b-9e7d-4ef0-9a6a-c451c74090d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:09.663780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a239b-9e7d-4ef0-9a6a-c451c74090d0 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:09.664070 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a239b-9e7d-4ef0-9a6a-c451c74090d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:09.664351 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a239b-9e7d-4ef0-9a6a-c451c74090d0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:09.665026 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a239b-9e7d-4ef0-9a6a-c451c74090d0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:09.666447 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a239b-9e7d-4ef0-9a6a-c451c74090d0 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:09.679844 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-f83a239b-9e7d-4ef0-9a6a-c451c74090d0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 10:41:09.679844 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:09.679844 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:41:09.679844 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:41:09.679844 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:41:09.679844 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:41:09.679844 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:41:09.679844 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:41:09.679844 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 10:41:09.679844 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:09.679844 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:41:09.679844 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:09.679844 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:09.679844 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:09.679844 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:09.679844 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:09.680955 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:09.680955 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:09.680955 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:09.680955 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:09.680955 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:09.680955 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:09.680955 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:09.680955 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:41:09.680955 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:41:09.680955 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:41:09.680955 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:41:09.680955 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:09.680955 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:09.680955 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:09.680955 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:09.680955 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:09.682476 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:09.682476 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:09.682476 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:09.682476 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:09.682476 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:09.682476 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:09.682476 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:09.682476 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:09.682476 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:09.682476 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:09.682476 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:09.682476 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:41:09.682476 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:41:09.682476 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 10:41:09.682476 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:09.682476 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 458/921] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jun 24 10:41:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:41:09.687599 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf3f2c-50ad-4a46-8a2d-93a3323aab40 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:09.797035 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf3f2c-50ad-4a46-8a2d-93a3323aab40 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:09.831874 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff6b48-0797-44c2-9c54-9920b3b543be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:09.832475 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff6b48-0797-44c2-9c54-9920b3b543be None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:09.832762 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff6b48-0797-44c2-9c54-9920b3b543be None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:09.833042 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff6b48-0797-44c2-9c54-9920b3b543be None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:09.833789 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff6b48-0797-44c2-9c54-9920b3b543be None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:09.834103 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff6b48-0797-44c2-9c54-9920b3b543be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:09.835502 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff6b48-0797-44c2-9c54-9920b3b543be None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:09.840752 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 464/922] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Jun 24 10:41:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:41:09.848299 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a239b-9e7d-4ef0-9a6a-c451c74090d0 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:09.889249 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:09.953242 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a239b-9e7d-4ef0-9a6a-c451c74090d0 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:09.988323 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b71a3-12c0-4f11-a6e4-0a38e4a50460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:09.989005 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b71a3-12c0-4f11-a6e4-0a38e4a50460 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:09.989292 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b71a3-12c0-4f11-a6e4-0a38e4a50460 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:09.989572 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b71a3-12c0-4f11-a6e4-0a38e4a50460 None admin] PATH_INFO: `/v3/services` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:09.990349 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b71a3-12c0-4f11-a6e4-0a38e4a50460 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:09.990660 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b71a3-12c0-4f11-a6e4-0a38e4a50460 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:09.992067 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b71a3-12c0-4f11-a6e4-0a38e4a50460 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:10.001278 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 459/923] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Jun 24 10:41:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:10.007373 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff6b48-0797-44c2-9c54-9920b3b543be None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:10.065062 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:10.112262 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff6b48-0797-44c2-9c54-9920b3b543be None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:10.147520 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a1aea-68eb-4608-a9da-c9d82b79a672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:10.148584 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a1aea-68eb-4608-a9da-c9d82b79a672 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:10.149078 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a1aea-68eb-4608-a9da-c9d82b79a672 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:10.149559 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a1aea-68eb-4608-a9da-c9d82b79a672 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:10.150504 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a1aea-68eb-4608-a9da-c9d82b79a672 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:10.152119 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a1aea-68eb-4608-a9da-c9d82b79a672 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:10.174868 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 465/924] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Jun 24 10:41:10 2022] POST /identity/v3/endpoints => generated 347 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:41:10.508491 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf19f7-8910-45d8-92c1-1e493a11ad71 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:10.509008 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf19f7-8910-45d8-92c1-1e493a11ad71 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:10.509008 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf19f7-8910-45d8-92c1-1e493a11ad71 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:10.510589 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 460/925] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:41:10.515835 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a78df6-5ded-4be8-b461-b0553c5816cc None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:10.516659 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a78df6-5ded-4be8-b461-b0553c5816cc None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:10.517160 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a78df6-5ded-4be8-b461-b0553c5816cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:10.534785 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-95a78df6-5ded-4be8-b461-b0553c5816cc None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:10.536358 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-95a78df6-5ded-4be8-b461-b0553c5816cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:10.610097 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 466/926] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:41:10.635799 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf19f7-8910-45d8-92c1-1e493a11ad71 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:10.770819 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf19f7-8910-45d8-92c1-1e493a11ad71 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:10.772548 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:10.810812 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465b4c7-f4ee-43c4-bcfa-0e0d4c4eb557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:10.812033 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465b4c7-f4ee-43c4-bcfa-0e0d4c4eb557 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:10.812316 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465b4c7-f4ee-43c4-bcfa-0e0d4c4eb557 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:10.812589 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465b4c7-f4ee-43c4-bcfa-0e0d4c4eb557 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:10.813241 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465b4c7-f4ee-43c4-bcfa-0e0d4c4eb557 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:10.814604 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465b4c7-f4ee-43c4-bcfa-0e0d4c4eb557 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:10.827083 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-a465b4c7-f4ee-43c4-bcfa-0e0d4c4eb557 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 10:41:10.827083 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:10.827083 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:41:10.827083 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:41:10.827083 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:41:10.827083 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:41:10.827083 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:41:10.827083 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:41:10.827083 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 10:41:10.827083 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:10.827083 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:41:10.827083 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:10.827083 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:10.827083 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:10.827083 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:10.827083 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:10.827083 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:10.828132 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:10.828132 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:10.828132 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:10.828132 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:10.828132 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:10.828132 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:10.828132 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:41:10.828132 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:41:10.828132 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:41:10.828132 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:41:10.828132 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:10.828132 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:10.828132 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:10.828132 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:10.828132 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:10.828132 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:10.828970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:10.828970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:10.828970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:10.828970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:10.828970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:10.828970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:10.828970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:10.828970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:10.828970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:10.828970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:10.828970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:41:10.828970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:41:10.828970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 10:41:10.828970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:10.828970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 461/927] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Jun 24 10:41:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:10.836344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a78df6-5ded-4be8-b461-b0553c5816cc None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:10.880463 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:10.939903 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9ffed-12c6-4b91-bf69-3a11d7aef1b1 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:10.940623 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9ffed-12c6-4b91-bf69-3a11d7aef1b1 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:10.941115 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9ffed-12c6-4b91-bf69-3a11d7aef1b1 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:10.942581 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a78df6-5ded-4be8-b461-b0553c5816cc None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:10.947008 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 462/928] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:41:10.948416 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef23d35-a3cc-4d23-b1a5-bb16c63b0908 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:10.948878 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef23d35-a3cc-4d23-b1a5-bb16c63b0908 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:10.949311 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef23d35-a3cc-4d23-b1a5-bb16c63b0908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:10.967879 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-bef23d35-a3cc-4d23-b1a5-bb16c63b0908 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:10.969402 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-bef23d35-a3cc-4d23-b1a5-bb16c63b0908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:10.978375 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087bc30-6d78-432d-a292-61492e65c3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:10.979061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087bc30-6d78-432d-a292-61492e65c3b9 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:10.979374 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087bc30-6d78-432d-a292-61492e65c3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:10.979659 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087bc30-6d78-432d-a292-61492e65c3b9 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:10.980378 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1087bc30-6d78-432d-a292-61492e65c3b9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:10.980682 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1087bc30-6d78-432d-a292-61492e65c3b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:10.982120 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1087bc30-6d78-432d-a292-61492e65c3b9 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:10.987268 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 467/929] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jun 24 10:41:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:10.992861 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087bc30-6d78-432d-a292-61492e65c3b9 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:11.071412 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 463/930] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:41:11.102834 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef23d35-a3cc-4d23-b1a5-bb16c63b0908 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:11.114552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:11.119355 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087bc30-6d78-432d-a292-61492e65c3b9 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:11.162541 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be9f8c-4c50-42b1-bcf0-8509ecf2c56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:11.163827 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be9f8c-4c50-42b1-bcf0-8509ecf2c56f None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:11.164321 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be9f8c-4c50-42b1-bcf0-8509ecf2c56f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:11.165175 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be9f8c-4c50-42b1-bcf0-8509ecf2c56f None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:11.166383 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be9f8c-4c50-42b1-bcf0-8509ecf2c56f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:11.166904 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be9f8c-4c50-42b1-bcf0-8509ecf2c56f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:11.168956 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be9f8c-4c50-42b1-bcf0-8509ecf2c56f None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:11.180069 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 468/931] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jun 24 10:41:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:41:11.181171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be9f8c-4c50-42b1-bcf0-8509ecf2c56f None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:11.230935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:11.238289 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef23d35-a3cc-4d23-b1a5-bb16c63b0908 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:11.288973 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a7a71-9fcb-4204-b212-91b97d47ddfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:11.289954 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a7a71-9fcb-4204-b212-91b97d47ddfc None admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:11.290292 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a7a71-9fcb-4204-b212-91b97d47ddfc None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:11.290577 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a7a71-9fcb-4204-b212-91b97d47ddfc None admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:11.291604 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3a7a71-9fcb-4204-b212-91b97d47ddfc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:11.293051 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3a7a71-9fcb-4204-b212-91b97d47ddfc None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:11.295019 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: WARNING keystone.server.flask.common [None req-2a3a7a71-9fcb-4204-b212-91b97d47ddfc None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 24 10:41:11.314217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be9f8c-4c50-42b1-bcf0-8509ecf2c56f None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:11.320536 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.sql.core [None req-2a3a7a71-9fcb-4204-b212-91b97d47ddfc None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 10:41:11.320536 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 24 10:41:11.320536 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [parameters: {'id': 'd85016d9e41c4bce854d2957eda4a61e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 24 10:41:11.320536 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80173) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 10:41:11.329474 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-2a3a7a71-9fcb-4204-b212-91b97d47ddfc None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d85016d9e41c4bce854d2957eda4a61e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d85016d9e41c4bce854d2957eda4a61e. Jun 24 10:41:11.329474 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:11.329474 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 10:41:11.329474 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 10:41:11.329474 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 10:41:11.329474 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 10:41:11.329474 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 10:41:11.329474 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 10:41:11.329474 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 10:41:11.329474 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application conn.query(q) Jun 24 10:41:11.329474 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 10:41:11.329474 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 10:41:11.329474 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 10:41:11.330361 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application result.read() Jun 24 10:41:11.330361 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 10:41:11.330361 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 10:41:11.330361 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 10:41:11.330361 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 10:41:11.330361 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 10:41:11.330361 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 10:41:11.330361 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 10:41:11.330361 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 10:41:11.330361 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 10:41:11.330361 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:11.330361 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 10:41:11.330361 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:11.330361 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:11.330361 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 10:41:11.330361 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 10:41:11.330361 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 24 10:41:11.330361 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 24 10:41:11.331352 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 10:41:11.331352 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application next(self.gen) Jun 24 10:41:11.331352 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 10:41:11.331352 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application yield resource Jun 24 10:41:11.331352 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 10:41:11.331352 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application next(self.gen) Jun 24 10:41:11.331352 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 10:41:11.331352 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 10:41:11.331352 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 10:41:11.331352 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 10:41:11.331352 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 10:41:11.331352 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise self.value Jun 24 10:41:11.331352 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 10:41:11.331352 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 10:41:11.331352 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 10:41:11.331352 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application session.commit() Jun 24 10:41:11.331352 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 10:41:11.332423 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 10:41:11.332423 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 10:41:11.332423 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 10:41:11.332423 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 10:41:11.332423 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self.session.flush() Jun 24 10:41:11.332423 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 10:41:11.332423 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 10:41:11.332423 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 10:41:11.332423 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 10:41:11.332423 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 10:41:11.332423 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application compat.raise_( Jun 24 10:41:11.332423 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 10:41:11.332423 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception Jun 24 10:41:11.332423 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 10:41:11.332423 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 10:41:11.332423 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 10:41:11.332423 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 10:41:11.333502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 10:41:11.333502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 10:41:11.333502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 10:41:11.333502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 10:41:11.333502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 24 10:41:11.333502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 24 10:41:11.333502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 10:41:11.333502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 10:41:11.333502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 10:41:11.333502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 10:41:11.333502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 10:41:11.333502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 10:41:11.333502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 10:41:11.333502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 10:41:11.333502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 10:41:11.334291 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 10:41:11.334291 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 10:41:11.334291 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception Jun 24 10:41:11.334291 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 10:41:11.334291 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 10:41:11.334291 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 10:41:11.334291 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 10:41:11.334291 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 10:41:11.334291 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 10:41:11.334291 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 10:41:11.334291 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application conn.query(q) Jun 24 10:41:11.334291 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 10:41:11.334291 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 10:41:11.334291 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 10:41:11.334291 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application result.read() Jun 24 10:41:11.334291 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 10:41:11.334291 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 10:41:11.335279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 10:41:11.335279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 10:41:11.335279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 10:41:11.335279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 10:41:11.335279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 10:41:11.335279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 10:41:11.335279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 10:41:11.335279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 24 10:41:11.335279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [parameters: {'id': 'd85016d9e41c4bce854d2957eda4a61e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 24 10:41:11.335279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 10:41:11.335279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:11.335279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:41:11.335279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:11.335279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:11.335279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 24 10:41:11.336144 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 24 10:41:11.336144 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 10:41:11.336144 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 10:41:11.336144 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 24 10:41:11.336144 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:11.336144 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:41:11.336144 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:11.336144 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:11.336144 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:11.336144 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:11.336144 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:11.336144 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:11.336144 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:11.336144 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:11.336144 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:11.336144 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:11.336144 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:11.337823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:11.337823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 24 10:41:11.337823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 24 10:41:11.337823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:11.337823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:11.337823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 24 10:41:11.337823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 24 10:41:11.337823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d85016d9e41c4bce854d2957eda4a61e. Jun 24 10:41:11.337823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:11.337823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 464/932] 10.222.0.16 () {60 vars in 1140 bytes} [Fri Jun 24 10:41:11 2022] POST /identity/v3/projects => generated 262 bytes in 234 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:11.337823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a7a71-9fcb-4204-b212-91b97d47ddfc None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:11.376677 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4dcdec-2aed-4211-823f-ef5ef5a23fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:11.378180 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dcdec-2aed-4211-823f-ef5ef5a23fdf None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:11.378668 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dcdec-2aed-4211-823f-ef5ef5a23fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:11.379369 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dcdec-2aed-4211-823f-ef5ef5a23fdf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:11.380525 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4dcdec-2aed-4211-823f-ef5ef5a23fdf None admin] RBAC: Adding query filter params (interface=public, service_id=95ec96bceb2d432c8676b1cdfba34b55, region_id=RegionOne) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:11.381031 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4dcdec-2aed-4211-823f-ef5ef5a23fdf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:11.382801 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4dcdec-2aed-4211-823f-ef5ef5a23fdf None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:11.395064 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 469/933] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Jun 24 10:41:11 2022] GET /identity/v3/endpoints?service_id=95ec96bceb2d432c8676b1cdfba34b55&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:11.396221 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4dcdec-2aed-4211-823f-ef5ef5a23fdf None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:11.432144 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:11.474674 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a7a71-9fcb-4204-b212-91b97d47ddfc None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:11.518081 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4dcdec-2aed-4211-823f-ef5ef5a23fdf None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:11.520133 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0b3b0-c9ee-4745-8eb6-cd33e78ac9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:11.522387 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0b3b0-c9ee-4745-8eb6-cd33e78ac9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:11.522884 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0b3b0-c9ee-4745-8eb6-cd33e78ac9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:11.523373 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0b3b0-c9ee-4745-8eb6-cd33e78ac9f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:11.532278 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0b3b0-c9ee-4745-8eb6-cd33e78ac9f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:11.535129 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0b3b0-c9ee-4745-8eb6-cd33e78ac9f2 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:11.552486 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-fcf0b3b0-c9ee-4745-8eb6-cd33e78ac9f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:41:11.552486 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:11.552486 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:11.552486 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:11.552486 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:11.552486 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:11.552486 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:11.552486 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:11.552486 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:11.552486 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:11.552486 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:11.552486 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:11.552486 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:41:11.552486 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:41:11.552486 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:41:11.553446 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:41:11.553446 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:11.553446 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:11.553446 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:11.553446 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:11.553446 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:11.553446 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:11.553446 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:11.553446 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:11.553446 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:11.553446 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:11.553446 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:11.553446 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:11.553446 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:11.553446 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:11.553446 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:11.553446 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:11.554392 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:41:11.554392 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:41:11.554392 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:41:11.554392 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:41:11.554392 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:41:11.554392 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:41:11.554392 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:41:11.554392 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:11.559024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 465/934] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:41:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:11.560174 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0b3b0-c9ee-4745-8eb6-cd33e78ac9f2 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:11.562544 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34fb66-f0ed-428c-a7de-d842ff89dbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:11.563723 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34fb66-f0ed-428c-a7de-d842ff89dbf4 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:11.565116 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34fb66-f0ed-428c-a7de-d842ff89dbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:11.565596 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34fb66-f0ed-428c-a7de-d842ff89dbf4 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:11.566490 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34fb66-f0ed-428c-a7de-d842ff89dbf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:11.568253 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34fb66-f0ed-428c-a7de-d842ff89dbf4 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:11.576959 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:11.579208 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 470/935] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Jun 24 10:41:11 2022] GET /identity/v3/services => generated 1497 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:41:11.683658 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0b3b0-c9ee-4745-8eb6-cd33e78ac9f2 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:11.722454 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdcabc-caf5-455a-a05f-6539f57f141b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:11.723523 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdcabc-caf5-455a-a05f-6539f57f141b None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:11.724025 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdcabc-caf5-455a-a05f-6539f57f141b None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:11.724604 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdcabc-caf5-455a-a05f-6539f57f141b None admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:11.725580 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cdcabc-caf5-455a-a05f-6539f57f141b None admin] RBAC: Adding query filter params (name=service) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:11.726104 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7cf57-586a-4f7e-85c1-ad589ff69233 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:11.726297 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cdcabc-caf5-455a-a05f-6539f57f141b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:11.726395 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7cf57-586a-4f7e-85c1-ad589ff69233 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:11.726662 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7cf57-586a-4f7e-85c1-ad589ff69233 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:11.728250 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cdcabc-caf5-455a-a05f-6539f57f141b None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:11.732242 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 471/936] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:41:11.734053 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f03be1-0f13-41b0-869b-ff657d30501c None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:11.734419 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f03be1-0f13-41b0-869b-ff657d30501c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:11.734773 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f03be1-0f13-41b0-869b-ff657d30501c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:11.753901 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-37f03be1-0f13-41b0-869b-ff657d30501c None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:11.755103 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-37f03be1-0f13-41b0-869b-ff657d30501c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:11.759628 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 466/937] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jun 24 10:41:11 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:11.843461 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 472/938] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:41:11.864077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdcabc-caf5-455a-a05f-6539f57f141b None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:11.943239 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:11.976360 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdcabc-caf5-455a-a05f-6539f57f141b None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:12.014200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13e68d-f76b-4d35-8baf-e010b1331e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:12.015043 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13e68d-f76b-4d35-8baf-e010b1331e89 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:12.015352 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13e68d-f76b-4d35-8baf-e010b1331e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:12.015631 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13e68d-f76b-4d35-8baf-e010b1331e89 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:12.027405 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13e68d-f76b-4d35-8baf-e010b1331e89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:41:12.035737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-6d13e68d-f76b-4d35-8baf-e010b1331e89 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 10:41:12.035737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:12.035737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:12.035737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:12.035737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:12.035737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:12.035737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:12.035737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:12.035737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:12.035737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:12.035737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:12.035737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:12.035737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:41:12.035737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:41:12.035737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:41:12.035737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:41:12.036742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:41:12.036742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:41:12.036742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:41:12.036742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:41:12.036742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:12.036742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:12.036742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:12.036742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:12.036742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:12.036742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:12.036742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:12.036742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:12.036742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:12.036742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:12.036742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:12.036742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:12.037585 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:12.037585 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:12.037585 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:12.037585 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:12.037585 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:41:12.037585 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:41:12.037585 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:41:12.037585 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:41:12.037585 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:41:12.037585 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:41:12.037585 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 10:41:12.037585 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:12.037585 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 467/939] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jun 24 10:41:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:12.043262 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f03be1-0f13-41b0-869b-ff657d30501c None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:12.070411 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:12.149841 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f03be1-0f13-41b0-869b-ff657d30501c None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:12.184821 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73581b-eb29-4f9f-947e-41f5c236e21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:12.185511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73581b-eb29-4f9f-947e-41f5c236e21a None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:12.185794 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73581b-eb29-4f9f-947e-41f5c236e21a None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:12.186067 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73581b-eb29-4f9f-947e-41f5c236e21a None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:12.187211 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c73581b-eb29-4f9f-947e-41f5c236e21a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:12.187525 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c73581b-eb29-4f9f-947e-41f5c236e21a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:12.188900 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c73581b-eb29-4f9f-947e-41f5c236e21a None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:12.202306 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 473/940] 10.222.0.16 () {56 vars in 1115 bytes} [Fri Jun 24 10:41:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:12.203561 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13e68d-f76b-4d35-8baf-e010b1331e89 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:12.272449 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d217b8-aeb4-42e0-9101-f9a9da939c06 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:12.272785 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d217b8-aeb4-42e0-9101-f9a9da939c06 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:12.273013 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d217b8-aeb4-42e0-9101-f9a9da939c06 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:12.274628 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 474/941] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:41:12.279458 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cffc1-fff6-4793-8ef3-3fa625672ed5 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:12.279747 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cffc1-fff6-4793-8ef3-3fa625672ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:12.280026 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cffc1-fff6-4793-8ef3-3fa625672ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:12.300849 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-af5cffc1-fff6-4793-8ef3-3fa625672ed5 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:12.302055 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-af5cffc1-fff6-4793-8ef3-3fa625672ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:12.315272 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13e68d-f76b-4d35-8baf-e010b1331e89 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:12.347489 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:12.354557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0575e6-e538-4bc6-ab75-a89731c01d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:12.355416 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0575e6-e538-4bc6-ab75-a89731c01d36 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:12.355697 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0575e6-e538-4bc6-ab75-a89731c01d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:12.355966 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0575e6-e538-4bc6-ab75-a89731c01d36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:12.368426 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0575e6-e538-4bc6-ab75-a89731c01d36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:12.370090 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0575e6-e538-4bc6-ab75-a89731c01d36 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:12.388742 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 475/942] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:41:12.395504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-5d0575e6-e538-4bc6-ab75-a89731c01d36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:41:12.395504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:12.395504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:12.395504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:12.395504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:12.395504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:12.395504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:12.395504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:12.395504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:12.395504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:12.395504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:12.395504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:12.395504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:41:12.395504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:41:12.395504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:41:12.396568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:41:12.396568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:12.396568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:12.396568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:12.396568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:12.396568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:12.396568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:12.396568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:12.396568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:12.396568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:12.396568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:12.396568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:12.396568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:12.396568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:12.396568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:12.396568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:12.396568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:12.397689 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:41:12.397689 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:41:12.397689 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:41:12.397689 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:12.397689 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 468/943] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:41:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:12.403258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5cffc1-fff6-4793-8ef3-3fa625672ed5 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:12.415657 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0575e6-e538-4bc6-ab75-a89731c01d36 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:12.423428 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:12.524910 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5cffc1-fff6-4793-8ef3-3fa625672ed5 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:12.535338 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0575e6-e538-4bc6-ab75-a89731c01d36 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:12.571479 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a82ef7-d611-4be2-8dd6-3fc6f8fd933f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:12.572171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a82ef7-d611-4be2-8dd6-3fc6f8fd933f None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:12.572452 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a82ef7-d611-4be2-8dd6-3fc6f8fd933f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:12.572727 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a82ef7-d611-4be2-8dd6-3fc6f8fd933f None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:12.573459 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a82ef7-d611-4be2-8dd6-3fc6f8fd933f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:12.573766 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a82ef7-d611-4be2-8dd6-3fc6f8fd933f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:12.575136 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a82ef7-d611-4be2-8dd6-3fc6f8fd933f None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:12.577844 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0c55d-10c1-4844-8ad5-7c75fc2b5b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:12.578653 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0c55d-10c1-4844-8ad5-7c75fc2b5b2b None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:12.578930 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0c55d-10c1-4844-8ad5-7c75fc2b5b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:12.579226 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0c55d-10c1-4844-8ad5-7c75fc2b5b2b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:12.579884 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0c55d-10c1-4844-8ad5-7c75fc2b5b2b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:12.581239 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0c55d-10c1-4844-8ad5-7c75fc2b5b2b None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:12.592264 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 476/944] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:12.597134 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-40f0c55d-10c1-4844-8ad5-7c75fc2b5b2b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 10:41:12.597134 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:12.597134 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:41:12.597134 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:41:12.597134 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:41:12.597134 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:41:12.597134 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:41:12.597134 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:41:12.597134 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 10:41:12.597134 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:12.597134 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:41:12.597134 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:12.597134 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:12.597134 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:12.597134 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:12.597134 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:12.597134 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:12.598096 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:12.598096 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:12.598096 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:12.598096 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:12.598096 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:12.598096 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:12.598096 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:41:12.598096 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:41:12.598096 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:41:12.598096 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:41:12.598096 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:12.598096 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:12.598096 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:12.598096 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:12.598096 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:12.598096 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:12.598968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:12.598968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:12.598968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:12.598968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:12.598968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:12.598968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:12.598968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:12.598968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:12.598968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:12.598968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:12.598968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:41:12.598968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:41:12.598968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 10:41:12.598968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:12.599744 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a82ef7-d611-4be2-8dd6-3fc6f8fd933f None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:12.601299 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 469/945] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:41:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:41:12.607971 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0c55d-10c1-4844-8ad5-7c75fc2b5b2b None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:12.671648 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:12.698084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:12.726214 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a82ef7-d611-4be2-8dd6-3fc6f8fd933f None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:12.735523 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0c55d-10c1-4844-8ad5-7c75fc2b5b2b None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:12.768104 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627e391-dac7-453f-be12-2cbc8f516654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:12.769445 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627e391-dac7-453f-be12-2cbc8f516654 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:12.769883 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627e391-dac7-453f-be12-2cbc8f516654 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:12.770101 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8c70b-2f63-4470-81ca-2d15517cb83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:12.770479 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627e391-dac7-453f-be12-2cbc8f516654 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:12.770990 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8c70b-2f63-4470-81ca-2d15517cb83a None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:12.771406 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8c70b-2f63-4470-81ca-2d15517cb83a None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:12.771780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8c70b-2f63-4470-81ca-2d15517cb83a None admin] PATH_INFO: `/v3/services` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:12.772584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8c70b-2f63-4470-81ca-2d15517cb83a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:12.772986 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8c70b-2f63-4470-81ca-2d15517cb83a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:12.774511 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8c70b-2f63-4470-81ca-2d15517cb83a None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:12.781746 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627e391-dac7-453f-be12-2cbc8f516654 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:12.783519 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627e391-dac7-453f-be12-2cbc8f516654 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:12.785156 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 470/946] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jun 24 10:41:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:12.786226 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8c70b-2f63-4470-81ca-2d15517cb83a None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:12.803483 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-b627e391-dac7-453f-be12-2cbc8f516654 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 10:41:12.803483 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:12.803483 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:12.803483 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:12.803483 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:12.803483 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:12.803483 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:12.803483 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:12.803483 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:12.803483 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:12.803483 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:12.803483 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:12.803483 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:41:12.803483 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:41:12.803483 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:41:12.803483 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:41:12.804721 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:12.804721 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:12.804721 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:41:12.804721 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:41:12.804721 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:41:12.804721 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:41:12.804721 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:12.804721 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:12.804721 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:12.804721 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:12.804721 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:12.804721 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:12.804721 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:12.804721 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:12.804721 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:12.804721 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:12.804721 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:12.804721 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:12.805896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:12.805896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:12.805896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:41:12.805896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:41:12.805896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:41:12.805896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:41:12.805896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:41:12.805896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:41:12.805896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 10:41:12.805896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:12.808627 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 477/947] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jun 24 10:41:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:41:12.815688 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627e391-dac7-453f-be12-2cbc8f516654 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:12.910945 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8c70b-2f63-4470-81ca-2d15517cb83a None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:12.926702 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:12.949044 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627e391-dac7-453f-be12-2cbc8f516654 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:12.957717 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e451677-3ae0-4511-8c7d-d67f7f672d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:12.958974 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e451677-3ae0-4511-8c7d-d67f7f672d9d None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:12.959773 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e451677-3ae0-4511-8c7d-d67f7f672d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:12.960380 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e451677-3ae0-4511-8c7d-d67f7f672d9d None admin] PATH_INFO: `/v3/services` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:12.961372 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e451677-3ae0-4511-8c7d-d67f7f672d9d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:12.961874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e451677-3ae0-4511-8c7d-d67f7f672d9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:12.964238 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e451677-3ae0-4511-8c7d-d67f7f672d9d None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:12.970557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 471/948] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jun 24 10:41:12 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:12.988768 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ec7cf-1e4c-4d15-a11f-c6184ea13d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:12.989630 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ec7cf-1e4c-4d15-a11f-c6184ea13d33 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:12.989988 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ec7cf-1e4c-4d15-a11f-c6184ea13d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:12.990343 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ec7cf-1e4c-4d15-a11f-c6184ea13d33 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:12.991363 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ec7cf-1e4c-4d15-a11f-c6184ea13d33 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:12.991782 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ec7cf-1e4c-4d15-a11f-c6184ea13d33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:12.993397 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ec7cf-1e4c-4d15-a11f-c6184ea13d33 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:13.005944 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:13.016074 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 478/949] 10.222.0.16 () {56 vars in 1149 bytes} [Fri Jun 24 10:41:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:13.022919 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e451677-3ae0-4511-8c7d-d67f7f672d9d None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:13.134987 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e451677-3ae0-4511-8c7d-d67f7f672d9d None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:13.175692 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a4ab7-3950-4aa3-b9f1-16c019f2bd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:13.176505 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a4ab7-3950-4aa3-b9f1-16c019f2bd21 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:13.176790 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a4ab7-3950-4aa3-b9f1-16c019f2bd21 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:13.177163 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a4ab7-3950-4aa3-b9f1-16c019f2bd21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:13.188646 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a4ab7-3950-4aa3-b9f1-16c019f2bd21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:13.190098 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a4ab7-3950-4aa3-b9f1-16c019f2bd21 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:13.207682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-178a4ab7-3950-4aa3-b9f1-16c019f2bd21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:41:13.207682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:13.207682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:13.207682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:13.207682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:13.207682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:13.207682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:13.207682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:13.207682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:13.207682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:13.207682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:13.207682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:13.207682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:41:13.207682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:41:13.207682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:41:13.208793 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:41:13.208793 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:13.208793 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:13.208793 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:13.208793 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:13.208793 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:13.208793 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:13.208793 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:13.208793 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:13.208793 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:13.208793 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:13.208793 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:13.208793 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:13.208793 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:13.208793 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:13.208793 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:13.208793 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:13.209679 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:41:13.209679 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:41:13.209679 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:41:13.209679 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:13.209679 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 472/950] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:41:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:13.215507 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ec7cf-1e4c-4d15-a11f-c6184ea13d33 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:13.321519 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ec7cf-1e4c-4d15-a11f-c6184ea13d33 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:13.357528 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b201045-2521-4824-83a1-6d945910aafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:13.358572 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b201045-2521-4824-83a1-6d945910aafa None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:13.359087 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b201045-2521-4824-83a1-6d945910aafa None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:13.359593 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b201045-2521-4824-83a1-6d945910aafa None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:13.360522 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b201045-2521-4824-83a1-6d945910aafa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:13.361028 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b201045-2521-4824-83a1-6d945910aafa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:13.362664 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b201045-2521-4824-83a1-6d945910aafa None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:13.375359 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 479/951] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:13.387276 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a4ab7-3950-4aa3-b9f1-16c019f2bd21 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:13.413545 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:13.488995 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a4ab7-3950-4aa3-b9f1-16c019f2bd21 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:13.524818 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21db6e9-6eea-4ed0-8743-578333dbad15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:13.525643 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21db6e9-6eea-4ed0-8743-578333dbad15 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:13.525927 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21db6e9-6eea-4ed0-8743-578333dbad15 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:13.526207 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21db6e9-6eea-4ed0-8743-578333dbad15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:13.533204 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21db6e9-6eea-4ed0-8743-578333dbad15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:13.534666 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21db6e9-6eea-4ed0-8743-578333dbad15 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:13.549069 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-f21db6e9-6eea-4ed0-8743-578333dbad15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:41:13.549069 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:13.549069 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:13.549069 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:13.549069 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:13.549069 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:13.549069 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:13.549069 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:13.549069 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:13.549069 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:13.549069 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:13.549069 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:13.549069 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:41:13.549069 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:41:13.549069 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:41:13.550390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:41:13.550390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:13.550390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:13.550390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:13.550390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:13.550390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:13.550390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:13.550390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:13.550390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:13.550390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:13.550390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:13.550390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:13.550390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:13.550390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:13.550390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:13.550390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:13.550390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:13.551316 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:41:13.551316 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:41:13.551316 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:41:13.551316 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:41:13.551316 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:41:13.551316 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:41:13.551316 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:41:13.551316 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:13.551316 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 473/952] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:41:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:13.556305 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b201045-2521-4824-83a1-6d945910aafa None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:13.630800 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:13.713696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b201045-2521-4824-83a1-6d945910aafa None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:13.737386 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc61e41-1777-480b-86d2-981a2c007137 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:13.737745 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc61e41-1777-480b-86d2-981a2c007137 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:13.737951 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc61e41-1777-480b-86d2-981a2c007137 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:13.739641 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 474/953] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:41:13.745258 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215aa08-c5c2-4527-9cf3-ab7165de5032 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:13.745544 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215aa08-c5c2-4527-9cf3-ab7165de5032 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:13.745824 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215aa08-c5c2-4527-9cf3-ab7165de5032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:13.751342 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416fba9-9535-42f5-959a-07763a6933b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:13.752291 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416fba9-9535-42f5-959a-07763a6933b6 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:13.752643 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416fba9-9535-42f5-959a-07763a6933b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:13.753004 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416fba9-9535-42f5-959a-07763a6933b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:13.753879 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416fba9-9535-42f5-959a-07763a6933b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:13.754262 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416fba9-9535-42f5-959a-07763a6933b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:13.756090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416fba9-9535-42f5-959a-07763a6933b6 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:13.769182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-7215aa08-c5c2-4527-9cf3-ab7165de5032 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:13.769441 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 480/954] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:41:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:13.771855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-7215aa08-c5c2-4527-9cf3-ab7165de5032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:13.775270 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416fba9-9535-42f5-959a-07763a6933b6 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:13.862211 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 475/955] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:41:13.883620 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215aa08-c5c2-4527-9cf3-ab7165de5032 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:13.900312 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416fba9-9535-42f5-959a-07763a6933b6 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:13.905093 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:13.917093 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:13.945867 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513088ee-8af4-4c17-9520-e8fb4f9f931e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:13.947194 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513088ee-8af4-4c17-9520-e8fb4f9f931e None admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:13.947463 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513088ee-8af4-4c17-9520-e8fb4f9f931e None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:13.947740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513088ee-8af4-4c17-9520-e8fb4f9f931e None admin] PATH_INFO: `/v3/projects/61b2f5f9674c4fd3a1ec5db2f3b4b26e/users/4dfddd72dfa84ce39fe62112224b425d/roles/1ecedc947e994590ae954b1a812c3208` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:13.950507 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513088ee-8af4-4c17-9520-e8fb4f9f931e None admin] RBAC: Authorizing `identity:create_grant(project_id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user_id=4dfddd72dfa84ce39fe62112224b425d, role_id=1ecedc947e994590ae954b1a812c3208)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:13.952257 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513088ee-8af4-4c17-9520-e8fb4f9f931e None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:13.975204 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 481/956] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 10:41:13 2022] PUT /identity/v3/projects/61b2f5f9674c4fd3a1ec5db2f3b4b26e/users/4dfddd72dfa84ce39fe62112224b425d/roles/1ecedc947e994590ae954b1a812c3208 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:41:14.013195 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215aa08-c5c2-4527-9cf3-ab7165de5032 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:14.048369 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391d22b-42be-4380-b613-ad03e2bf58a4 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:14.048853 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391d22b-42be-4380-b613-ad03e2bf58a4 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:14.049136 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391d22b-42be-4380-b613-ad03e2bf58a4 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:14.051633 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 482/957] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:41:14.056642 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106412f0-9446-4ac9-a3aa-1ed419d4814f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:14.057235 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80026c94-725c-45c5-8b00-e6a970c43365 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:14.057553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106412f0-9446-4ac9-a3aa-1ed419d4814f None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:14.057664 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80026c94-725c-45c5-8b00-e6a970c43365 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:14.057820 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106412f0-9446-4ac9-a3aa-1ed419d4814f None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:14.057917 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80026c94-725c-45c5-8b00-e6a970c43365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:14.058061 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106412f0-9446-4ac9-a3aa-1ed419d4814f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:14.058708 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106412f0-9446-4ac9-a3aa-1ed419d4814f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:14.060211 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106412f0-9446-4ac9-a3aa-1ed419d4814f None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:14.076568 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-80026c94-725c-45c5-8b00-e6a970c43365 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:14.077112 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-106412f0-9446-4ac9-a3aa-1ed419d4814f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 10:41:14.077112 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:14.077112 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:41:14.077112 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:41:14.077112 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:41:14.077112 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:41:14.077112 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:41:14.077112 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:41:14.077112 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 10:41:14.077112 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:14.077112 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:41:14.077112 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:14.077112 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:14.077112 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:14.077112 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:14.077112 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:14.077112 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:14.078252 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:14.078252 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:14.078252 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:14.078252 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:14.078252 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:14.078252 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:14.078252 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:41:14.078252 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:41:14.078252 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:41:14.078252 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:41:14.078252 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:14.078252 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:14.078252 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:14.078252 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:14.078252 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:14.078252 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:14.079188 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:14.079188 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:14.079188 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:14.079188 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:14.079188 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:14.079188 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:14.079188 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:14.079188 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:14.079188 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:14.079188 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:14.079188 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:41:14.079188 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:41:14.079188 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 10:41:14.079188 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:14.079981 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-80026c94-725c-45c5-8b00-e6a970c43365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:14.080052 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 476/958] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Jun 24 10:41:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:41:14.084865 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106412f0-9446-4ac9-a3aa-1ed419d4814f None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:14.184724 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 483/959] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:41:14.197175 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:14.213339 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80026c94-725c-45c5-8b00-e6a970c43365 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:14.225550 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106412f0-9446-4ac9-a3aa-1ed419d4814f None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:14.262838 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c9449-f39c-448f-bf50-193f3f699aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:14.263795 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c9449-f39c-448f-bf50-193f3f699aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:14.264330 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c9449-f39c-448f-bf50-193f3f699aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:14.264759 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c9449-f39c-448f-bf50-193f3f699aa8 None admin] PATH_INFO: `/v3/services` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:14.265605 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c9449-f39c-448f-bf50-193f3f699aa8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:14.266165 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c9449-f39c-448f-bf50-193f3f699aa8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:14.267695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c9449-f39c-448f-bf50-193f3f699aa8 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:14.273431 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 477/960] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jun 24 10:41:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:14.279350 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c9449-f39c-448f-bf50-193f3f699aa8 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:14.341339 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80026c94-725c-45c5-8b00-e6a970c43365 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:14.343998 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:14.384188 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc901d1e-7b02-400d-9ae2-96d726cd5bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:14.384968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc901d1e-7b02-400d-9ae2-96d726cd5bf4 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:14.385328 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc901d1e-7b02-400d-9ae2-96d726cd5bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:14.385681 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc901d1e-7b02-400d-9ae2-96d726cd5bf4 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:14.386464 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc901d1e-7b02-400d-9ae2-96d726cd5bf4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:14.388036 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc901d1e-7b02-400d-9ae2-96d726cd5bf4 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:14.389439 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: WARNING keystone.server.flask.common [None req-cc901d1e-7b02-400d-9ae2-96d726cd5bf4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 24 10:41:14.394980 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c9449-f39c-448f-bf50-193f3f699aa8 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:14.402489 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.sql.core [None req-cc901d1e-7b02-400d-9ae2-96d726cd5bf4 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 10:41:14.402489 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 24 10:41:14.402489 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [parameters: {'user_id': 'bf8d3086bd204b4ea9a30c5c515d399c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 24 10:41:14.402489 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80174) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 10:41:14.420258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-cc901d1e-7b02-400d-9ae2-96d726cd5bf4 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 24 10:41:14.420258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:14.420258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 10:41:14.420258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 10:41:14.420258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 10:41:14.420258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 10:41:14.420258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 10:41:14.420258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 10:41:14.420258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 10:41:14.420258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application conn.query(q) Jun 24 10:41:14.420258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 10:41:14.420258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 10:41:14.420258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 10:41:14.420258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application result.read() Jun 24 10:41:14.420258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 10:41:14.421199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 10:41:14.421199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 10:41:14.421199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 10:41:14.421199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 10:41:14.421199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 10:41:14.421199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 10:41:14.421199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 10:41:14.421199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 10:41:14.421199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:14.421199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 10:41:14.421199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:14.421199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:14.421199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 10:41:14.421199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 10:41:14.421199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 24 10:41:14.421199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 24 10:41:14.421199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 10:41:14.421199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application next(self.gen) Jun 24 10:41:14.422134 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 10:41:14.422134 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application yield resource Jun 24 10:41:14.422134 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 10:41:14.422134 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application next(self.gen) Jun 24 10:41:14.422134 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 10:41:14.422134 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 10:41:14.422134 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 10:41:14.422134 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 10:41:14.422134 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 10:41:14.422134 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise self.value Jun 24 10:41:14.422134 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 10:41:14.422134 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 10:41:14.422134 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 10:41:14.422134 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application session.commit() Jun 24 10:41:14.422134 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 10:41:14.422134 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 10:41:14.422134 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 10:41:14.423049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 10:41:14.423049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 10:41:14.423049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self.session.flush() Jun 24 10:41:14.423049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 10:41:14.423049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 10:41:14.423049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 10:41:14.423049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 10:41:14.423049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 10:41:14.423049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application compat.raise_( Jun 24 10:41:14.423049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 10:41:14.423049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception Jun 24 10:41:14.423049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 10:41:14.423049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 10:41:14.423049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 10:41:14.423049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 10:41:14.423049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 10:41:14.423049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 10:41:14.423978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 10:41:14.423978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 10:41:14.423978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 24 10:41:14.423978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 24 10:41:14.423978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 10:41:14.423978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 10:41:14.423978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 10:41:14.423978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 10:41:14.423978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 10:41:14.423978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 10:41:14.423978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 10:41:14.423978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 10:41:14.423978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 10:41:14.423978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 10:41:14.423978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 10:41:14.423978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception Jun 24 10:41:14.424876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 10:41:14.424876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 10:41:14.424876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 10:41:14.424876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 10:41:14.424876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 10:41:14.424876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 10:41:14.424876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 10:41:14.424876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application conn.query(q) Jun 24 10:41:14.424876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 10:41:14.424876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 10:41:14.424876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 10:41:14.424876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application result.read() Jun 24 10:41:14.424876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 10:41:14.424876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 10:41:14.424876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 10:41:14.424876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 10:41:14.425728 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 10:41:14.425728 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 10:41:14.425728 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 10:41:14.425728 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 10:41:14.425728 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 10:41:14.425728 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 24 10:41:14.425728 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [parameters: {'user_id': 'bf8d3086bd204b4ea9a30c5c515d399c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 24 10:41:14.425728 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 10:41:14.425728 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:14.425728 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:41:14.425728 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:14.425728 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:14.425728 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:14.425728 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:14.425728 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:14.426567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:14.426567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:14.426567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:14.426567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:14.426567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:14.426567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:14.426567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:14.426567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 24 10:41:14.426567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 24 10:41:14.426567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:14.426567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:14.426567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:41:14.426567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:41:14.426567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:41:14.426567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:41:14.426567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 24 10:41:14.426567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 24 10:41:14.427573 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 24 10:41:14.427573 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 24 10:41:14.427573 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 10:41:14.427573 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 10:41:14.427573 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 24 10:41:14.427573 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:14.427573 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 484/961] 10.222.0.16 () {60 vars in 1131 bytes} [Fri Jun 24 10:41:14 2022] POST /identity/v3/users => generated 160 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:41:14.432492 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc901d1e-7b02-400d-9ae2-96d726cd5bf4 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:14.435902 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc33652-f4e4-439b-a622-df366c8140da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:14.436875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc33652-f4e4-439b-a622-df366c8140da None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:14.437164 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc33652-f4e4-439b-a622-df366c8140da None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:14.437445 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc33652-f4e4-439b-a622-df366c8140da None admin] PATH_INFO: `/v3/services` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:14.438163 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc33652-f4e4-439b-a622-df366c8140da None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:14.438472 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc33652-f4e4-439b-a622-df366c8140da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:14.439924 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc33652-f4e4-439b-a622-df366c8140da None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:14.449954 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 478/962] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jun 24 10:41:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:14.450917 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc33652-f4e4-439b-a622-df366c8140da None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:14.466921 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:14.554615 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc901d1e-7b02-400d-9ae2-96d726cd5bf4 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:14.581867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc33652-f4e4-439b-a622-df366c8140da None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:14.616951 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23ef0d-8e7c-46bb-8bf8-dc33549060bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:14.618316 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4945a5a-1794-4fd7-bd60-5e07103e62f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:14.618538 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23ef0d-8e7c-46bb-8bf8-dc33549060bb None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:14.619117 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4945a5a-1794-4fd7-bd60-5e07103e62f0 None admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:14.619490 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4945a5a-1794-4fd7-bd60-5e07103e62f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:14.619874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4945a5a-1794-4fd7-bd60-5e07103e62f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:14.620736 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4945a5a-1794-4fd7-bd60-5e07103e62f0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:14.622210 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4945a5a-1794-4fd7-bd60-5e07103e62f0 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:14.629103 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23ef0d-8e7c-46bb-8bf8-dc33549060bb None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:14.629687 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23ef0d-8e7c-46bb-8bf8-dc33549060bb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:14.649557 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23ef0d-8e7c-46bb-8bf8-dc33549060bb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:14.659752 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 479/963] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Jun 24 10:41:14 2022] POST /identity/v3/endpoints => generated 349 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:41:14.663948 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23ef0d-8e7c-46bb-8bf8-dc33549060bb None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:14.694127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-5a23ef0d-8e7c-46bb-8bf8-dc33549060bb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 10:41:14.694127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:14.694127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:14.694127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:14.694127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:14.694127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:14.694127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:14.694127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:14.694127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:14.694127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:14.694127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:14.694127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:14.694127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:41:14.694127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:41:14.694127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:41:14.694127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:41:14.695955 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:14.695955 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:14.695955 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:41:14.695955 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:41:14.695955 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:41:14.695955 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:41:14.695955 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:14.695955 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:14.695955 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:14.695955 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:14.695955 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:14.695955 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:14.695955 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:14.695955 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:14.695955 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:14.695955 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:14.695955 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:14.695955 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:14.697732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:14.697732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:14.697732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:41:14.697732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:41:14.697732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:41:14.697732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:41:14.697732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:41:14.697732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:41:14.697732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 10:41:14.697732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:14.701295 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 485/964] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:41:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:14.707652 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4945a5a-1794-4fd7-bd60-5e07103e62f0 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:14.782642 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:14.832522 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4945a5a-1794-4fd7-bd60-5e07103e62f0 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:14.875659 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d72f7-6419-4c73-b110-613ed688255b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:14.876355 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d72f7-6419-4c73-b110-613ed688255b None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:14.876714 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d72f7-6419-4c73-b110-613ed688255b None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:14.876886 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d72f7-6419-4c73-b110-613ed688255b None admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:14.877714 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d72f7-6419-4c73-b110-613ed688255b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:14.878039 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d72f7-6419-4c73-b110-613ed688255b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:14.879479 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d72f7-6419-4c73-b110-613ed688255b None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:14.920687 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 480/965] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 10:41:14 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:15.091611 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0dc44-22bd-455d-a3cf-4d8ae682550e None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:15.091801 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0dc44-22bd-455d-a3cf-4d8ae682550e None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:15.092077 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0dc44-22bd-455d-a3cf-4d8ae682550e None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:15.096465 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 486/966] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:41:15.102279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2521f-c93a-4a5b-8294-5f80ee4001c3 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:15.102967 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2521f-c93a-4a5b-8294-5f80ee4001c3 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:15.103499 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2521f-c93a-4a5b-8294-5f80ee4001c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:15.122313 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-17a2521f-c93a-4a5b-8294-5f80ee4001c3 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:15.123545 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-17a2521f-c93a-4a5b-8294-5f80ee4001c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:15.196090 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 481/967] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:41:15.219685 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0dc44-22bd-455d-a3cf-4d8ae682550e None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:15.249529 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:15.334632 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0dc44-22bd-455d-a3cf-4d8ae682550e None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:15.368747 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d0e6d-c374-4549-8b1a-155d414bbf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:15.369421 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d0e6d-c374-4549-8b1a-155d414bbf09 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:15.369701 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d0e6d-c374-4549-8b1a-155d414bbf09 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:15.369984 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d0e6d-c374-4549-8b1a-155d414bbf09 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:15.370696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d0e6d-c374-4549-8b1a-155d414bbf09 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:15.372114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d0e6d-c374-4549-8b1a-155d414bbf09 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:15.387637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 487/968] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jun 24 10:41:15 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:41:16.175283 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5419948-17a6-4cb0-93ed-9e4699092b15 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:16.175889 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5419948-17a6-4cb0-93ed-9e4699092b15 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:16.176069 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5419948-17a6-4cb0-93ed-9e4699092b15 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:16.177504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 482/969] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:41:16.182768 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4cb8a-c249-4150-a839-3deef97d7e21 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:16.183239 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4cb8a-c249-4150-a839-3deef97d7e21 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:16.183321 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4cb8a-c249-4150-a839-3deef97d7e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:16.200825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-a7d4cb8a-c249-4150-a839-3deef97d7e21 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:16.202311 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a7d4cb8a-c249-4150-a839-3deef97d7e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:16.283183 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 488/970] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:16 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:41:16.307768 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5419948-17a6-4cb0-93ed-9e4699092b15 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:16.362973 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:16.417800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5419948-17a6-4cb0-93ed-9e4699092b15 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:16.454260 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695fbcd-06d9-4e71-aadd-3cf0b7de618e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:16.455003 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695fbcd-06d9-4e71-aadd-3cf0b7de618e None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:16.455317 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695fbcd-06d9-4e71-aadd-3cf0b7de618e None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:16.455594 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695fbcd-06d9-4e71-aadd-3cf0b7de618e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:16.466597 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f695fbcd-06d9-4e71-aadd-3cf0b7de618e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:41:16.474774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-f695fbcd-06d9-4e71-aadd-3cf0b7de618e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 10:41:16.474774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:16.474774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:16.474774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:16.474774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:16.474774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:16.474774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:16.474774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:16.474774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:16.474774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:16.474774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:16.474774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:16.474774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:41:16.474774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:41:16.474774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:41:16.474774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:41:16.475942 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:41:16.475942 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:41:16.475942 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:41:16.475942 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:41:16.475942 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:16.475942 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:16.475942 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:16.475942 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:16.475942 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:16.475942 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:16.475942 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:16.475942 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:16.475942 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:16.475942 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:16.475942 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:16.475942 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:16.482238 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:16.482238 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:16.482238 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:16.482238 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:16.482238 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:41:16.482238 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:41:16.482238 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:41:16.482238 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:41:16.482238 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:41:16.482238 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:41:16.482238 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 10:41:16.482238 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:16.482238 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 483/971] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jun 24 10:41:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:16.483085 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4cb8a-c249-4150-a839-3deef97d7e21 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:16.495731 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:16.588015 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4cb8a-c249-4150-a839-3deef97d7e21 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:16.624251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975d5b8-ebe8-40bb-956a-93ea8052ec1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:16.624935 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975d5b8-ebe8-40bb-956a-93ea8052ec1c None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:16.625234 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975d5b8-ebe8-40bb-956a-93ea8052ec1c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:16.625506 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975d5b8-ebe8-40bb-956a-93ea8052ec1c None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:16.626251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975d5b8-ebe8-40bb-956a-93ea8052ec1c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:16.626559 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975d5b8-ebe8-40bb-956a-93ea8052ec1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:16.627963 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975d5b8-ebe8-40bb-956a-93ea8052ec1c None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:16.636884 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 489/972] 10.222.0.16 () {56 vars in 1115 bytes} [Fri Jun 24 10:41:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:41:16.642345 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695fbcd-06d9-4e71-aadd-3cf0b7de618e None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:16.747711 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695fbcd-06d9-4e71-aadd-3cf0b7de618e None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:16.757979 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:16.783899 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23ec76-138c-4363-afc5-5c399145728b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:16.784759 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23ec76-138c-4363-afc5-5c399145728b None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:16.785044 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23ec76-138c-4363-afc5-5c399145728b None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:16.785318 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23ec76-138c-4363-afc5-5c399145728b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:16.796861 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23ec76-138c-4363-afc5-5c399145728b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:16.798317 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23ec76-138c-4363-afc5-5c399145728b None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:16.803841 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364319c-0217-4a3e-bbcd-b4898e3e2bee None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:16.804141 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364319c-0217-4a3e-bbcd-b4898e3e2bee None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:16.804425 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364319c-0217-4a3e-bbcd-b4898e3e2bee None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:16.805947 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 490/973] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:41:16.810724 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87905f29-20b7-4ac5-856b-0e5303617314 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:16.811010 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87905f29-20b7-4ac5-856b-0e5303617314 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:16.811321 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87905f29-20b7-4ac5-856b-0e5303617314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:16.817509 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-3e23ec76-138c-4363-afc5-5c399145728b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:41:16.817509 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:16.817509 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:16.817509 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:16.817509 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:16.817509 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:16.817509 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:16.817509 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:16.817509 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:16.817509 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:16.817509 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:16.817509 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:16.817509 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:41:16.817509 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:41:16.817509 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:41:16.818639 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:41:16.818639 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:16.818639 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:16.818639 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:16.818639 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:16.818639 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:16.818639 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:16.818639 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:16.818639 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:16.818639 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:16.818639 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:16.818639 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:16.818639 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:16.818639 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:16.818639 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:16.818639 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:16.818639 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:16.819967 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:41:16.819967 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:41:16.819967 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:41:16.819967 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:16.825044 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 484/974] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:41:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:16.826187 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23ec76-138c-4363-afc5-5c399145728b None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:16.829297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-87905f29-20b7-4ac5-856b-0e5303617314 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:16.830464 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-87905f29-20b7-4ac5-856b-0e5303617314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:16.899699 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 491/975] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:16 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:41:16.922890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87905f29-20b7-4ac5-856b-0e5303617314 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:16.925435 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:16.938108 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23ec76-138c-4363-afc5-5c399145728b None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:16.974635 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f597840-b713-4187-aefd-39c79ac88a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:16.975345 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f597840-b713-4187-aefd-39c79ac88a77 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:16.975631 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f597840-b713-4187-aefd-39c79ac88a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:16.975904 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f597840-b713-4187-aefd-39c79ac88a77 None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:16.976629 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f597840-b713-4187-aefd-39c79ac88a77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:16.976935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f597840-b713-4187-aefd-39c79ac88a77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:16.978305 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f597840-b713-4187-aefd-39c79ac88a77 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:16.991535 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 485/976] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:16.996831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f597840-b713-4187-aefd-39c79ac88a77 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:17.025068 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:17.028942 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87905f29-20b7-4ac5-856b-0e5303617314 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:17.067548 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8b63e-ee51-411a-b4fd-15e9e8564d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:17.068672 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8b63e-ee51-411a-b4fd-15e9e8564d6e None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:17.068980 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8b63e-ee51-411a-b4fd-15e9e8564d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:17.069245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8b63e-ee51-411a-b4fd-15e9e8564d6e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:17.069905 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8b63e-ee51-411a-b4fd-15e9e8564d6e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:17.071410 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8b63e-ee51-411a-b4fd-15e9e8564d6e None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:17.083740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-91e8b63e-ee51-411a-b4fd-15e9e8564d6e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 10:41:17.083740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:17.083740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:41:17.083740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:41:17.083740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:41:17.083740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:41:17.083740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:41:17.083740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:41:17.083740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 10:41:17.083740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:17.083740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:41:17.083740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:17.083740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:17.083740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:17.083740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:17.083740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:17.083740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:17.084843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:17.084843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:17.084843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:17.084843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:17.084843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:17.084843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:17.084843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:41:17.084843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:41:17.084843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:41:17.084843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:41:17.084843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:17.084843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:17.084843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:17.084843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:17.084843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:17.084843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:17.091584 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:17.091584 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:17.091584 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:17.091584 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:17.091584 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:17.091584 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:17.091584 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:17.091584 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:17.091584 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:17.091584 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:17.091584 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:41:17.091584 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:41:17.091584 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 10:41:17.091584 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:17.091584 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 492/977] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Jun 24 10:41:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:41:17.092404 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8b63e-ee51-411a-b4fd-15e9e8564d6e None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:17.118277 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f597840-b713-4187-aefd-39c79ac88a77 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:17.153080 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2533c1d-048e-4c4e-9427-90f999926a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:17.153910 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2533c1d-048e-4c4e-9427-90f999926a6c None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:17.154195 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2533c1d-048e-4c4e-9427-90f999926a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:17.154470 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2533c1d-048e-4c4e-9427-90f999926a6c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:17.158920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:17.161969 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2533c1d-048e-4c4e-9427-90f999926a6c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:17.163457 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2533c1d-048e-4c4e-9427-90f999926a6c None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:17.179048 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-e2533c1d-048e-4c4e-9427-90f999926a6c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 10:41:17.179048 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:17.179048 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:17.179048 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:17.179048 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:17.179048 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:17.179048 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:17.179048 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:17.179048 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:17.179048 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:17.179048 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:17.179048 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:17.179048 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:41:17.179048 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:41:17.179048 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:41:17.179048 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:41:17.180698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:17.180698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:17.180698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:41:17.180698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:41:17.180698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:41:17.180698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:41:17.180698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:17.180698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:17.180698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:17.180698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:17.180698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:17.180698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:17.180698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:17.180698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:17.180698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:17.180698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:17.180698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:17.180698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:17.181681 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:17.181681 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:17.181681 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:41:17.181681 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:41:17.181681 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:41:17.181681 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:41:17.181681 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:41:17.181681 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:41:17.181681 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 10:41:17.181681 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:17.181681 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 486/978] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jun 24 10:41:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:41:17.186067 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2533c1d-048e-4c4e-9427-90f999926a6c None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:17.200680 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8b63e-ee51-411a-b4fd-15e9e8564d6e None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:17.236921 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fa6cd-d728-49ea-ab96-cb5a58ad7c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:17.237683 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fa6cd-d728-49ea-ab96-cb5a58ad7c28 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:17.238039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fa6cd-d728-49ea-ab96-cb5a58ad7c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:17.238385 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fa6cd-d728-49ea-ab96-cb5a58ad7c28 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:17.239189 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955fa6cd-d728-49ea-ab96-cb5a58ad7c28 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:17.239656 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955fa6cd-d728-49ea-ab96-cb5a58ad7c28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:17.241129 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955fa6cd-d728-49ea-ab96-cb5a58ad7c28 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:17.246245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 493/979] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jun 24 10:41:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:17.251750 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fa6cd-d728-49ea-ab96-cb5a58ad7c28 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:17.273464 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:17.300862 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2533c1d-048e-4c4e-9427-90f999926a6c None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:17.339286 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfab65-e11c-4204-abdb-ba2db294059e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:17.339974 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfab65-e11c-4204-abdb-ba2db294059e None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:17.340261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfab65-e11c-4204-abdb-ba2db294059e None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:17.340545 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfab65-e11c-4204-abdb-ba2db294059e None admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:17.341400 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dfab65-e11c-4204-abdb-ba2db294059e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:17.341711 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dfab65-e11c-4204-abdb-ba2db294059e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:17.343178 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dfab65-e11c-4204-abdb-ba2db294059e None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:17.367075 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fa6cd-d728-49ea-ab96-cb5a58ad7c28 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:17.367350 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 487/980] 10.222.0.16 () {56 vars in 1149 bytes} [Fri Jun 24 10:41:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:41:17.372615 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfab65-e11c-4204-abdb-ba2db294059e None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:17.400433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:17.408471 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b51d7-2c1d-437d-a1a9-663a0724b806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:17.409156 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b51d7-2c1d-437d-a1a9-663a0724b806 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:17.409440 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b51d7-2c1d-437d-a1a9-663a0724b806 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:17.409718 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b51d7-2c1d-437d-a1a9-663a0724b806 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:17.410443 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b51d7-2c1d-437d-a1a9-663a0724b806 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:17.410754 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b51d7-2c1d-437d-a1a9-663a0724b806 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:17.412486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b51d7-2c1d-437d-a1a9-663a0724b806 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:17.417525 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 494/981] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jun 24 10:41:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:41:17.418807 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe1980-7d84-494a-bf26-ea994d07023c None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:17.419100 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe1980-7d84-494a-bf26-ea994d07023c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:17.419418 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe1980-7d84-494a-bf26-ea994d07023c None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:17.420771 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 495/982] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:41:17.423447 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe1980-7d84-494a-bf26-ea994d07023c None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:17.478036 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfab65-e11c-4204-abdb-ba2db294059e None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:17.510620 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450031a-b197-404a-954f-9c1e25d51f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:17.511307 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450031a-b197-404a-954f-9c1e25d51f6b None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:17.511591 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450031a-b197-404a-954f-9c1e25d51f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:17.511867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450031a-b197-404a-954f-9c1e25d51f6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:17.520380 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe1980-7d84-494a-bf26-ea994d07023c None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:17.522288 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:17.554385 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18b5fc-5467-49f1-8e77-a12e506b0290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:17.554972 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18b5fc-5467-49f1-8e77-a12e506b0290 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:17.555289 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18b5fc-5467-49f1-8e77-a12e506b0290 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:17.555569 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18b5fc-5467-49f1-8e77-a12e506b0290 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:17.556353 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18b5fc-5467-49f1-8e77-a12e506b0290 None admin] RBAC: Adding query filter params (interface=admin, service_id=95ec96bceb2d432c8676b1cdfba34b55, region_id=RegionOne) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:17.556673 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18b5fc-5467-49f1-8e77-a12e506b0290 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:17.558040 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18b5fc-5467-49f1-8e77-a12e506b0290 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:17.567292 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 496/983] 10.222.0.16 () {56 vars in 1249 bytes} [Fri Jun 24 10:41:17 2022] GET /identity/v3/endpoints?service_id=95ec96bceb2d432c8676b1cdfba34b55&interface=admin®ion_id=RegionOne => generated 193 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:17.567292 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a36501-8f7f-41a1-b066-9a52fc819d49 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:17.567292 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a36501-8f7f-41a1-b066-9a52fc819d49 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:17.567292 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a36501-8f7f-41a1-b066-9a52fc819d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:17.582218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450031a-b197-404a-954f-9c1e25d51f6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:17.583591 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-d7a36501-8f7f-41a1-b066-9a52fc819d49 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:17.583728 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450031a-b197-404a-954f-9c1e25d51f6b None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:17.584803 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-d7a36501-8f7f-41a1-b066-9a52fc819d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:17.644680 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:17.664990 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 497/984] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:17 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:41:17.665950 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a36501-8f7f-41a1-b066-9a52fc819d49 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:17.690544 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 488/985] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:41:17 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 10:41:17.691517 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450031a-b197-404a-954f-9c1e25d51f6b None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:17.732756 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:17.777568 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a36501-8f7f-41a1-b066-9a52fc819d49 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:17.794693 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450031a-b197-404a-954f-9c1e25d51f6b None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:17.820137 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982df23-0aec-4276-b8b5-01e217a1b618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:17.820764 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982df23-0aec-4276-b8b5-01e217a1b618 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:17.821023 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982df23-0aec-4276-b8b5-01e217a1b618 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:17.821323 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982df23-0aec-4276-b8b5-01e217a1b618 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:17.822008 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982df23-0aec-4276-b8b5-01e217a1b618 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:17.823432 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982df23-0aec-4276-b8b5-01e217a1b618 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:17.843185 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 498/986] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Jun 24 10:41:17 2022] GET /identity/v3/services => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:41:17.843424 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95365fe3-db80-48bf-8f94-894b48970635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:17.843572 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982df23-0aec-4276-b8b5-01e217a1b618 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:17.843650 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95365fe3-db80-48bf-8f94-894b48970635 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:17.843650 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95365fe3-db80-48bf-8f94-894b48970635 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:17.843650 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95365fe3-db80-48bf-8f94-894b48970635 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:17.843650 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95365fe3-db80-48bf-8f94-894b48970635 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:17.843650 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95365fe3-db80-48bf-8f94-894b48970635 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:17.848935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-95365fe3-db80-48bf-8f94-894b48970635 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 10:41:17.848935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:17.848935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:41:17.848935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:41:17.848935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:41:17.848935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:41:17.848935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:41:17.848935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:41:17.848935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 10:41:17.848935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:17.848935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:41:17.848935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:17.848935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:17.848935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:17.848935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:17.848935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:17.848935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:17.850154 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:17.850154 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:17.850154 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:17.850154 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:17.850154 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:17.850154 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:17.850154 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:41:17.850154 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:41:17.850154 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:41:17.850154 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:41:17.850154 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:17.850154 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:17.850154 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:17.850154 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:17.850154 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:17.850154 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:17.851041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:17.851041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:17.851041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:17.851041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:17.851041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:17.851041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:17.851041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:17.851041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:17.851041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:17.851041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:17.851041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:41:17.851041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:41:17.851041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 10:41:17.851041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:17.855577 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 489/987] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:41:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:17.857145 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95365fe3-db80-48bf-8f94-894b48970635 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:17.910560 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:17.964735 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982df23-0aec-4276-b8b5-01e217a1b618 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:17.990154 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95365fe3-db80-48bf-8f94-894b48970635 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:17.994298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:18.012717 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a538bf-a888-418f-b0f8-d64b4a6d93b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:18.013924 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a538bf-a888-418f-b0f8-d64b4a6d93b1 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:18.014424 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a538bf-a888-418f-b0f8-d64b4a6d93b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:18.014876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a538bf-a888-418f-b0f8-d64b4a6d93b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:18.028497 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a538bf-a888-418f-b0f8-d64b4a6d93b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:18.030605 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a538bf-a888-418f-b0f8-d64b4a6d93b1 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:18.036427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed950a4-afb8-4d95-bd77-d4957364d40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:18.037262 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed950a4-afb8-4d95-bd77-d4957364d40c None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:18.037696 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed950a4-afb8-4d95-bd77-d4957364d40c None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:18.038156 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed950a4-afb8-4d95-bd77-d4957364d40c None admin] PATH_INFO: `/v3/services` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:18.038882 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed950a4-afb8-4d95-bd77-d4957364d40c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:18.039374 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed950a4-afb8-4d95-bd77-d4957364d40c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:18.040761 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed950a4-afb8-4d95-bd77-d4957364d40c None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:18.046747 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 490/988] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jun 24 10:41:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:18.052498 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-b6a538bf-a888-418f-b0f8-d64b4a6d93b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:41:18.052498 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:18.052498 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:18.052498 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:18.052498 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:18.052498 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:18.052498 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:18.052498 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:18.052498 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:18.052498 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:18.052498 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:18.052498 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:18.052498 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:41:18.052498 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:41:18.052498 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:41:18.053470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:41:18.053470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:18.053470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:18.053470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:18.053470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:18.053470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:18.053470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:18.053470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:18.053470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:18.053470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:18.053470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:18.053470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:18.053470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:18.053470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:18.053470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:18.053470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:18.053470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:18.054388 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:41:18.054388 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:41:18.054388 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:41:18.054388 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:18.055057 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed950a4-afb8-4d95-bd77-d4957364d40c None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:18.055134 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 499/989] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:41:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:18.061006 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a538bf-a888-418f-b0f8-d64b4a6d93b1 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:18.176281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed950a4-afb8-4d95-bd77-d4957364d40c None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:18.193879 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a538bf-a888-418f-b0f8-d64b4a6d93b1 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:18.196968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:18.222561 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6d2fe-8887-4576-b6f8-d0e0e7f28718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:18.223660 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6d2fe-8887-4576-b6f8-d0e0e7f28718 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:18.224244 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6d2fe-8887-4576-b6f8-d0e0e7f28718 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:18.224697 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6d2fe-8887-4576-b6f8-d0e0e7f28718 None admin] PATH_INFO: `/v3/services` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:18.226201 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6d2fe-8887-4576-b6f8-d0e0e7f28718 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:18.226710 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6d2fe-8887-4576-b6f8-d0e0e7f28718 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:18.229259 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6d2fe-8887-4576-b6f8-d0e0e7f28718 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:18.234165 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9148858-b9cd-4ba6-a974-34224e5b78c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:18.234840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9148858-b9cd-4ba6-a974-34224e5b78c6 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:18.235119 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9148858-b9cd-4ba6-a974-34224e5b78c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:18.235641 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9148858-b9cd-4ba6-a974-34224e5b78c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:18.235745 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 491/990] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jun 24 10:41:18 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:18.236148 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9148858-b9cd-4ba6-a974-34224e5b78c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:18.236452 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9148858-b9cd-4ba6-a974-34224e5b78c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:18.238047 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9148858-b9cd-4ba6-a974-34224e5b78c6 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:18.242192 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6d2fe-8887-4576-b6f8-d0e0e7f28718 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:18.256135 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 500/991] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:18.257302 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9148858-b9cd-4ba6-a974-34224e5b78c6 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:18.292427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:18.375515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6d2fe-8887-4576-b6f8-d0e0e7f28718 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:18.376868 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9148858-b9cd-4ba6-a974-34224e5b78c6 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:18.411827 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b62e18-f13c-4688-a036-63d141d1d8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:18.412668 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b62e18-f13c-4688-a036-63d141d1d8ea None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:18.412953 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b62e18-f13c-4688-a036-63d141d1d8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:18.413222 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b62e18-f13c-4688-a036-63d141d1d8ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:18.414660 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6bf21-4ab6-4e37-bbe2-dfc47375d89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:18.415912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6bf21-4ab6-4e37-bbe2-dfc47375d89f None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:18.416296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6bf21-4ab6-4e37-bbe2-dfc47375d89f None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:18.416594 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6bf21-4ab6-4e37-bbe2-dfc47375d89f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:18.417411 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6bf21-4ab6-4e37-bbe2-dfc47375d89f None admin] RBAC: Adding query filter params (interface=public, service_id=5b74746e43b34ae3b6a9df5b637f2f2f, region_id=RegionOne) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:18.417728 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6bf21-4ab6-4e37-bbe2-dfc47375d89f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:18.419117 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6bf21-4ab6-4e37-bbe2-dfc47375d89f None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:18.420338 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b62e18-f13c-4688-a036-63d141d1d8ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:18.421778 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b62e18-f13c-4688-a036-63d141d1d8ea None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:18.425180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 492/992] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Jun 24 10:41:18 2022] GET /identity/v3/endpoints?service_id=5b74746e43b34ae3b6a9df5b637f2f2f&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:41:18.430739 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6bf21-4ab6-4e37-bbe2-dfc47375d89f None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:18.437225 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-37b62e18-f13c-4688-a036-63d141d1d8ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:41:18.437225 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:18.437225 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:18.437225 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:18.437225 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:18.437225 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:18.437225 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:18.437225 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:18.437225 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:18.437225 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:18.437225 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:18.437225 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:18.437225 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:41:18.437225 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:41:18.437225 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:41:18.438156 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:41:18.438156 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:18.438156 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:18.438156 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:18.438156 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:18.438156 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:18.438156 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:18.438156 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:18.438156 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:18.438156 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:18.438156 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:18.438156 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:18.438156 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:18.438156 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:18.438156 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:18.438156 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:18.438156 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:18.439045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:41:18.439045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:41:18.439045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:41:18.439045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:41:18.439045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:41:18.439045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:41:18.439045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:41:18.439045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:18.443274 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 501/993] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:41:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:18.444371 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b62e18-f13c-4688-a036-63d141d1d8ea None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:18.472557 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:18.548287 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:18.557472 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6bf21-4ab6-4e37-bbe2-dfc47375d89f None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:18.560858 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b62e18-f13c-4688-a036-63d141d1d8ea None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:18.603029 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6258b-2f6d-4f01-bd76-5b905fd58e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:18.603766 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6258b-2f6d-4f01-bd76-5b905fd58e8b None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:18.604103 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6258b-2f6d-4f01-bd76-5b905fd58e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:18.604605 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6258b-2f6d-4f01-bd76-5b905fd58e8b None admin] PATH_INFO: `/v3/services` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:18.605375 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d6258b-2f6d-4f01-bd76-5b905fd58e8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:18.606832 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d6258b-2f6d-4f01-bd76-5b905fd58e8b None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:18.611678 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7013283-51f0-4c7d-b6ce-29d656b84611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:18.612466 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7013283-51f0-4c7d-b6ce-29d656b84611 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:18.612841 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7013283-51f0-4c7d-b6ce-29d656b84611 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:18.613207 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7013283-51f0-4c7d-b6ce-29d656b84611 None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:18.613832 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 493/994] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Jun 24 10:41:18 2022] GET /identity/v3/services => generated 1727 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:41:18.614604 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7013283-51f0-4c7d-b6ce-29d656b84611 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:18.615297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7013283-51f0-4c7d-b6ce-29d656b84611 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:18.617358 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7013283-51f0-4c7d-b6ce-29d656b84611 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:18.640597 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 502/995] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:41:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:18.642455 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6258b-2f6d-4f01-bd76-5b905fd58e8b None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:18.772294 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6258b-2f6d-4f01-bd76-5b905fd58e8b None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:18.809891 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364dc737-24a4-4385-a2b4-769b4022bde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:18.810568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dc737-24a4-4385-a2b4-769b4022bde7 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:18.810859 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dc737-24a4-4385-a2b4-769b4022bde7 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:18.811140 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dc737-24a4-4385-a2b4-769b4022bde7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:18.812373 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364dc737-24a4-4385-a2b4-769b4022bde7 None admin] RBAC: Adding query filter params (role.id=1ecedc947e994590ae954b1a812c3208, scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user.id=4dfddd72dfa84ce39fe62112224b425d) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:18.812690 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364dc737-24a4-4385-a2b4-769b4022bde7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:18.814135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364dc737-24a4-4385-a2b4-769b4022bde7 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:18.821670 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 494/996] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:41:18 2022] GET /identity/v3/role_assignments?user.id=4dfddd72dfa84ce39fe62112224b425d&scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e&role.id=1ecedc947e994590ae954b1a812c3208 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:19.903783 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e762fc-097d-4272-9ccb-e62ddb961128 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:19.904324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e762fc-097d-4272-9ccb-e62ddb961128 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:19.904324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e762fc-097d-4272-9ccb-e62ddb961128 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:19.905834 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 503/997] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:41:19.911018 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669791b-20ce-40a9-95e9-2852fa72ffaa None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:19.911499 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669791b-20ce-40a9-95e9-2852fa72ffaa None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:19.911725 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669791b-20ce-40a9-95e9-2852fa72ffaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:19.932020 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-9669791b-20ce-40a9-95e9-2852fa72ffaa None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:19.933208 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-9669791b-20ce-40a9-95e9-2852fa72ffaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:19.953846 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:20.008146 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 495/998] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:19 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:41:20.031180 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e762fc-097d-4272-9ccb-e62ddb961128 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:20.123991 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:20.142045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e762fc-097d-4272-9ccb-e62ddb961128 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:20.175840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5467e0e-b508-43a8-84a7-682e01783fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:20.176589 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5467e0e-b508-43a8-84a7-682e01783fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:20.177053 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5467e0e-b508-43a8-84a7-682e01783fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:20.177379 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5467e0e-b508-43a8-84a7-682e01783fb7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:20.178186 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5467e0e-b508-43a8-84a7-682e01783fb7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:20.179645 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5467e0e-b508-43a8-84a7-682e01783fb7 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:20.192459 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-f5467e0e-b508-43a8-84a7-682e01783fb7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 10:41:20.192459 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:20.192459 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:41:20.192459 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:41:20.192459 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:41:20.192459 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:41:20.192459 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:41:20.192459 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:41:20.192459 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 10:41:20.192459 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:20.192459 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:41:20.192459 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:20.192459 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:20.192459 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:20.192459 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:20.192459 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:20.192459 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:20.199536 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:20.199536 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:20.199536 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:20.199536 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:20.199536 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:20.199536 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:20.199536 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:41:20.199536 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:41:20.199536 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:41:20.199536 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:41:20.199536 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:20.199536 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:20.199536 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:20.199536 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:20.199536 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:20.199536 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:20.200470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:20.200470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:20.200470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:20.200470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:20.200470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:20.200470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:20.200470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:20.200470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:20.200470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:20.200470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:20.200470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:41:20.200470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:41:20.200470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 10:41:20.200470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:20.200470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 504/999] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Jun 24 10:41:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:20.203739 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669791b-20ce-40a9-95e9-2852fa72ffaa None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:20.317280 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669791b-20ce-40a9-95e9-2852fa72ffaa None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:20.359593 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6240b9-b6f1-4062-bb06-74dfc9fd65d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:20.360268 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6240b9-b6f1-4062-bb06-74dfc9fd65d1 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:20.360552 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6240b9-b6f1-4062-bb06-74dfc9fd65d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:20.360824 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6240b9-b6f1-4062-bb06-74dfc9fd65d1 None admin] PATH_INFO: `/v3/services` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:20.361535 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6240b9-b6f1-4062-bb06-74dfc9fd65d1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:20.361839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6240b9-b6f1-4062-bb06-74dfc9fd65d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:20.363257 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6240b9-b6f1-4062-bb06-74dfc9fd65d1 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:20.369353 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 496/1000] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jun 24 10:41:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:20.374934 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5467e0e-b508-43a8-84a7-682e01783fb7 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:20.495408 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5467e0e-b508-43a8-84a7-682e01783fb7 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:20.531069 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136484ef-3b7e-4ac8-8a95-8fbb81f3af85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:20.531774 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136484ef-3b7e-4ac8-8a95-8fbb81f3af85 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:20.532057 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136484ef-3b7e-4ac8-8a95-8fbb81f3af85 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:20.532313 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136484ef-3b7e-4ac8-8a95-8fbb81f3af85 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:20.533101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136484ef-3b7e-4ac8-8a95-8fbb81f3af85 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:20.533413 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136484ef-3b7e-4ac8-8a95-8fbb81f3af85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:20.534894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136484ef-3b7e-4ac8-8a95-8fbb81f3af85 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:20.540437 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 505/1001] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jun 24 10:41:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:20.545978 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6240b9-b6f1-4062-bb06-74dfc9fd65d1 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:20.566412 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:20.662536 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cceb6f6-742a-4c03-a0bf-6d6d2fc82231 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:20.662836 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cceb6f6-742a-4c03-a0bf-6d6d2fc82231 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:20.663119 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cceb6f6-742a-4c03-a0bf-6d6d2fc82231 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:20.663793 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6240b9-b6f1-4062-bb06-74dfc9fd65d1 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:20.664695 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 506/1002] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:41:20.669768 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33b935-1e24-4aab-92fd-d3ffb8f56d21 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:20.670062 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33b935-1e24-4aab-92fd-d3ffb8f56d21 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:20.670343 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33b935-1e24-4aab-92fd-d3ffb8f56d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:20.688067 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-9c33b935-1e24-4aab-92fd-d3ffb8f56d21 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:20.689262 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9c33b935-1e24-4aab-92fd-d3ffb8f56d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:20.698148 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:20.704234 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023f41b-e719-4491-a9ef-c05bab013293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:20.704921 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023f41b-e719-4491-a9ef-c05bab013293 None admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:20.705211 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023f41b-e719-4491-a9ef-c05bab013293 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:20.705515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023f41b-e719-4491-a9ef-c05bab013293 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:20.706337 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023f41b-e719-4491-a9ef-c05bab013293 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:20.707750 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023f41b-e719-4491-a9ef-c05bab013293 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:20.724335 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 497/1003] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Jun 24 10:41:20 2022] POST /identity/v3/endpoints => generated 325 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:41:20.776372 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 507/1004] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:20 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:41:20.799865 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023f41b-e719-4491-a9ef-c05bab013293 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:20.871806 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b721d-2159-42d5-9054-95a1b4ebd28f None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:20.872353 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b721d-2159-42d5-9054-95a1b4ebd28f None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:20.872647 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b721d-2159-42d5-9054-95a1b4ebd28f None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:20.874048 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 508/1005] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:41:20.879318 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17027a6c-0d5c-44d1-bb87-7057c7f0f140 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:20.879829 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17027a6c-0d5c-44d1-bb87-7057c7f0f140 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:20.880989 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17027a6c-0d5c-44d1-bb87-7057c7f0f140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:20.892543 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:20.901631 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-17027a6c-0d5c-44d1-bb87-7057c7f0f140 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:20.902701 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-17027a6c-0d5c-44d1-bb87-7057c7f0f140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:20.918020 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023f41b-e719-4491-a9ef-c05bab013293 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:20.956691 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124cf8e-b931-4d35-84c3-82000a2d29b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:20.957512 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124cf8e-b931-4d35-84c3-82000a2d29b3 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:20.957799 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124cf8e-b931-4d35-84c3-82000a2d29b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:20.958254 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124cf8e-b931-4d35-84c3-82000a2d29b3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:20.959303 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124cf8e-b931-4d35-84c3-82000a2d29b3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:20.960683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124cf8e-b931-4d35-84c3-82000a2d29b3 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:20.972920 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-1124cf8e-b931-4d35-84c3-82000a2d29b3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 10:41:20.972920 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:20.972920 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:41:20.972920 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:41:20.972920 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:41:20.972920 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:41:20.972920 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:41:20.972920 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:41:20.972920 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 10:41:20.972920 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:20.972920 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:41:20.972920 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:20.972920 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:20.972920 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:20.972920 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:20.972920 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:20.972920 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:20.974015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:20.974015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:20.974015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:20.974015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:20.974015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:20.974015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:20.974015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:41:20.974015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:41:20.974015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:41:20.974015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:41:20.974015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:20.974015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:20.974015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:20.974015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:20.974015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:20.974015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:20.980079 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:20.980079 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:20.980079 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:20.980079 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:20.980079 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:20.980079 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:20.980079 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:20.980079 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:20.980079 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:20.980079 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:20.980079 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:41:20.980079 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:41:20.980079 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 10:41:20.980079 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:20.980079 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 498/1006] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:41:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:20.980926 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 509/1007] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:20 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:41:20.982752 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124cf8e-b931-4d35-84c3-82000a2d29b3 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:20.995580 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17027a6c-0d5c-44d1-bb87-7057c7f0f140 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:21.070521 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:21.094580 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124cf8e-b931-4d35-84c3-82000a2d29b3 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:21.108308 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17027a6c-0d5c-44d1-bb87-7057c7f0f140 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:21.136636 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e0908-8566-4294-a972-7373b240d40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:21.137343 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e0908-8566-4294-a972-7373b240d40d None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:21.137633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e0908-8566-4294-a972-7373b240d40d None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:21.137935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e0908-8566-4294-a972-7373b240d40d None admin] PATH_INFO: `/v3/services` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:21.138772 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e0908-8566-4294-a972-7373b240d40d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:21.138947 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e0908-8566-4294-a972-7373b240d40d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:21.140345 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e0908-8566-4294-a972-7373b240d40d None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:21.145568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 499/1008] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jun 24 10:41:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:21.147746 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f49c6-41b9-4a80-bde8-8f5721b869d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:21.148552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f49c6-41b9-4a80-bde8-8f5721b869d0 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:21.148831 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f49c6-41b9-4a80-bde8-8f5721b869d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:21.149101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f49c6-41b9-4a80-bde8-8f5721b869d0 None admin] PATH_INFO: `/v3/services/image` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:21.149803 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f49c6-41b9-4a80-bde8-8f5721b869d0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:21.151045 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e0908-8566-4294-a972-7373b240d40d None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:21.151468 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f49c6-41b9-4a80-bde8-8f5721b869d0 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:21.160860 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:21.163997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-b19f49c6-41b9-4a80-bde8-8f5721b869d0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 10:41:21.163997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:21.163997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:41:21.163997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:41:21.163997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:41:21.163997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:41:21.163997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:41:21.163997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:41:21.163997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 10:41:21.163997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:21.163997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:41:21.163997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:21.163997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:21.163997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:21.163997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:21.163997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:21.163997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:21.165073 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:21.165073 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:21.165073 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:21.165073 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:21.165073 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:21.165073 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:21.165073 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:41:21.165073 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:41:21.165073 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:41:21.165073 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:41:21.165073 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:21.165073 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:21.165073 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:21.165073 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:21.165073 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:21.165073 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:21.166023 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:21.166023 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:21.166023 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:21.166023 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:21.166023 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:21.166023 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:21.166023 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:21.166023 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:21.166023 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:21.166023 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:21.166023 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:41:21.166023 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:41:21.166023 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 10:41:21.166023 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:21.170096 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 510/1009] 10.222.0.16 () {56 vars in 1105 bytes} [Fri Jun 24 10:41:20 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:41:21.170915 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f49c6-41b9-4a80-bde8-8f5721b869d0 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:21.262331 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e0908-8566-4294-a972-7373b240d40d None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:21.277203 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f49c6-41b9-4a80-bde8-8f5721b869d0 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:21.299331 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5676d-30d1-45e1-a0c1-587c0e05a968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:21.300020 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5676d-30d1-45e1-a0c1-587c0e05a968 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:21.300306 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5676d-30d1-45e1-a0c1-587c0e05a968 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:21.300582 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5676d-30d1-45e1-a0c1-587c0e05a968 None admin] PATH_INFO: `/v3/services` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:21.301297 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5676d-30d1-45e1-a0c1-587c0e05a968 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:21.301609 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5676d-30d1-45e1-a0c1-587c0e05a968 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:21.303196 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5676d-30d1-45e1-a0c1-587c0e05a968 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:21.308527 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 500/1010] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jun 24 10:41:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:21.309860 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:21.314727 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5676d-30d1-45e1-a0c1-587c0e05a968 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:21.316137 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce64d2d-8974-4ca6-a382-25f31349a7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:21.316811 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce64d2d-8974-4ca6-a382-25f31349a7de None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:21.317089 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce64d2d-8974-4ca6-a382-25f31349a7de None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:21.317676 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce64d2d-8974-4ca6-a382-25f31349a7de None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:21.318394 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce64d2d-8974-4ca6-a382-25f31349a7de None admin] RBAC: Adding query filter params (name=image) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:21.318703 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce64d2d-8974-4ca6-a382-25f31349a7de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:21.320113 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce64d2d-8974-4ca6-a382-25f31349a7de None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:21.325359 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 511/1011] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:41:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:21.330520 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce64d2d-8974-4ca6-a382-25f31349a7de None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:21.387200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:21.421993 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5676d-30d1-45e1-a0c1-587c0e05a968 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:21.435549 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce64d2d-8974-4ca6-a382-25f31349a7de None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:21.457040 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416f6dd-153b-463c-a0f6-68d863c3d52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:21.457714 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416f6dd-153b-463c-a0f6-68d863c3d52d None admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:21.458073 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416f6dd-153b-463c-a0f6-68d863c3d52d None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:21.458422 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416f6dd-153b-463c-a0f6-68d863c3d52d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:21.459414 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416f6dd-153b-463c-a0f6-68d863c3d52d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:21.461044 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416f6dd-153b-463c-a0f6-68d863c3d52d None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:21.470960 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4181a28-7e1e-406d-aaaf-5c394ba3b132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:21.471667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4181a28-7e1e-406d-aaaf-5c394ba3b132 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:21.471952 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4181a28-7e1e-406d-aaaf-5c394ba3b132 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:21.472227 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4181a28-7e1e-406d-aaaf-5c394ba3b132 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:21.472942 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4181a28-7e1e-406d-aaaf-5c394ba3b132 None admin] RBAC: Adding query filter params (type=image) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:21.473254 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4181a28-7e1e-406d-aaaf-5c394ba3b132 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:21.474820 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4181a28-7e1e-406d-aaaf-5c394ba3b132 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:21.479468 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 512/1012] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:41:21 2022] GET /identity/v3/services?type=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:41:21.481934 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 501/1013] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Jun 24 10:41:21 2022] POST /identity/v3/endpoints => generated 334 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:41:22.772993 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af21d1-91b0-41bf-9565-341fe26938a0 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:22.773560 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af21d1-91b0-41bf-9565-341fe26938a0 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:22.773560 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af21d1-91b0-41bf-9565-341fe26938a0 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:22.775081 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 513/1014] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:41:22.780449 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf908489-984f-4be5-b502-76f8dc65574f None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:22.780855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf908489-984f-4be5-b502-76f8dc65574f None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:22.781041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf908489-984f-4be5-b502-76f8dc65574f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:22.798887 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-bf908489-984f-4be5-b502-76f8dc65574f None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:22.800099 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-bf908489-984f-4be5-b502-76f8dc65574f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:22.876536 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 502/1015] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:22 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:41:22.900058 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af21d1-91b0-41bf-9565-341fe26938a0 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:22.963212 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:23.007090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af21d1-91b0-41bf-9565-341fe26938a0 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:23.041208 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51785116-61a8-4a3e-9766-3c68456b02ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:23.042014 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51785116-61a8-4a3e-9766-3c68456b02ce None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:23.042297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51785116-61a8-4a3e-9766-3c68456b02ce None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:23.042575 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51785116-61a8-4a3e-9766-3c68456b02ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:23.043769 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51785116-61a8-4a3e-9766-3c68456b02ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:23.045215 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51785116-61a8-4a3e-9766-3c68456b02ce None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:23.047011 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 514/1016] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:41:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:23.052995 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf908489-984f-4be5-b502-76f8dc65574f None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:23.106999 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:23.158279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf908489-984f-4be5-b502-76f8dc65574f None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:23.194851 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee84e7b-5bdd-4c94-9fa9-20740bfb1ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:23.195553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee84e7b-5bdd-4c94-9fa9-20740bfb1ff5 None admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:23.195838 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee84e7b-5bdd-4c94-9fa9-20740bfb1ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:23.196112 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee84e7b-5bdd-4c94-9fa9-20740bfb1ff5 None admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:23.196834 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee84e7b-5bdd-4c94-9fa9-20740bfb1ff5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:23.198267 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee84e7b-5bdd-4c94-9fa9-20740bfb1ff5 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:23.226879 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 503/1017] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jun 24 10:41:23 2022] POST /identity/v3/projects => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:41:23.521681 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31507d12-1e78-4338-a6d0-cc03cd4c7777 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:23.521892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31507d12-1e78-4338-a6d0-cc03cd4c7777 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:23.522174 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31507d12-1e78-4338-a6d0-cc03cd4c7777 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:23.523766 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 515/1018] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:41:23.529138 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee941e38-9d2e-4323-8392-0c9f60905005 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:23.529535 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee941e38-9d2e-4323-8392-0c9f60905005 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:23.529885 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee941e38-9d2e-4323-8392-0c9f60905005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:23.547682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-ee941e38-9d2e-4323-8392-0c9f60905005 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:23.548886 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-ee941e38-9d2e-4323-8392-0c9f60905005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:23.625901 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bac72-fa98-4781-a879-0aedada1e2b7 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:23.626251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bac72-fa98-4781-a879-0aedada1e2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:23.626429 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bac72-fa98-4781-a879-0aedada1e2b7 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:23.626644 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 504/1019] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:23 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:41:23.628015 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 516/1020] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:41:23.633079 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfee1d6-1240-4f9a-ac61-452c1a424f34 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:23.633370 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfee1d6-1240-4f9a-ac61-452c1a424f34 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:23.633644 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfee1d6-1240-4f9a-ac61-452c1a424f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:23.642329 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58bac72-fa98-4781-a879-0aedada1e2b7 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:23.652644 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-2cfee1d6-1240-4f9a-ac61-452c1a424f34 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:23.653846 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-2cfee1d6-1240-4f9a-ac61-452c1a424f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:23.684326 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:23.729526 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 505/1021] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:23 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:41:23.752538 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfee1d6-1240-4f9a-ac61-452c1a424f34 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:23.757992 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58bac72-fa98-4781-a879-0aedada1e2b7 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:23.788681 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:23.797777 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc2d42-8391-467d-b09d-cbe8fb8c4d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:23.798457 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc2d42-8391-467d-b09d-cbe8fb8c4d4b None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:23.798749 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc2d42-8391-467d-b09d-cbe8fb8c4d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:23.799057 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc2d42-8391-467d-b09d-cbe8fb8c4d4b None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:23.799833 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc2d42-8391-467d-b09d-cbe8fb8c4d4b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:23.801203 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc2d42-8391-467d-b09d-cbe8fb8c4d4b None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:23.820028 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 517/1022] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jun 24 10:41:23 2022] POST /identity/v3/services => generated 242 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:41:23.870401 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfee1d6-1240-4f9a-ac61-452c1a424f34 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:23.924485 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b579932-09a3-4d4a-ba41-006aeb68c640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:23.925384 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b579932-09a3-4d4a-ba41-006aeb68c640 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:23.925656 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b579932-09a3-4d4a-ba41-006aeb68c640 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:23.925960 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b579932-09a3-4d4a-ba41-006aeb68c640 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:23.938750 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b579932-09a3-4d4a-ba41-006aeb68c640 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:41:23.947382 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-7b579932-09a3-4d4a-ba41-006aeb68c640 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 10:41:23.947382 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:23.947382 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:23.947382 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:23.947382 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:23.947382 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:23.947382 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:23.947382 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:23.947382 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:23.947382 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:23.947382 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:23.947382 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:23.947382 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:41:23.947382 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:41:23.947382 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:41:23.947382 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:41:23.948409 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:41:23.948409 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:41:23.948409 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:41:23.948409 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:41:23.948409 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:23.948409 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:23.948409 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:23.948409 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:23.948409 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:23.948409 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:23.948409 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:23.948409 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:23.948409 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:23.948409 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:23.948409 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:23.948409 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:23.949287 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:23.949287 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:23.949287 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:23.949287 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:23.949287 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:41:23.949287 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:41:23.949287 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:41:23.949287 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:41:23.949287 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:41:23.949287 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:41:23.949287 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 10:41:23.949287 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:23.951545 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 506/1023] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jun 24 10:41:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:23.954745 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc2d42-8391-467d-b09d-cbe8fb8c4d4b None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:24.063834 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc2d42-8391-467d-b09d-cbe8fb8c4d4b None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:24.100199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0eafa9-b675-464e-9be2-12a8202c2bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:24.100877 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0eafa9-b675-464e-9be2-12a8202c2bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:24.101160 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0eafa9-b675-464e-9be2-12a8202c2bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:24.101434 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0eafa9-b675-464e-9be2-12a8202c2bb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:24.102183 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0eafa9-b675-464e-9be2-12a8202c2bb8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:24.102490 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0eafa9-b675-464e-9be2-12a8202c2bb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:24.103887 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0eafa9-b675-464e-9be2-12a8202c2bb8 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:24.112372 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 518/1024] 10.222.0.16 () {56 vars in 1115 bytes} [Fri Jun 24 10:41:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:24.118520 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b579932-09a3-4d4a-ba41-006aeb68c640 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:24.142238 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:24.229243 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b579932-09a3-4d4a-ba41-006aeb68c640 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:24.266185 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d485a5a-99a3-48c2-acf1-cb0004f1b567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:24.266996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d485a5a-99a3-48c2-acf1-cb0004f1b567 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:24.267306 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d485a5a-99a3-48c2-acf1-cb0004f1b567 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:24.267578 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d485a5a-99a3-48c2-acf1-cb0004f1b567 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:24.279599 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d485a5a-99a3-48c2-acf1-cb0004f1b567 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:24.281067 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d485a5a-99a3-48c2-acf1-cb0004f1b567 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:24.299365 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-2d485a5a-99a3-48c2-acf1-cb0004f1b567 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:41:24.299365 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:24.299365 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:24.299365 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:24.299365 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:24.299365 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:24.299365 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:24.299365 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:24.299365 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:24.299365 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:24.299365 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:24.299365 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:24.299365 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:41:24.299365 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:41:24.299365 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:41:24.300298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:41:24.300298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:24.300298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:24.300298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:24.300298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:24.300298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:24.300298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:24.300298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:24.300298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:24.300298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:24.300298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:24.300298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:24.300298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:24.300298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:24.300298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:24.300298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:24.300298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:24.301192 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:41:24.301192 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:41:24.301192 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:41:24.301192 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:24.301192 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 507/1025] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:41:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:24.307248 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0eafa9-b675-464e-9be2-12a8202c2bb8 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:24.361381 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:24.417638 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0eafa9-b675-464e-9be2-12a8202c2bb8 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:24.454828 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309321cf-7503-404d-90df-521bfd5a6315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:24.455536 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309321cf-7503-404d-90df-521bfd5a6315 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:24.455815 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309321cf-7503-404d-90df-521bfd5a6315 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:24.456085 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309321cf-7503-404d-90df-521bfd5a6315 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:24.456838 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309321cf-7503-404d-90df-521bfd5a6315 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:24.457141 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309321cf-7503-404d-90df-521bfd5a6315 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:24.459172 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309321cf-7503-404d-90df-521bfd5a6315 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:24.471222 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 519/1026] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:41:24.477243 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d485a5a-99a3-48c2-acf1-cb0004f1b567 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:24.549457 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:24.585954 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d485a5a-99a3-48c2-acf1-cb0004f1b567 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:24.626188 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8b1e6-6309-44a8-903c-81db1eafe144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:24.626918 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8b1e6-6309-44a8-903c-81db1eafe144 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:24.627198 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8b1e6-6309-44a8-903c-81db1eafe144 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:24.627553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8b1e6-6309-44a8-903c-81db1eafe144 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:24.635856 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8b1e6-6309-44a8-903c-81db1eafe144 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:24.637144 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8b1e6-6309-44a8-903c-81db1eafe144 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:24.654501 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-efd8b1e6-6309-44a8-903c-81db1eafe144 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:41:24.654501 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:24.654501 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:24.654501 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:24.654501 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:24.654501 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:24.654501 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:24.654501 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:24.654501 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:24.654501 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:24.654501 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:24.654501 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:24.654501 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:41:24.654501 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:41:24.654501 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:41:24.654501 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:41:24.655735 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:24.655735 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:24.655735 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:41:24.655735 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:41:24.655735 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:41:24.655735 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:41:24.655735 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:24.655735 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:24.655735 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:24.655735 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:24.655735 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:24.655735 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:24.655735 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:24.655735 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:24.655735 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:24.655735 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:24.655735 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:24.655735 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:24.656724 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:24.656724 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:24.656724 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:41:24.656724 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:41:24.656724 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:41:24.656724 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:41:24.656724 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:41:24.656724 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:41:24.656724 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:41:24.656724 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:24.658689 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309321cf-7503-404d-90df-521bfd5a6315 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:24.659134 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 508/1027] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Jun 24 10:41:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:24.759390 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309321cf-7503-404d-90df-521bfd5a6315 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:24.770269 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:24.795481 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce386d3-5c6e-4532-bba8-61cf905b8675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:24.796741 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce386d3-5c6e-4532-bba8-61cf905b8675 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:24.797033 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce386d3-5c6e-4532-bba8-61cf905b8675 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:24.797357 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce386d3-5c6e-4532-bba8-61cf905b8675 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:24.798211 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce386d3-5c6e-4532-bba8-61cf905b8675 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:24.798528 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce386d3-5c6e-4532-bba8-61cf905b8675 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:24.800145 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce386d3-5c6e-4532-bba8-61cf905b8675 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:24.818792 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 520/1028] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jun 24 10:41:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:24.824337 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8b1e6-6309-44a8-903c-81db1eafe144 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:24.929877 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8b1e6-6309-44a8-903c-81db1eafe144 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:24.962778 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:24.969655 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580401f-56ea-440f-9e37-b07d98c64518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:24.970326 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580401f-56ea-440f-9e37-b07d98c64518 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:24.970615 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580401f-56ea-440f-9e37-b07d98c64518 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:24.970889 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580401f-56ea-440f-9e37-b07d98c64518 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:25.043882 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580401f-56ea-440f-9e37-b07d98c64518 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:25.045338 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580401f-56ea-440f-9e37-b07d98c64518 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:25.145427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 509/1029] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:41:24 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:41:25.151059 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce386d3-5c6e-4532-bba8-61cf905b8675 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:25.253576 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce386d3-5c6e-4532-bba8-61cf905b8675 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:25.289496 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0c07c-21a0-41b9-8dde-708cc98faa4d None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:25.289840 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0c07c-21a0-41b9-8dde-708cc98faa4d None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:25.290023 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63249f-cafa-4a88-879f-a708c6c65830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:25.290143 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0c07c-21a0-41b9-8dde-708cc98faa4d None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:25.290848 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63249f-cafa-4a88-879f-a708c6c65830 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:25.291131 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63249f-cafa-4a88-879f-a708c6c65830 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:25.291587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63249f-cafa-4a88-879f-a708c6c65830 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:25.291689 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 510/1030] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:41:25.296418 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8db05-2cc1-4463-a499-d96f6e9f85dd None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:25.296707 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8db05-2cc1-4463-a499-d96f6e9f85dd None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:25.296989 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8db05-2cc1-4463-a499-d96f6e9f85dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:25.302569 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63249f-cafa-4a88-879f-a708c6c65830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:25.304066 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63249f-cafa-4a88-879f-a708c6c65830 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:25.314219 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-31f8db05-2cc1-4463-a499-d96f6e9f85dd None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:25.315445 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-31f8db05-2cc1-4463-a499-d96f6e9f85dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:25.322173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-fc63249f-cafa-4a88-879f-a708c6c65830 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:41:25.322173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:25.322173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:25.322173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:25.322173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:25.322173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:25.322173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:25.322173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:25.322173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:25.322173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:25.322173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:25.322173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:25.322173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:41:25.322173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:41:25.322173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:41:25.323061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:41:25.323061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:25.323061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:25.323061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:25.323061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:25.323061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:25.323061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:25.323061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:25.323061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:25.323061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:25.323061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:25.323061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:25.323061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:25.323061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:25.323061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:25.323061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:25.323061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:25.324020 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:41:25.324020 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:41:25.324020 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:41:25.324020 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:25.324020 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 521/1031] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:41:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:25.328961 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63249f-cafa-4a88-879f-a708c6c65830 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:25.346478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:25.354258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:25.389659 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 511/1032] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:41:25.414713 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8db05-2cc1-4463-a499-d96f6e9f85dd None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:25.435626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63249f-cafa-4a88-879f-a708c6c65830 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:25.472410 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189729ba-6ada-44c3-aec0-31bce7b67a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:25.473084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189729ba-6ada-44c3-aec0-31bce7b67a73 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:25.473369 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189729ba-6ada-44c3-aec0-31bce7b67a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:25.473840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189729ba-6ada-44c3-aec0-31bce7b67a73 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:25.474572 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189729ba-6ada-44c3-aec0-31bce7b67a73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:25.474880 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189729ba-6ada-44c3-aec0-31bce7b67a73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:25.476289 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189729ba-6ada-44c3-aec0-31bce7b67a73 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:25.488301 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 522/1033] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:41:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:25.493669 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189729ba-6ada-44c3-aec0-31bce7b67a73 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:25.518451 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8db05-2cc1-4463-a499-d96f6e9f85dd None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:25.557635 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3b195-15fd-493b-8653-e511f58c61b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:25.558850 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3b195-15fd-493b-8653-e511f58c61b6 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:25.559380 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3b195-15fd-493b-8653-e511f58c61b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:25.559879 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3b195-15fd-493b-8653-e511f58c61b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:25.561620 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c3b195-15fd-493b-8653-e511f58c61b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:25.563072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c3b195-15fd-493b-8653-e511f58c61b6 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:25.567180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 512/1034] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:41:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:41:25.570390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3b195-15fd-493b-8653-e511f58c61b6 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:25.581553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:25.602168 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:25.605128 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189729ba-6ada-44c3-aec0-31bce7b67a73 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:25.644166 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada63f9-6b60-4aa6-999b-64d251091335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:25.644983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada63f9-6b60-4aa6-999b-64d251091335 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:25.645280 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada63f9-6b60-4aa6-999b-64d251091335 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:25.645736 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada63f9-6b60-4aa6-999b-64d251091335 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:25.653959 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada63f9-6b60-4aa6-999b-64d251091335 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:25.656135 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada63f9-6b60-4aa6-999b-64d251091335 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:25.671380 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-fada63f9-6b60-4aa6-999b-64d251091335 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:41:25.671380 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:25.671380 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:25.671380 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:25.671380 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:25.671380 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:25.671380 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:25.671380 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:25.671380 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:25.671380 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:25.671380 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:25.671380 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:25.671380 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:41:25.671380 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:41:25.671380 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:41:25.672317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:41:25.672317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:25.672317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:25.672317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:25.672317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:25.672317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:25.672317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:25.672317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:25.672317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:25.672317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:25.672317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:25.672317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:25.672317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:25.672317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:25.672317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:25.672317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:25.672317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:25.673215 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:41:25.673215 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:41:25.673215 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:41:25.673215 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:41:25.673215 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:41:25.673215 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:41:25.673215 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:41:25.673215 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:25.673215 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 523/1035] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:41:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:41:25.678442 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada63f9-6b60-4aa6-999b-64d251091335 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:25.684540 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3b195-15fd-493b-8653-e511f58c61b6 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:25.729364 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49984e-1410-49ce-b72a-c5bfbc0f1806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:25.730058 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49984e-1410-49ce-b72a-c5bfbc0f1806 None admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:25.730345 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49984e-1410-49ce-b72a-c5bfbc0f1806 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:25.730610 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49984e-1410-49ce-b72a-c5bfbc0f1806 None admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:25.731360 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f49984e-1410-49ce-b72a-c5bfbc0f1806 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:25.733528 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f49984e-1410-49ce-b72a-c5bfbc0f1806 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:25.759666 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 513/1036] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 10:41:25 2022] POST /identity/v3/users => generated 285 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:41:25.787616 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada63f9-6b60-4aa6-999b-64d251091335 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:25.831947 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb22148-1e7f-4619-b056-dda0a84d9df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:25.832722 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb22148-1e7f-4619-b056-dda0a84d9df0 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:25.833064 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb22148-1e7f-4619-b056-dda0a84d9df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:25.833348 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb22148-1e7f-4619-b056-dda0a84d9df0 None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:25.834222 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb22148-1e7f-4619-b056-dda0a84d9df0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:25.834541 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb22148-1e7f-4619-b056-dda0a84d9df0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:25.836072 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb22148-1e7f-4619-b056-dda0a84d9df0 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:25.846832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:25.855403 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 524/1037] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:41:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:25.857383 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b8828-680f-47de-8e72-e77b9b7aee85 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:25.857677 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b8828-680f-47de-8e72-e77b9b7aee85 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:25.857959 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b8828-680f-47de-8e72-e77b9b7aee85 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:25.860198 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 514/1038] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:41:25.860957 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb22148-1e7f-4619-b056-dda0a84d9df0 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:25.866974 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3c0f7-22ef-4164-8725-cdf715bb83b5 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:25.867559 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3c0f7-22ef-4164-8725-cdf715bb83b5 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:25.868036 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3c0f7-22ef-4164-8725-cdf715bb83b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:25.886944 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-ddd3c0f7-22ef-4164-8725-cdf715bb83b5 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:25.888718 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-ddd3c0f7-22ef-4164-8725-cdf715bb83b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:25.991520 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 515/1039] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:41:26.013695 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb22148-1e7f-4619-b056-dda0a84d9df0 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:26.016471 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3c0f7-22ef-4164-8725-cdf715bb83b5 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:26.042437 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:26.058891 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae3e38-1ebf-4b6c-a0d8-9580a8bebae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:26.059974 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae3e38-1ebf-4b6c-a0d8-9580a8bebae1 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:26.060258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae3e38-1ebf-4b6c-a0d8-9580a8bebae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:26.060530 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae3e38-1ebf-4b6c-a0d8-9580a8bebae1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:26.062376 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae3e38-1ebf-4b6c-a0d8-9580a8bebae1 None admin] RBAC: Adding query filter params (role.id=1ecedc947e994590ae954b1a812c3208, scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user.id=e8034bad51144002a7386c975e412992) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:26.062870 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae3e38-1ebf-4b6c-a0d8-9580a8bebae1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:26.064208 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae3e38-1ebf-4b6c-a0d8-9580a8bebae1 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:26.070724 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 525/1040] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:41:25 2022] GET /identity/v3/role_assignments?user.id=e8034bad51144002a7386c975e412992&scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e&role.id=1ecedc947e994590ae954b1a812c3208 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:41:26.147625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3c0f7-22ef-4164-8725-cdf715bb83b5 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:26.186612 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d302d-2551-4bac-aac6-69ec2fdbb255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:26.187625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d302d-2551-4bac-aac6-69ec2fdbb255 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:26.188003 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d302d-2551-4bac-aac6-69ec2fdbb255 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:26.188375 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d302d-2551-4bac-aac6-69ec2fdbb255 None admin] PATH_INFO: `/v3/services/image` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:26.189156 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6d302d-2551-4bac-aac6-69ec2fdbb255 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:26.190655 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6d302d-2551-4bac-aac6-69ec2fdbb255 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:26.203491 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-8e6d302d-2551-4bac-aac6-69ec2fdbb255 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 10:41:26.203491 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:26.203491 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:41:26.203491 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:41:26.203491 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:41:26.203491 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:41:26.203491 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:41:26.203491 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:41:26.203491 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 10:41:26.203491 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:26.203491 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:41:26.203491 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:26.203491 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:26.203491 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:26.203491 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:26.203491 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:26.203491 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:26.204798 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:26.204798 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:26.204798 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:26.204798 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:26.204798 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:26.204798 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:26.204798 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:41:26.204798 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:41:26.204798 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:41:26.204798 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:41:26.204798 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:26.204798 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:26.204798 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:26.204798 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:26.204798 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:26.204798 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:26.205867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:26.205867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:26.205867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:26.205867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:26.205867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:26.205867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:26.205867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:26.205867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:26.205867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:26.205867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:26.205867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:41:26.205867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:41:26.205867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 10:41:26.205867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:26.212990 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 516/1041] 10.222.0.16 () {56 vars in 1105 bytes} [Fri Jun 24 10:41:26 2022] GET /identity/v3/services/image => generated 86 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:26.216520 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae3e38-1ebf-4b6c-a0d8-9580a8bebae1 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:26.299641 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:26.339753 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae3e38-1ebf-4b6c-a0d8-9580a8bebae1 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:26.375620 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c716173-65e5-4576-93e8-83c7db1d665b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:26.376290 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c716173-65e5-4576-93e8-83c7db1d665b None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:26.376574 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c716173-65e5-4576-93e8-83c7db1d665b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:26.376854 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c716173-65e5-4576-93e8-83c7db1d665b None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:26.377569 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c716173-65e5-4576-93e8-83c7db1d665b None admin] RBAC: Adding query filter params (name=image) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:26.377880 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c716173-65e5-4576-93e8-83c7db1d665b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:26.379290 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c716173-65e5-4576-93e8-83c7db1d665b None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:26.384790 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 526/1042] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:41:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:41:26.390393 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d302d-2551-4bac-aac6-69ec2fdbb255 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:26.475569 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:26.496949 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d302d-2551-4bac-aac6-69ec2fdbb255 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:26.532198 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99986ae-a5e3-40ea-9e72-46d198fc5693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:26.533031 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99986ae-a5e3-40ea-9e72-46d198fc5693 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:26.533404 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99986ae-a5e3-40ea-9e72-46d198fc5693 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:26.533791 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99986ae-a5e3-40ea-9e72-46d198fc5693 None admin] PATH_INFO: `/v3/services` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:26.534607 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99986ae-a5e3-40ea-9e72-46d198fc5693 None admin] RBAC: Adding query filter params (type=image) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:26.535003 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99986ae-a5e3-40ea-9e72-46d198fc5693 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:26.536548 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99986ae-a5e3-40ea-9e72-46d198fc5693 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:26.546578 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 517/1043] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:41:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:26.547906 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c716173-65e5-4576-93e8-83c7db1d665b None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:26.658251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c716173-65e5-4576-93e8-83c7db1d665b None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:26.687426 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:26.696687 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fa65d-eb7f-4589-98db-11ca6b9e8a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:26.697359 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fa65d-eb7f-4589-98db-11ca6b9e8a37 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:26.697646 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fa65d-eb7f-4589-98db-11ca6b9e8a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:26.697926 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fa65d-eb7f-4589-98db-11ca6b9e8a37 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:26.698725 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1fa65d-eb7f-4589-98db-11ca6b9e8a37 None admin] RBAC: Adding query filter params (interface=public, service_id=05fcef022b48499c83ffcdcf6520a1e0, region_id=RegionOne) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:26.699037 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1fa65d-eb7f-4589-98db-11ca6b9e8a37 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:26.700449 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1fa65d-eb7f-4589-98db-11ca6b9e8a37 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:26.705844 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 527/1044] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Jun 24 10:41:26 2022] GET /identity/v3/endpoints?service_id=05fcef022b48499c83ffcdcf6520a1e0&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:26.711449 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99986ae-a5e3-40ea-9e72-46d198fc5693 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:26.814250 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99986ae-a5e3-40ea-9e72-46d198fc5693 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:26.848256 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a3175-9553-41a4-a617-889cb1f7181a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:26.849135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a3175-9553-41a4-a617-889cb1f7181a None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:26.849423 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a3175-9553-41a4-a617-889cb1f7181a None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:26.849701 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a3175-9553-41a4-a617-889cb1f7181a None admin] PATH_INFO: `/v3/services` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:26.850390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a3175-9553-41a4-a617-889cb1f7181a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:26.851807 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a3175-9553-41a4-a617-889cb1f7181a None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:26.858634 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 518/1045] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Jun 24 10:41:26 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:41:27.934007 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcadd88-1fb7-4b00-a341-05b8051c54af None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:27.934498 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcadd88-1fb7-4b00-a341-05b8051c54af None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:27.934498 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcadd88-1fb7-4b00-a341-05b8051c54af None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:27.936378 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 528/1046] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:41:27.941347 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d8962-b08a-437e-844b-f30447f28d93 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:27.941751 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d8962-b08a-437e-844b-f30447f28d93 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:27.941923 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d8962-b08a-437e-844b-f30447f28d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:27.960905 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-4e5d8962-b08a-437e-844b-f30447f28d93 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:27.962111 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-4e5d8962-b08a-437e-844b-f30447f28d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:27.964440 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:28.038784 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 519/1047] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:41:28.062631 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcadd88-1fb7-4b00-a341-05b8051c54af None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:28.097303 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36d940-7648-4e6a-84e8-35cee0bf9f50 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:28.097623 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36d940-7648-4e6a-84e8-35cee0bf9f50 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:28.097870 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36d940-7648-4e6a-84e8-35cee0bf9f50 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:28.099810 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 520/1048] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:41:28.105406 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd32f8-a7b1-4f82-8775-9159a5a2239d None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:28.105703 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd32f8-a7b1-4f82-8775-9159a5a2239d None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:28.105995 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd32f8-a7b1-4f82-8775-9159a5a2239d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:28.126410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-12fd32f8-a7b1-4f82-8775-9159a5a2239d None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:28.128279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-12fd32f8-a7b1-4f82-8775-9159a5a2239d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:28.180759 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcadd88-1fb7-4b00-a341-05b8051c54af None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:28.199271 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 521/1049] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:41:28.218645 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ce098-44cd-469d-bb88-7e5e32f5d0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:28.219488 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ce098-44cd-469d-bb88-7e5e32f5d0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:28.219774 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ce098-44cd-469d-bb88-7e5e32f5d0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:28.220051 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ce098-44cd-469d-bb88-7e5e32f5d0b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:28.221715 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd32f8-a7b1-4f82-8775-9159a5a2239d None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:28.233090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ce098-44cd-469d-bb88-7e5e32f5d0b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:41:28.241173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-ce4ce098-44cd-469d-bb88-7e5e32f5d0b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:41:28.241173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:28.241173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:28.241173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:28.241173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:28.241173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:28.241173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:28.241173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:28.241173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:28.241173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:28.241173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:28.241173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:28.241173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:41:28.241173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:41:28.241173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:41:28.241173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:41:28.242116 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:41:28.242116 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:41:28.242116 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:41:28.242116 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:41:28.242116 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:28.242116 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:28.242116 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:28.242116 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:28.242116 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:28.242116 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:28.242116 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:28.242116 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:28.242116 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:28.242116 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:28.242116 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:28.242116 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:28.247942 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:28.247942 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:28.247942 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:28.247942 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:28.247942 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:41:28.247942 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:41:28.247942 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:41:28.247942 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:41:28.247942 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:41:28.247942 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:41:28.247942 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:41:28.247942 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:28.247942 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 529/1050] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:41:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:28.248652 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ce098-44cd-469d-bb88-7e5e32f5d0b0 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:28.298037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:28.305414 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:28.345077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd32f8-a7b1-4f82-8775-9159a5a2239d None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:28.362671 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ce098-44cd-469d-bb88-7e5e32f5d0b0 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:28.382344 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb1e43-4a2f-4c7b-920d-326cd1d0ac26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:28.383183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb1e43-4a2f-4c7b-920d-326cd1d0ac26 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:28.383464 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb1e43-4a2f-4c7b-920d-326cd1d0ac26 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:28.383739 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb1e43-4a2f-4c7b-920d-326cd1d0ac26 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:28.394424 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb1e43-4a2f-4c7b-920d-326cd1d0ac26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:41:28.398530 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c9e29-1e90-42f8-b878-7e97cf4465df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:28.399238 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c9e29-1e90-42f8-b878-7e97cf4465df None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:28.399528 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c9e29-1e90-42f8-b878-7e97cf4465df None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:28.399812 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c9e29-1e90-42f8-b878-7e97cf4465df None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:28.400560 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c9e29-1e90-42f8-b878-7e97cf4465df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:28.400868 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c9e29-1e90-42f8-b878-7e97cf4465df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:28.402241 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c9e29-1e90-42f8-b878-7e97cf4465df None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:28.402696 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-5aeb1e43-4a2f-4c7b-920d-326cd1d0ac26 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 10:41:28.402696 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:28.402696 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:28.402696 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:28.402696 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:28.402696 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:28.402696 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:28.402696 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:28.402696 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:28.402696 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:28.402696 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:28.402696 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:28.402696 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:41:28.402696 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:41:28.402696 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:41:28.402696 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:41:28.403612 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:41:28.403612 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:41:28.403612 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:41:28.403612 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:41:28.403612 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:28.403612 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:28.403612 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:28.403612 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:28.403612 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:28.403612 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:28.403612 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:28.403612 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:28.403612 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:28.403612 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:28.403612 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:28.403612 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:28.404448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:28.404448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:28.404448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:28.404448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:28.404448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:41:28.404448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:41:28.404448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:41:28.404448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:41:28.404448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:41:28.404448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:41:28.404448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 10:41:28.404448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:28.404448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 522/1051] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jun 24 10:41:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:28.409897 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb1e43-4a2f-4c7b-920d-326cd1d0ac26 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:28.414395 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 530/1052] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:41:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:28.419806 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c9e29-1e90-42f8-b878-7e97cf4465df None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:28.513965 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb1e43-4a2f-4c7b-920d-326cd1d0ac26 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:28.523716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c9e29-1e90-42f8-b878-7e97cf4465df None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:28.538561 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:28.540507 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:28.548704 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9d54a-4858-4ef2-b373-d909c95450d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:28.549390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9d54a-4858-4ef2-b373-d909c95450d7 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:28.549669 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9d54a-4858-4ef2-b373-d909c95450d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:28.549950 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9d54a-4858-4ef2-b373-d909c95450d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:28.550715 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9d54a-4858-4ef2-b373-d909c95450d7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:28.551021 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9d54a-4858-4ef2-b373-d909c95450d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:28.552473 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9d54a-4858-4ef2-b373-d909c95450d7 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:28.565662 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 523/1053] 10.222.0.16 () {56 vars in 1115 bytes} [Fri Jun 24 10:41:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:41:28.565847 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f99aa-952a-4da1-ba63-02c90926f30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:28.565847 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f99aa-952a-4da1-ba63-02c90926f30c None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:28.565847 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f99aa-952a-4da1-ba63-02c90926f30c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:28.565847 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f99aa-952a-4da1-ba63-02c90926f30c None admin] PATH_INFO: `/v3/users/2be1eebdacc14623a2d6dd00456dd97f` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:28.566737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9d54a-4858-4ef2-b373-d909c95450d7 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:28.581263 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f99aa-952a-4da1-ba63-02c90926f30c None admin] RBAC: Authorizing `identity:get_user(user_id=2be1eebdacc14623a2d6dd00456dd97f)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:28.582723 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f99aa-952a-4da1-ba63-02c90926f30c None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:28.584656 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 531/1054] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:41:28 2022] GET /identity/v3/users/2be1eebdacc14623a2d6dd00456dd97f => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:41:28.590488 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f99aa-952a-4da1-ba63-02c90926f30c None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:28.682878 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9d54a-4858-4ef2-b373-d909c95450d7 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:28.710069 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f99aa-952a-4da1-ba63-02c90926f30c None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:28.718771 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7374a-a6c5-4f51-a0d4-ab899c9ed9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:28.719613 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7374a-a6c5-4f51-a0d4-ab899c9ed9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:28.719872 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7374a-a6c5-4f51-a0d4-ab899c9ed9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:28.720145 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7374a-a6c5-4f51-a0d4-ab899c9ed9f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:28.731243 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7374a-a6c5-4f51-a0d4-ab899c9ed9f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:28.732695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7374a-a6c5-4f51-a0d4-ab899c9ed9f9 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:28.750642 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-2bc7374a-a6c5-4f51-a0d4-ab899c9ed9f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:41:28.750642 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:28.750642 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:28.750642 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:28.750642 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:28.750642 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:28.750642 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:28.750642 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:28.750642 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:28.750642 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:28.750642 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:28.750642 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:28.750642 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:41:28.750642 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:41:28.750642 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:41:28.751624 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:41:28.751624 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:28.751624 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:28.751624 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:28.751624 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:28.751624 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:28.751624 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:28.751624 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:28.751624 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:28.751624 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:28.751624 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:28.751624 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:28.751624 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:28.751624 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:28.751624 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:28.751624 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:28.751624 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:28.752514 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:41:28.752514 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:41:28.752514 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:41:28.752514 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:28.752744 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a13d65-a8fe-46c3-80fd-8b879b66b063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:28.752744 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a13d65-a8fe-46c3-80fd-8b879b66b063 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:28.752744 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a13d65-a8fe-46c3-80fd-8b879b66b063 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:28.752744 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a13d65-a8fe-46c3-80fd-8b879b66b063 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:28.753016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 524/1055] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:41:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:28.757722 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7374a-a6c5-4f51-a0d4-ab899c9ed9f9 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:28.802764 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:28.804676 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:28.835626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a13d65-a8fe-46c3-80fd-8b879b66b063 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:28.837094 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a13d65-a8fe-46c3-80fd-8b879b66b063 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:28.862960 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7374a-a6c5-4f51-a0d4-ab899c9ed9f9 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:28.899086 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9271994-a113-4a6a-a4e9-defa285e0d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:28.899802 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9271994-a113-4a6a-a4e9-defa285e0d68 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:28.900084 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9271994-a113-4a6a-a4e9-defa285e0d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:28.900344 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9271994-a113-4a6a-a4e9-defa285e0d68 None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:28.901062 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9271994-a113-4a6a-a4e9-defa285e0d68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:28.901367 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9271994-a113-4a6a-a4e9-defa285e0d68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:28.902730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9271994-a113-4a6a-a4e9-defa285e0d68 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:28.915464 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 525/1056] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:28.916811 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6bf8e-74c0-46d6-8c4b-7f85dd695d27 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:28.917099 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6bf8e-74c0-46d6-8c4b-7f85dd695d27 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:28.917371 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6bf8e-74c0-46d6-8c4b-7f85dd695d27 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:28.918581 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 526/1057] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:41:28.921125 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6bf8e-74c0-46d6-8c4b-7f85dd695d27 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:28.947224 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 532/1058] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:41:28 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 10:41:28.948539 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14c9ab-222e-4589-a9da-fb19928f374b None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:28.948834 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14c9ab-222e-4589-a9da-fb19928f374b None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:28.949097 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14c9ab-222e-4589-a9da-fb19928f374b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:28.965462 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-9a14c9ab-222e-4589-a9da-fb19928f374b None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:28.966681 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9a14c9ab-222e-4589-a9da-fb19928f374b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:29.025888 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6bf8e-74c0-46d6-8c4b-7f85dd695d27 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:29.027449 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:29.035270 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 533/1059] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:41:29.036523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14c9ab-222e-4589-a9da-fb19928f374b None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:29.038886 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:29.063018 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd571a-275a-4cec-b39f-89ea671261ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:29.063786 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd571a-275a-4cec-b39f-89ea671261ff None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:29.064070 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd571a-275a-4cec-b39f-89ea671261ff None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:29.064344 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd571a-275a-4cec-b39f-89ea671261ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:29.071696 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd571a-275a-4cec-b39f-89ea671261ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:29.073145 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd571a-275a-4cec-b39f-89ea671261ff None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:29.087484 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-0bbd571a-275a-4cec-b39f-89ea671261ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:41:29.087484 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:29.087484 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:29.087484 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:29.087484 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:29.087484 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:29.087484 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:29.087484 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:29.087484 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:29.087484 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:29.087484 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:29.087484 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:29.087484 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:41:29.087484 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:41:29.087484 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:41:29.087484 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:41:29.088463 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:29.088463 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:29.088463 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:41:29.088463 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:41:29.088463 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:41:29.088463 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:41:29.088463 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:29.088463 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:29.088463 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:29.088463 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:29.088463 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:29.088463 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:29.088463 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:29.088463 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:29.088463 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:29.088463 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:29.088463 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:29.088463 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:29.089614 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:29.089614 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:29.089614 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:41:29.089614 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:41:29.089614 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:41:29.089614 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:41:29.089614 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:41:29.089614 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:41:29.089614 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:41:29.089614 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:29.089614 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 527/1060] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Jun 24 10:41:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:41:29.089614 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd571a-275a-4cec-b39f-89ea671261ff None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:29.141457 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14c9ab-222e-4589-a9da-fb19928f374b None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:29.177053 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fafb8-2505-4c12-b0da-47238fe3ed4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:29.177922 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fafb8-2505-4c12-b0da-47238fe3ed4e None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:29.178226 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fafb8-2505-4c12-b0da-47238fe3ed4e None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:29.178504 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fafb8-2505-4c12-b0da-47238fe3ed4e None admin] PATH_INFO: `/v3/projects/64b3d4ad1d654554b94c72c97041483c` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:29.179804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7fafb8-2505-4c12-b0da-47238fe3ed4e None admin] RBAC: Authorizing `identity:get_project(project_id=64b3d4ad1d654554b94c72c97041483c)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:29.181244 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7fafb8-2505-4c12-b0da-47238fe3ed4e None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:29.182985 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 534/1061] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:41:29 2022] GET /identity/v3/projects/64b3d4ad1d654554b94c72c97041483c => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:29.183768 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fafb8-2505-4c12-b0da-47238fe3ed4e None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:29.190444 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd571a-275a-4cec-b39f-89ea671261ff None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:29.223660 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c4821-4401-4c50-9a4c-785b9d100e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:29.224570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c4821-4401-4c50-9a4c-785b9d100e6b None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:29.224855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c4821-4401-4c50-9a4c-785b9d100e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:29.225131 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c4821-4401-4c50-9a4c-785b9d100e6b None admin] PATH_INFO: `/v3/services/image` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:29.225783 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c4821-4401-4c50-9a4c-785b9d100e6b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:29.227180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c4821-4401-4c50-9a4c-785b9d100e6b None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:29.238564 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-801c4821-4401-4c50-9a4c-785b9d100e6b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 10:41:29.238564 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:29.238564 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:41:29.238564 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:41:29.238564 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:41:29.238564 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:41:29.238564 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:41:29.238564 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:41:29.238564 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 10:41:29.238564 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:29.238564 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:41:29.238564 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:29.238564 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:29.238564 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:29.238564 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:29.238564 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:29.238564 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:29.239881 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:29.239881 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:29.239881 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:29.239881 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:29.239881 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:29.239881 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:29.239881 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:41:29.239881 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:41:29.239881 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:41:29.239881 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:41:29.239881 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:29.239881 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:29.239881 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:29.239881 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:29.239881 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:29.239881 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:29.240936 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:29.240936 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:29.240936 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:29.240936 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:29.240936 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:29.240936 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:29.240936 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:29.240936 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:29.240936 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:29.240936 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:29.240936 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:41:29.240936 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:41:29.240936 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 10:41:29.240936 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:29.240936 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 528/1062] 10.222.0.16 () {56 vars in 1105 bytes} [Fri Jun 24 10:41:29 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:29.242137 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c4821-4401-4c50-9a4c-785b9d100e6b None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:29.258055 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:29.268780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:29.289617 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fafb8-2505-4c12-b0da-47238fe3ed4e None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:29.326546 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec1c7d-6162-4692-b030-375547fee30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:29.327141 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec1c7d-6162-4692-b030-375547fee30b None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:29.327455 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec1c7d-6162-4692-b030-375547fee30b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:29.327706 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec1c7d-6162-4692-b030-375547fee30b None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:29.328541 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec1c7d-6162-4692-b030-375547fee30b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:29.328855 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec1c7d-6162-4692-b030-375547fee30b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:29.330285 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec1c7d-6162-4692-b030-375547fee30b None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:29.343397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c4821-4401-4c50-9a4c-785b9d100e6b None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:29.347472 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 535/1063] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jun 24 10:41:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:29.348461 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec1c7d-6162-4692-b030-375547fee30b None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:29.382419 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084c9c6-94b4-499f-a7f4-a25d14a9716a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:29.383080 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084c9c6-94b4-499f-a7f4-a25d14a9716a None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:29.383393 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084c9c6-94b4-499f-a7f4-a25d14a9716a None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:29.383671 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084c9c6-94b4-499f-a7f4-a25d14a9716a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:29.384500 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084c9c6-94b4-499f-a7f4-a25d14a9716a None admin] RBAC: Adding query filter params (role.id=4867b69c45554ce18e23167c05a02175, scope.project.id=64b3d4ad1d654554b94c72c97041483c, user.id=2be1eebdacc14623a2d6dd00456dd97f) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:29.384816 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084c9c6-94b4-499f-a7f4-a25d14a9716a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:29.386250 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084c9c6-94b4-499f-a7f4-a25d14a9716a None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:29.401319 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 529/1064] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:41:29 2022] GET /identity/v3/role_assignments?user.id=2be1eebdacc14623a2d6dd00456dd97f&scope.project.id=64b3d4ad1d654554b94c72c97041483c&role.id=4867b69c45554ce18e23167c05a02175 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:29.401319 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084c9c6-94b4-499f-a7f4-a25d14a9716a None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:29.462847 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec1c7d-6162-4692-b030-375547fee30b None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:29.494865 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:29.503670 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411271fe-a20f-4eba-a6b2-e8d4ed53f288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:29.504359 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411271fe-a20f-4eba-a6b2-e8d4ed53f288 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:29.504770 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411271fe-a20f-4eba-a6b2-e8d4ed53f288 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:29.505683 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411271fe-a20f-4eba-a6b2-e8d4ed53f288 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:29.506425 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411271fe-a20f-4eba-a6b2-e8d4ed53f288 None admin] RBAC: Adding query filter params (name=image) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:29.506734 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411271fe-a20f-4eba-a6b2-e8d4ed53f288 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:29.508178 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411271fe-a20f-4eba-a6b2-e8d4ed53f288 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:29.513174 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:29.518658 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 536/1065] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:41:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:29.520045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411271fe-a20f-4eba-a6b2-e8d4ed53f288 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:29.526200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084c9c6-94b4-499f-a7f4-a25d14a9716a None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:29.568321 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c0505-d998-49ec-81bf-131b76ad5898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:29.569147 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c0505-d998-49ec-81bf-131b76ad5898 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:29.569436 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c0505-d998-49ec-81bf-131b76ad5898 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:29.569725 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c0505-d998-49ec-81bf-131b76ad5898 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:29.581279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c0505-d998-49ec-81bf-131b76ad5898 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:29.582710 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c0505-d998-49ec-81bf-131b76ad5898 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:29.600445 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-388c0505-d998-49ec-81bf-131b76ad5898 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:41:29.600445 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:29.600445 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:29.600445 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:29.600445 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:29.600445 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:29.600445 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:29.600445 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:29.600445 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:29.600445 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:29.600445 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:29.600445 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:29.600445 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:41:29.600445 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:41:29.600445 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:41:29.601553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:41:29.601553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:29.601553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:29.601553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:29.601553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:29.601553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:29.601553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:29.601553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:29.601553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:29.601553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:29.601553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:29.601553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:29.601553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:29.601553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:29.601553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:29.601553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:29.601553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:29.602591 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:41:29.602591 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:41:29.602591 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:41:29.602591 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:29.602591 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 530/1066] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:41:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:29.607279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c0505-d998-49ec-81bf-131b76ad5898 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:29.637779 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411271fe-a20f-4eba-a6b2-e8d4ed53f288 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:29.678590 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e3082-b7ff-40e8-86b0-da49adb477b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:29.679296 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e3082-b7ff-40e8-86b0-da49adb477b0 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:29.679578 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e3082-b7ff-40e8-86b0-da49adb477b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:29.679859 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e3082-b7ff-40e8-86b0-da49adb477b0 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:29.680553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e3082-b7ff-40e8-86b0-da49adb477b0 None admin] RBAC: Adding query filter params (type=image) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:29.680860 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e3082-b7ff-40e8-86b0-da49adb477b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:29.682226 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e3082-b7ff-40e8-86b0-da49adb477b0 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:29.692287 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 537/1067] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:41:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:29.693483 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e3082-b7ff-40e8-86b0-da49adb477b0 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:29.726504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c0505-d998-49ec-81bf-131b76ad5898 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:29.762679 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:29.765386 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3bfc9-7096-485d-b19a-5715dac7c8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:29.766320 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3bfc9-7096-485d-b19a-5715dac7c8b4 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:29.767054 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3bfc9-7096-485d-b19a-5715dac7c8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:29.767375 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3bfc9-7096-485d-b19a-5715dac7c8b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:29.768524 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3bfc9-7096-485d-b19a-5715dac7c8b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:29.768837 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3bfc9-7096-485d-b19a-5715dac7c8b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:29.770435 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3bfc9-7096-485d-b19a-5715dac7c8b4 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:29.786428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 531/1068] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:41:29.792411 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3bfc9-7096-485d-b19a-5715dac7c8b4 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:29.795168 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:29.817662 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e3082-b7ff-40e8-86b0-da49adb477b0 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:29.854895 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebba7d-32fd-416b-9e76-d94dab249984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:29.855600 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebba7d-32fd-416b-9e76-d94dab249984 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:29.855885 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebba7d-32fd-416b-9e76-d94dab249984 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:29.856163 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebba7d-32fd-416b-9e76-d94dab249984 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:29.856906 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebba7d-32fd-416b-9e76-d94dab249984 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:29.858268 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebba7d-32fd-416b-9e76-d94dab249984 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:29.880245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 538/1069] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Jun 24 10:41:29 2022] POST /identity/v3/endpoints => generated 327 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:41:29.908897 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3bfc9-7096-485d-b19a-5715dac7c8b4 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:29.955793 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b632c47-5dea-4e93-8c62-0f36b54ea8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:29.956676 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b632c47-5dea-4e93-8c62-0f36b54ea8b0 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:29.956958 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b632c47-5dea-4e93-8c62-0f36b54ea8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:29.957276 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b632c47-5dea-4e93-8c62-0f36b54ea8b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:29.965224 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b632c47-5dea-4e93-8c62-0f36b54ea8b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:29.966729 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b632c47-5dea-4e93-8c62-0f36b54ea8b0 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:29.981466 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-0b632c47-5dea-4e93-8c62-0f36b54ea8b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:41:29.981466 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:29.981466 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:29.981466 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:29.981466 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:29.981466 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:29.981466 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:29.981466 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:29.981466 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:29.981466 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:29.981466 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:29.981466 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:29.981466 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:41:29.981466 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:41:29.981466 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:41:29.982458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:41:29.982458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:29.982458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:29.982458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:29.982458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:29.982458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:29.982458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:29.982458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:29.982458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:29.982458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:29.982458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:29.982458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:29.982458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:29.982458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:29.982458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:29.982458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:29.982458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:29.984028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:41:29.984028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:41:29.984028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:41:29.984028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:41:29.984028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:41:29.984028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:41:29.984028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:41:29.984028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:29.984028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 532/1070] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:41:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:41:29.988807 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebba7d-32fd-416b-9e76-d94dab249984 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:30.113643 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebba7d-32fd-416b-9e76-d94dab249984 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:30.131930 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:30.156872 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29504c7-e915-48b9-ab6c-7f95de50a59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:30.157554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29504c7-e915-48b9-ab6c-7f95de50a59b None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:30.157838 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29504c7-e915-48b9-ab6c-7f95de50a59b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:30.158118 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29504c7-e915-48b9-ab6c-7f95de50a59b None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:30.158916 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29504c7-e915-48b9-ab6c-7f95de50a59b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:30.159358 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29504c7-e915-48b9-ab6c-7f95de50a59b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:30.160693 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29504c7-e915-48b9-ab6c-7f95de50a59b None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:30.173299 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 539/1071] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:41:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:30.179621 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b632c47-5dea-4e93-8c62-0f36b54ea8b0 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:30.242804 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:30.287489 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b632c47-5dea-4e93-8c62-0f36b54ea8b0 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:30.321850 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8dcb7-3648-40dd-b9ec-515dc51c2c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:30.322754 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8dcb7-3648-40dd-b9ec-515dc51c2c0d None admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:30.323041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8dcb7-3648-40dd-b9ec-515dc51c2c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:30.323348 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8dcb7-3648-40dd-b9ec-515dc51c2c0d None admin] PATH_INFO: `/v3/projects/61b2f5f9674c4fd3a1ec5db2f3b4b26e/users/e8034bad51144002a7386c975e412992/roles/1ecedc947e994590ae954b1a812c3208` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:30.325507 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8dcb7-3648-40dd-b9ec-515dc51c2c0d None admin] RBAC: Authorizing `identity:create_grant(project_id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user_id=e8034bad51144002a7386c975e412992, role_id=1ecedc947e994590ae954b1a812c3208)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:30.326967 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8dcb7-3648-40dd-b9ec-515dc51c2c0d None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:30.342364 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 533/1072] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 10:41:30 2022] PUT /identity/v3/projects/61b2f5f9674c4fd3a1ec5db2f3b4b26e/users/e8034bad51144002a7386c975e412992/roles/1ecedc947e994590ae954b1a812c3208 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:41:31.443118 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755da32-1885-459d-aa0f-a171d4a15569 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:31.443736 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755da32-1885-459d-aa0f-a171d4a15569 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:31.443736 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755da32-1885-459d-aa0f-a171d4a15569 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:31.445112 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 540/1073] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:41:31.450878 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e38393-f112-4002-b047-3b8a71fdde29 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:31.451365 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e38393-f112-4002-b047-3b8a71fdde29 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:31.451459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e38393-f112-4002-b047-3b8a71fdde29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:31.473871 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-67e38393-f112-4002-b047-3b8a71fdde29 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:31.475055 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-67e38393-f112-4002-b047-3b8a71fdde29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:31.544549 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 534/1074] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:41:31.566718 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755da32-1885-459d-aa0f-a171d4a15569 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:31.679275 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755da32-1885-459d-aa0f-a171d4a15569 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:31.715316 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674be2cb-1266-4504-adaf-6030a369cf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:31.716162 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674be2cb-1266-4504-adaf-6030a369cf8c None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:31.716445 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674be2cb-1266-4504-adaf-6030a369cf8c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:31.716722 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674be2cb-1266-4504-adaf-6030a369cf8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:31.727856 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674be2cb-1266-4504-adaf-6030a369cf8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:41:31.735361 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-674be2cb-1266-4504-adaf-6030a369cf8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:41:31.735361 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:31.735361 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:31.735361 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:31.735361 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:31.735361 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:31.735361 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:31.735361 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:31.735361 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:31.735361 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:31.735361 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:31.735361 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:31.735361 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:41:31.735361 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:41:31.735361 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:41:31.735361 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:41:31.736284 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:41:31.736284 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:41:31.736284 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:41:31.736284 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:41:31.736284 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:31.736284 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:31.736284 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:31.736284 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:31.736284 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:31.736284 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:31.736284 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:31.736284 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:31.736284 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:31.736284 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:31.736284 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:31.736284 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:31.742553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:31.742553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:31.742553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:31.742553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:31.742553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:41:31.742553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:41:31.742553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:41:31.742553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:41:31.742553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:41:31.742553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:41:31.742553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:41:31.742553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:31.742553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 541/1075] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:41:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:31.744682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e38393-f112-4002-b047-3b8a71fdde29 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:31.796476 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:31.852159 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e38393-f112-4002-b047-3b8a71fdde29 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:31.886532 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6acdde2-29e2-4a22-b6a4-21bec00837ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:31.887241 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acdde2-29e2-4a22-b6a4-21bec00837ba None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:31.887521 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acdde2-29e2-4a22-b6a4-21bec00837ba None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:31.887792 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acdde2-29e2-4a22-b6a4-21bec00837ba None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:31.888544 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6acdde2-29e2-4a22-b6a4-21bec00837ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:31.888845 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6acdde2-29e2-4a22-b6a4-21bec00837ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:31.890210 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6acdde2-29e2-4a22-b6a4-21bec00837ba None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:31.899798 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 535/1076] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:41:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:31.905478 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674be2cb-1266-4504-adaf-6030a369cf8c None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:31.942843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:31.943739 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3870ac-da5c-4d7c-9a4c-29a2ab7e4d62 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:31.944030 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3870ac-da5c-4d7c-9a4c-29a2ab7e4d62 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:31.944310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3870ac-da5c-4d7c-9a4c-29a2ab7e4d62 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:31.946195 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 536/1077] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:41:31.951332 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3aee5-ca75-498d-be73-d25a091fa927 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:31.951606 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3aee5-ca75-498d-be73-d25a091fa927 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:31.951887 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3aee5-ca75-498d-be73-d25a091fa927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:31.969347 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-aee3aee5-ca75-498d-be73-d25a091fa927 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:31.970456 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-aee3aee5-ca75-498d-be73-d25a091fa927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:32.023587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674be2cb-1266-4504-adaf-6030a369cf8c None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:32.044923 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 537/1078] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:41:32.059294 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016374e6-b818-49fa-acac-c57e585399b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:32.060266 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016374e6-b818-49fa-acac-c57e585399b1 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:32.060634 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016374e6-b818-49fa-acac-c57e585399b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:32.061338 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016374e6-b818-49fa-acac-c57e585399b1 None admin] PATH_INFO: `/v3/users/2be1eebdacc14623a2d6dd00456dd97f` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:32.062575 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016374e6-b818-49fa-acac-c57e585399b1 None admin] RBAC: Authorizing `identity:get_user(user_id=2be1eebdacc14623a2d6dd00456dd97f)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:32.064122 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016374e6-b818-49fa-acac-c57e585399b1 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:32.065843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 542/1079] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:41:31 2022] GET /identity/v3/users/2be1eebdacc14623a2d6dd00456dd97f => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:32.067059 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3aee5-ca75-498d-be73-d25a091fa927 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:32.071498 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016374e6-b818-49fa-acac-c57e585399b1 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:32.111530 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:32.173147 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3aee5-ca75-498d-be73-d25a091fa927 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:32.177505 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:32.180057 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016374e6-b818-49fa-acac-c57e585399b1 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:32.210992 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4d6cb-d22a-40e7-964f-578a7410608c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:32.211722 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4d6cb-d22a-40e7-964f-578a7410608c None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:32.212010 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4d6cb-d22a-40e7-964f-578a7410608c None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:32.212289 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4d6cb-d22a-40e7-964f-578a7410608c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:32.218708 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacad112-9733-4cab-976e-15aaf1d920ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:32.219665 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacad112-9733-4cab-976e-15aaf1d920ae None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:32.219896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacad112-9733-4cab-976e-15aaf1d920ae None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:32.220173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacad112-9733-4cab-976e-15aaf1d920ae None admin] PATH_INFO: `/v3/projects/64b3d4ad1d654554b94c72c97041483c` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:32.221354 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacad112-9733-4cab-976e-15aaf1d920ae None admin] RBAC: Authorizing `identity:get_project(project_id=64b3d4ad1d654554b94c72c97041483c)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:32.222784 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacad112-9733-4cab-976e-15aaf1d920ae None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:32.224856 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 543/1080] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:41:32 2022] GET /identity/v3/projects/64b3d4ad1d654554b94c72c97041483c => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:41:32.230599 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacad112-9733-4cab-976e-15aaf1d920ae None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:32.283899 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4d6cb-d22a-40e7-964f-578a7410608c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:32.286384 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4d6cb-d22a-40e7-964f-578a7410608c None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:32.330473 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:32.334560 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacad112-9733-4cab-976e-15aaf1d920ae None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:32.368982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443994f7-bff5-4e5b-81cb-977eb5b80c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:32.369890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443994f7-bff5-4e5b-81cb-977eb5b80c6f None admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:32.370173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443994f7-bff5-4e5b-81cb-977eb5b80c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:32.370451 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443994f7-bff5-4e5b-81cb-977eb5b80c6f None admin] PATH_INFO: `/v3/projects/64b3d4ad1d654554b94c72c97041483c/users/2be1eebdacc14623a2d6dd00456dd97f/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:32.372471 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443994f7-bff5-4e5b-81cb-977eb5b80c6f None admin] RBAC: Authorizing `identity:create_grant(project_id=64b3d4ad1d654554b94c72c97041483c, user_id=2be1eebdacc14623a2d6dd00456dd97f, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:32.373912 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443994f7-bff5-4e5b-81cb-977eb5b80c6f None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:32.387302 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 544/1081] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 10:41:32 2022] PUT /identity/v3/projects/64b3d4ad1d654554b94c72c97041483c/users/2be1eebdacc14623a2d6dd00456dd97f/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:41:32.388376 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2de10-b58d-4db8-bab5-e5c800b6b993 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:32.388667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2de10-b58d-4db8-bab5-e5c800b6b993 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:32.388947 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2de10-b58d-4db8-bab5-e5c800b6b993 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:32.390215 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 545/1082] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:41:32.396122 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ff51d-42df-4465-b350-a4985f54204e None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:32.396412 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ff51d-42df-4465-b350-a4985f54204e None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:32.396691 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ff51d-42df-4465-b350-a4985f54204e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:32.407570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 538/1083] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:41:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:41:32.414453 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4d6cb-d22a-40e7-964f-578a7410608c None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:32.419341 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-940ff51d-42df-4465-b350-a4985f54204e None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:32.420576 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-940ff51d-42df-4465-b350-a4985f54204e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:32.448838 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:32.500082 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 546/1084] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:41:32.525348 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ff51d-42df-4465-b350-a4985f54204e None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:32.537262 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4d6cb-d22a-40e7-964f-578a7410608c None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:32.583470 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d739e9-78e8-4fb1-a502-1f1ff87d92ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:32.584333 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d739e9-78e8-4fb1-a502-1f1ff87d92ac None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:32.584633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d739e9-78e8-4fb1-a502-1f1ff87d92ac None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:32.584905 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d739e9-78e8-4fb1-a502-1f1ff87d92ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:32.593547 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:32.595886 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d739e9-78e8-4fb1-a502-1f1ff87d92ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:32.597395 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d739e9-78e8-4fb1-a502-1f1ff87d92ac None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:32.616776 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-a6d739e9-78e8-4fb1-a502-1f1ff87d92ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:41:32.616776 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:32.616776 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:32.616776 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:32.616776 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:32.616776 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:32.616776 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:32.616776 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:32.616776 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:32.616776 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:32.616776 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:32.616776 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:32.616776 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:41:32.616776 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:41:32.616776 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:41:32.617742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:41:32.617742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:32.617742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:32.617742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:32.617742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:32.617742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:32.617742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:32.617742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:32.617742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:32.617742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:32.617742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:32.617742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:32.617742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:32.617742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:32.617742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:32.617742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:32.617742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:32.618637 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:41:32.618637 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:41:32.618637 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:41:32.618637 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:32.618637 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 539/1085] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:41:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:41:32.626105 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d739e9-78e8-4fb1-a502-1f1ff87d92ac None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:32.648183 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ff51d-42df-4465-b350-a4985f54204e None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:32.687310 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d928993-d15c-41fb-8b6f-c4c76f7ad942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:32.688253 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d928993-d15c-41fb-8b6f-c4c76f7ad942 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:32.688568 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d928993-d15c-41fb-8b6f-c4c76f7ad942 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:32.688912 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d928993-d15c-41fb-8b6f-c4c76f7ad942 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:32.700428 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d928993-d15c-41fb-8b6f-c4c76f7ad942 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:41:32.709818 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-5d928993-d15c-41fb-8b6f-c4c76f7ad942 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 10:41:32.709818 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:32.709818 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:32.709818 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:32.709818 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:32.709818 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:32.709818 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:32.709818 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:32.709818 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:32.709818 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:32.709818 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:32.709818 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:32.709818 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:41:32.709818 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:41:32.709818 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:41:32.709818 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:41:32.710776 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:41:32.710776 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:41:32.710776 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:41:32.710776 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:41:32.710776 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:32.710776 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:32.710776 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:32.710776 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:32.710776 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:32.710776 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:32.710776 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:32.710776 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:32.710776 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:32.710776 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:32.710776 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:32.710776 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:32.711667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:32.711667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:32.711667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:32.711667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:32.711667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:41:32.711667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:41:32.711667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:41:32.711667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:41:32.711667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:41:32.711667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:41:32.711667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 10:41:32.711667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:32.711667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 547/1086] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jun 24 10:41:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:41:32.716837 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d928993-d15c-41fb-8b6f-c4c76f7ad942 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:32.738109 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:32.746298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d739e9-78e8-4fb1-a502-1f1ff87d92ac None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:32.786485 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a988499-06e0-4656-bc92-e03673fb3d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:32.787285 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a988499-06e0-4656-bc92-e03673fb3d41 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:32.787584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a988499-06e0-4656-bc92-e03673fb3d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:32.787867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a988499-06e0-4656-bc92-e03673fb3d41 None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:32.789224 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a988499-06e0-4656-bc92-e03673fb3d41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:32.789533 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a988499-06e0-4656-bc92-e03673fb3d41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:32.791082 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a988499-06e0-4656-bc92-e03673fb3d41 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:32.811207 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 540/1087] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:41:32.827699 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d928993-d15c-41fb-8b6f-c4c76f7ad942 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:32.869273 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7688672-c3a2-4c18-8ebf-297bf162bd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:32.869961 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7688672-c3a2-4c18-8ebf-297bf162bd2c None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:32.870244 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7688672-c3a2-4c18-8ebf-297bf162bd2c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:32.870519 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7688672-c3a2-4c18-8ebf-297bf162bd2c None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:32.871315 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7688672-c3a2-4c18-8ebf-297bf162bd2c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:32.871624 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7688672-c3a2-4c18-8ebf-297bf162bd2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:32.872998 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7688672-c3a2-4c18-8ebf-297bf162bd2c None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:32.883222 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 548/1088] 10.222.0.16 () {56 vars in 1115 bytes} [Fri Jun 24 10:41:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:41:32.889081 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a988499-06e0-4656-bc92-e03673fb3d41 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:32.950567 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:33.008374 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a988499-06e0-4656-bc92-e03673fb3d41 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:33.042885 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f648e-aee3-451e-abbc-a2bdbb67dd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:33.043649 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f648e-aee3-451e-abbc-a2bdbb67dd6c None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:33.043929 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f648e-aee3-451e-abbc-a2bdbb67dd6c None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:33.044278 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f648e-aee3-451e-abbc-a2bdbb67dd6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:33.055910 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f648e-aee3-451e-abbc-a2bdbb67dd6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:33.057368 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f648e-aee3-451e-abbc-a2bdbb67dd6c None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:33.078140 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-5a6f648e-aee3-451e-abbc-a2bdbb67dd6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:41:33.078140 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:33.078140 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:33.078140 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:33.078140 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:33.078140 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:33.078140 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:33.078140 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:33.078140 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:33.078140 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:33.078140 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:33.078140 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:33.078140 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:41:33.078140 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:41:33.078140 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:41:33.079339 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:41:33.079339 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:33.079339 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:33.079339 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:33.079339 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:33.079339 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:33.079339 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:33.079339 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:33.079339 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:33.079339 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:33.079339 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:33.079339 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:33.079339 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:33.079339 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:33.079339 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:33.079339 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:33.079339 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:33.080498 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:41:33.080498 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:41:33.080498 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:41:33.080498 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:33.080498 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 541/1089] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:41:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:33.086069 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7688672-c3a2-4c18-8ebf-297bf162bd2c None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:33.171037 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:33.194239 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7688672-c3a2-4c18-8ebf-297bf162bd2c None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:33.230457 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1ec4f-a5f8-4993-9992-9b243a7ce1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:33.231113 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1ec4f-a5f8-4993-9992-9b243a7ce1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:33.231422 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1ec4f-a5f8-4993-9992-9b243a7ce1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:33.231698 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1ec4f-a5f8-4993-9992-9b243a7ce1d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:33.232413 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e1ec4f-a5f8-4993-9992-9b243a7ce1d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:33.232720 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e1ec4f-a5f8-4993-9992-9b243a7ce1d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:33.234086 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e1ec4f-a5f8-4993-9992-9b243a7ce1d6 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:33.246409 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 549/1090] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:33.252280 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f648e-aee3-451e-abbc-a2bdbb67dd6c None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:33.363299 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f648e-aee3-451e-abbc-a2bdbb67dd6c None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:33.366169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:33.399569 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddb799-8fe3-47e7-8d3a-22c3e76e8b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:33.400386 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddb799-8fe3-47e7-8d3a-22c3e76e8b12 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:33.400645 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddb799-8fe3-47e7-8d3a-22c3e76e8b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:33.400925 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddb799-8fe3-47e7-8d3a-22c3e76e8b12 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:33.408633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cddb799-8fe3-47e7-8d3a-22c3e76e8b12 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:33.410086 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cddb799-8fe3-47e7-8d3a-22c3e76e8b12 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:33.424043 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-9cddb799-8fe3-47e7-8d3a-22c3e76e8b12 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:41:33.424043 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:33.424043 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:33.424043 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:33.424043 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:33.424043 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:33.424043 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:33.424043 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:33.424043 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:33.424043 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:33.424043 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:33.424043 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:33.424043 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:41:33.424043 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:41:33.424043 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:41:33.424043 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:41:33.424996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:33.424996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:33.424996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:41:33.424996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:41:33.424996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:41:33.424996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:41:33.424996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:33.424996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:33.424996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:33.424996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:33.424996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:33.424996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:33.424996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:33.424996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:33.424996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:33.424996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:33.424996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:33.424996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:33.425968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:33.425968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:33.425968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:41:33.425968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:41:33.425968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:41:33.425968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:41:33.425968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:41:33.425968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:41:33.425968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:41:33.425968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:33.425968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 542/1091] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Jun 24 10:41:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:33.431861 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1ec4f-a5f8-4993-9992-9b243a7ce1d6 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:33.537653 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1ec4f-a5f8-4993-9992-9b243a7ce1d6 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:33.573272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab1c16-45cc-4d6a-877c-a9b583cdb09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:33.573944 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab1c16-45cc-4d6a-877c-a9b583cdb09a None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:33.574231 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab1c16-45cc-4d6a-877c-a9b583cdb09a None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:33.574505 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab1c16-45cc-4d6a-877c-a9b583cdb09a None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:33.575384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab1c16-45cc-4d6a-877c-a9b583cdb09a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:33.575697 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab1c16-45cc-4d6a-877c-a9b583cdb09a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:33.577119 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab1c16-45cc-4d6a-877c-a9b583cdb09a None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:33.586136 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:33.595578 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 550/1092] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jun 24 10:41:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:33.601529 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddb799-8fe3-47e7-8d3a-22c3e76e8b12 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:33.704517 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddb799-8fe3-47e7-8d3a-22c3e76e8b12 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:33.739518 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b1d31-90c4-40bc-b878-cc01dc1bca86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:33.740172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b1d31-90c4-40bc-b878-cc01dc1bca86 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:33.740461 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b1d31-90c4-40bc-b878-cc01dc1bca86 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:33.740740 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b1d31-90c4-40bc-b878-cc01dc1bca86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:33.775123 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:33.814766 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b1d31-90c4-40bc-b878-cc01dc1bca86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:33.816269 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b1d31-90c4-40bc-b878-cc01dc1bca86 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:33.915615 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 543/1093] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:41:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:41:33.921526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab1c16-45cc-4d6a-877c-a9b583cdb09a None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:34.025405 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab1c16-45cc-4d6a-877c-a9b583cdb09a None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:34.062214 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6c737-d508-434a-97d6-6538b210dee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:34.063022 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6c737-d508-434a-97d6-6538b210dee5 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:34.063340 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6c737-d508-434a-97d6-6538b210dee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:34.063625 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6c737-d508-434a-97d6-6538b210dee5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:34.074255 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf6c737-d508-434a-97d6-6538b210dee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:34.075752 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf6c737-d508-434a-97d6-6538b210dee5 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:34.093317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-faf6c737-d508-434a-97d6-6538b210dee5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:41:34.093317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:34.093317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:34.093317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:34.093317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:34.093317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:34.093317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:34.093317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:34.093317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:34.093317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:34.093317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:34.093317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:34.093317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:41:34.093317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:41:34.093317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:41:34.094439 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:41:34.094439 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:34.094439 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:34.094439 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:34.094439 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:34.094439 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:34.094439 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:34.094439 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:34.094439 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:34.094439 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:34.094439 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:34.094439 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:34.094439 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:34.094439 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:34.094439 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:34.094439 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:34.094439 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:34.095382 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:41:34.095382 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:41:34.095382 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:41:34.095382 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:34.095382 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 551/1094] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:41:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:34.100567 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b1d31-90c4-40bc-b878-cc01dc1bca86 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:34.160295 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:34.199260 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b1d31-90c4-40bc-b878-cc01dc1bca86 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:34.234399 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026898e-17d0-4623-8872-3c4abc91b8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:34.235071 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026898e-17d0-4623-8872-3c4abc91b8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:34.235353 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026898e-17d0-4623-8872-3c4abc91b8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:34.235655 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026898e-17d0-4623-8872-3c4abc91b8f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:34.236374 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8026898e-17d0-4623-8872-3c4abc91b8f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:34.236682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8026898e-17d0-4623-8872-3c4abc91b8f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:34.238054 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8026898e-17d0-4623-8872-3c4abc91b8f9 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:34.249763 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 544/1095] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:34.255537 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6c737-d508-434a-97d6-6538b210dee5 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:34.307475 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:34.359183 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6c737-d508-434a-97d6-6538b210dee5 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:34.394909 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c938de-12d6-4ef9-b177-526abf2da9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:34.395788 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c938de-12d6-4ef9-b177-526abf2da9f0 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:34.396068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c938de-12d6-4ef9-b177-526abf2da9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:34.396366 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c938de-12d6-4ef9-b177-526abf2da9f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:34.396950 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e67f88-2be6-4001-a1e4-d9461d147f1e None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:34.397245 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e67f88-2be6-4001-a1e4-d9461d147f1e None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:34.397492 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e67f88-2be6-4001-a1e4-d9461d147f1e None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:34.399039 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 545/1096] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:41:34.403832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c938de-12d6-4ef9-b177-526abf2da9f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:34.403971 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfe11c-b80f-47df-a6c0-495998301eab None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:34.404106 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfe11c-b80f-47df-a6c0-495998301eab None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:34.404410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfe11c-b80f-47df-a6c0-495998301eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:34.405279 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c938de-12d6-4ef9-b177-526abf2da9f0 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:34.419047 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-55c938de-12d6-4ef9-b177-526abf2da9f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:41:34.419047 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:34.419047 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:34.419047 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:34.419047 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:34.419047 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:34.419047 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:34.419047 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:34.419047 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:34.419047 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:34.419047 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:34.419047 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:34.419047 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:41:34.419047 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:41:34.419047 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:41:34.419992 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:41:34.419992 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:34.419992 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:34.419992 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:34.419992 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:34.419992 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:34.419992 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:34.419992 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:34.419992 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:34.419992 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:34.419992 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:34.419992 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:34.419992 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:34.419992 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:34.419992 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:34.419992 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:34.419992 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:34.420921 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:41:34.420921 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:41:34.420921 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:41:34.420921 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:41:34.420921 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:41:34.420921 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:41:34.420921 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:41:34.420921 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:34.420921 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 552/1097] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:41:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:34.421952 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-fbdfe11c-b80f-47df-a6c0-495998301eab None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:34.423133 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-fbdfe11c-b80f-47df-a6c0-495998301eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:34.426065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c938de-12d6-4ef9-b177-526abf2da9f0 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:34.490873 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 546/1098] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:41:34.514050 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfe11c-b80f-47df-a6c0-495998301eab None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:34.529555 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c938de-12d6-4ef9-b177-526abf2da9f0 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:34.540011 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:34.564029 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812fe75-ad0b-4be3-bb08-fea3327bd108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:34.564683 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812fe75-ad0b-4be3-bb08-fea3327bd108 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:34.564961 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812fe75-ad0b-4be3-bb08-fea3327bd108 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:34.565237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812fe75-ad0b-4be3-bb08-fea3327bd108 None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:34.566018 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812fe75-ad0b-4be3-bb08-fea3327bd108 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:34.566327 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812fe75-ad0b-4be3-bb08-fea3327bd108 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:34.568339 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812fe75-ad0b-4be3-bb08-fea3327bd108 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:34.569611 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:34.580463 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 553/1099] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:41:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:41:34.586819 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812fe75-ad0b-4be3-bb08-fea3327bd108 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:34.614977 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfe11c-b80f-47df-a6c0-495998301eab None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:34.650463 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c26b2-e790-4443-a7bd-eaa652d7edd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:34.651307 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c26b2-e790-4443-a7bd-eaa652d7edd0 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:34.651652 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c26b2-e790-4443-a7bd-eaa652d7edd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:34.651928 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c26b2-e790-4443-a7bd-eaa652d7edd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:34.662290 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c26b2-e790-4443-a7bd-eaa652d7edd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:41:34.669864 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-423c26b2-e790-4443-a7bd-eaa652d7edd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:41:34.669864 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:34.669864 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:34.669864 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:34.669864 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:34.669864 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:34.669864 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:34.669864 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:34.669864 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:34.669864 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:34.669864 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:34.669864 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:34.669864 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:41:34.669864 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:41:34.669864 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:41:34.669864 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:41:34.671016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:41:34.671016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:41:34.671016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:41:34.671016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:41:34.671016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:34.671016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:34.671016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:34.671016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:34.671016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:34.671016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:34.671016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:34.671016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:34.671016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:34.671016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:34.671016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:34.671016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:34.672124 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:34.672124 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:34.672124 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:34.672124 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:34.672124 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:41:34.672124 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:41:34.672124 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:41:34.672124 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:41:34.672124 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:41:34.672124 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:41:34.672124 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:41:34.672124 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:41:34.672124 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 547/1100] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:41:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:41:34.677110 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c26b2-e790-4443-a7bd-eaa652d7edd0 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:34.694022 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812fe75-ad0b-4be3-bb08-fea3327bd108 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:34.728196 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48115bb7-3c7d-4ae1-9a8d-442a9c853a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:34.728855 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48115bb7-3c7d-4ae1-9a8d-442a9c853a6d None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:34.729137 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48115bb7-3c7d-4ae1-9a8d-442a9c853a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:34.729413 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48115bb7-3c7d-4ae1-9a8d-442a9c853a6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:34.730241 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48115bb7-3c7d-4ae1-9a8d-442a9c853a6d None admin] RBAC: Adding query filter params (role.id=1ecedc947e994590ae954b1a812c3208, scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user.id=e8034bad51144002a7386c975e412992) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:34.730551 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48115bb7-3c7d-4ae1-9a8d-442a9c853a6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:34.732019 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48115bb7-3c7d-4ae1-9a8d-442a9c853a6d None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:34.737934 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 554/1101] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:41:34 2022] GET /identity/v3/role_assignments?user.id=e8034bad51144002a7386c975e412992&scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e&role.id=1ecedc947e994590ae954b1a812c3208 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:41:34.786793 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c26b2-e790-4443-a7bd-eaa652d7edd0 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:34.803083 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:34.827000 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e682fc-68fa-4308-bae8-6337eac07b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:34.827734 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e682fc-68fa-4308-bae8-6337eac07b66 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:34.828021 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e682fc-68fa-4308-bae8-6337eac07b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:34.828302 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e682fc-68fa-4308-bae8-6337eac07b66 None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:34.829102 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e682fc-68fa-4308-bae8-6337eac07b66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:34.829410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e682fc-68fa-4308-bae8-6337eac07b66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:34.830809 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e682fc-68fa-4308-bae8-6337eac07b66 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:34.840435 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 548/1102] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:41:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:41:34.846541 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48115bb7-3c7d-4ae1-9a8d-442a9c853a6d None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:34.884939 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:34.959719 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48115bb7-3c7d-4ae1-9a8d-442a9c853a6d None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:34.994816 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d787e9c-9327-44a9-8052-ab4c55831477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:34.995774 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d787e9c-9327-44a9-8052-ab4c55831477 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:34.996052 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d787e9c-9327-44a9-8052-ab4c55831477 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:34.996329 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d787e9c-9327-44a9-8052-ab4c55831477 None admin] PATH_INFO: `/v3/users/2be1eebdacc14623a2d6dd00456dd97f` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:34.997530 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d787e9c-9327-44a9-8052-ab4c55831477 None admin] RBAC: Authorizing `identity:get_user(user_id=2be1eebdacc14623a2d6dd00456dd97f)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:34.998952 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d787e9c-9327-44a9-8052-ab4c55831477 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:35.000657 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 555/1103] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:41:34 2022] GET /identity/v3/users/2be1eebdacc14623a2d6dd00456dd97f => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:35.006973 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e682fc-68fa-4308-bae8-6337eac07b66 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:35.111577 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e682fc-68fa-4308-bae8-6337eac07b66 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:35.146693 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ef993-3c61-423c-8d19-646e9fa94b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:35.147402 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ef993-3c61-423c-8d19-646e9fa94b7f None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:35.147690 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ef993-3c61-423c-8d19-646e9fa94b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:35.147975 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ef993-3c61-423c-8d19-646e9fa94b7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:35.196638 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:35.220230 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ef993-3c61-423c-8d19-646e9fa94b7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:35.221683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ef993-3c61-423c-8d19-646e9fa94b7f None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:35.323882 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 549/1104] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:41:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:41:35.330065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d787e9c-9327-44a9-8052-ab4c55831477 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:35.445055 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d787e9c-9327-44a9-8052-ab4c55831477 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:35.446705 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:35.480859 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd884f-b301-482d-8dc2-c3784c51eb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:35.481757 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd884f-b301-482d-8dc2-c3784c51eb73 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:35.482033 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd884f-b301-482d-8dc2-c3784c51eb73 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:35.482312 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd884f-b301-482d-8dc2-c3784c51eb73 None admin] PATH_INFO: `/v3/projects/64b3d4ad1d654554b94c72c97041483c` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:35.483567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd884f-b301-482d-8dc2-c3784c51eb73 None admin] RBAC: Authorizing `identity:get_project(project_id=64b3d4ad1d654554b94c72c97041483c)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:35.485000 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd884f-b301-482d-8dc2-c3784c51eb73 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:35.486728 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 556/1105] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:41:35 2022] GET /identity/v3/projects/64b3d4ad1d654554b94c72c97041483c => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:35.493177 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ef993-3c61-423c-8d19-646e9fa94b7f None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:35.572816 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:35.596257 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ef993-3c61-423c-8d19-646e9fa94b7f None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:35.630244 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8856d46-ac19-4f91-ad75-898705581ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:35.630888 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8856d46-ac19-4f91-ad75-898705581ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:35.631195 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8856d46-ac19-4f91-ad75-898705581ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:35.631501 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8856d46-ac19-4f91-ad75-898705581ee1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:35.632340 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8856d46-ac19-4f91-ad75-898705581ee1 None admin] RBAC: Adding query filter params (role.id=4867b69c45554ce18e23167c05a02175, scope.project.id=64b3d4ad1d654554b94c72c97041483c, user.id=2be1eebdacc14623a2d6dd00456dd97f) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:35.632655 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8856d46-ac19-4f91-ad75-898705581ee1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:35.634096 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8856d46-ac19-4f91-ad75-898705581ee1 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:35.639909 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 550/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:41:35 2022] GET /identity/v3/role_assignments?user.id=2be1eebdacc14623a2d6dd00456dd97f&scope.project.id=64b3d4ad1d654554b94c72c97041483c&role.id=4867b69c45554ce18e23167c05a02175 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:37.661565 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a5674-8c44-465c-8808-0db1d53918e1 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:37.662029 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a5674-8c44-465c-8808-0db1d53918e1 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:37.662132 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a5674-8c44-465c-8808-0db1d53918e1 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:37.663537 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 557/1107] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:41:37.669073 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf90f72-3e82-4eda-9ee9-4a43a658ed3f None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:37.669548 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf90f72-3e82-4eda-9ee9-4a43a658ed3f None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:37.669642 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf90f72-3e82-4eda-9ee9-4a43a658ed3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:37.688887 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-acf90f72-3e82-4eda-9ee9-4a43a658ed3f None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:37.690066 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-acf90f72-3e82-4eda-9ee9-4a43a658ed3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:37.758781 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 551/1108] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:41:37.794526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a5674-8c44-465c-8808-0db1d53918e1 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:37.905603 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a5674-8c44-465c-8808-0db1d53918e1 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:37.944849 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b3a31-a3a0-4403-97df-03db170b5e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:37.945576 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b3a31-a3a0-4403-97df-03db170b5e24 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:37.945864 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b3a31-a3a0-4403-97df-03db170b5e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:37.946144 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b3a31-a3a0-4403-97df-03db170b5e24 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:37.947387 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b3a31-a3a0-4403-97df-03db170b5e24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:37.948846 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b3a31-a3a0-4403-97df-03db170b5e24 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:37.950432 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 558/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:41:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:37.956250 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf90f72-3e82-4eda-9ee9-4a43a658ed3f None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:38.040813 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:38.072666 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf90f72-3e82-4eda-9ee9-4a43a658ed3f None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:38.108229 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c891002-3279-4148-98d0-108c2b71f505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:38.108897 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c891002-3279-4148-98d0-108c2b71f505 None admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:38.109182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c891002-3279-4148-98d0-108c2b71f505 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:38.109438 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c891002-3279-4148-98d0-108c2b71f505 None admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:38.110176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c891002-3279-4148-98d0-108c2b71f505 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:38.111648 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c891002-3279-4148-98d0-108c2b71f505 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:38.133937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 552/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 10:41:37 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:41:40.203309 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feff31-06bf-466a-b30e-30293235bf47 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:40.204320 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feff31-06bf-466a-b30e-30293235bf47 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:40.204320 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feff31-06bf-466a-b30e-30293235bf47 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:40.206519 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 559/1111] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:41:40.213348 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc4e76-3b6f-45d5-bd03-5b57d92d7609 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:40.214017 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc4e76-3b6f-45d5-bd03-5b57d92d7609 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:40.214261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc4e76-3b6f-45d5-bd03-5b57d92d7609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:40.241021 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-b2cc4e76-3b6f-45d5-bd03-5b57d92d7609 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:40.242213 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-b2cc4e76-3b6f-45d5-bd03-5b57d92d7609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:40.314384 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 553/1112] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:41:40.346493 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2feff31-06bf-466a-b30e-30293235bf47 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:40.393993 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:40.473487 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2feff31-06bf-466a-b30e-30293235bf47 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:40.510810 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644b29f-3288-4d3f-b2a3-5352c515943a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:40.511698 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644b29f-3288-4d3f-b2a3-5352c515943a None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:40.511978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644b29f-3288-4d3f-b2a3-5352c515943a None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:40.512251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644b29f-3288-4d3f-b2a3-5352c515943a None admin] PATH_INFO: `/v3/roles/19b4d737ab92430caeb4cd548049bcfc` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:40.513845 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644b29f-3288-4d3f-b2a3-5352c515943a None admin] RBAC: Authorizing `identity:get_role(role_id=19b4d737ab92430caeb4cd548049bcfc)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:40.515251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644b29f-3288-4d3f-b2a3-5352c515943a None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:40.516639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 560/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:41:40 2022] GET /identity/v3/roles/19b4d737ab92430caeb4cd548049bcfc => generated 223 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:40.523583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc4e76-3b6f-45d5-bd03-5b57d92d7609 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:40.591929 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:40.643283 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc4e76-3b6f-45d5-bd03-5b57d92d7609 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:40.682194 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b5d69-0d75-4482-8f2c-e67503936fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:40.683082 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b5d69-0d75-4482-8f2c-e67503936fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:40.683400 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b5d69-0d75-4482-8f2c-e67503936fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:40.683676 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b5d69-0d75-4482-8f2c-e67503936fa3 None admin] PATH_INFO: `/v3/users/94085ae3735f442984ddaf795ff562b3` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:40.698652 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b5d69-0d75-4482-8f2c-e67503936fa3 None admin] RBAC: Authorizing `identity:get_user(user_id=94085ae3735f442984ddaf795ff562b3)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:40.700216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b5d69-0d75-4482-8f2c-e67503936fa3 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:40.701886 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 554/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:41:40 2022] GET /identity/v3/users/94085ae3735f442984ddaf795ff562b3 => generated 286 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:40.708041 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644b29f-3288-4d3f-b2a3-5352c515943a None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:40.812197 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644b29f-3288-4d3f-b2a3-5352c515943a None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:40.818940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:40.860542 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500cc2e8-9ceb-4e47-9a41-6d6a67de308a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:40.861204 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cc2e8-9ceb-4e47-9a41-6d6a67de308a None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:40.861477 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cc2e8-9ceb-4e47-9a41-6d6a67de308a None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:40.861755 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cc2e8-9ceb-4e47-9a41-6d6a67de308a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:40.937342 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500cc2e8-9ceb-4e47-9a41-6d6a67de308a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:40.938787 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500cc2e8-9ceb-4e47-9a41-6d6a67de308a None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:41.044337 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 561/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:41:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:41:41.050496 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b5d69-0d75-4482-8f2c-e67503936fa3 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:41.165249 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b5d69-0d75-4482-8f2c-e67503936fa3 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:41.179368 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:41.201352 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472db9bf-3832-4885-a043-f0426f9b3bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:41.202215 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472db9bf-3832-4885-a043-f0426f9b3bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:41.202493 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472db9bf-3832-4885-a043-f0426f9b3bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:41.202758 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472db9bf-3832-4885-a043-f0426f9b3bc1 None admin] PATH_INFO: `/v3/projects/64b3d4ad1d654554b94c72c97041483c` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:41.203982 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472db9bf-3832-4885-a043-f0426f9b3bc1 None admin] RBAC: Authorizing `identity:get_project(project_id=64b3d4ad1d654554b94c72c97041483c)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:41.205411 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472db9bf-3832-4885-a043-f0426f9b3bc1 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:41.207103 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 555/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:41:41 2022] GET /identity/v3/projects/64b3d4ad1d654554b94c72c97041483c => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:41:41.213667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500cc2e8-9ceb-4e47-9a41-6d6a67de308a None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:41.222153 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:41.334807 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500cc2e8-9ceb-4e47-9a41-6d6a67de308a None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:41.371432 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef715e2e-8ade-46db-8a6d-953d0f35e2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:41.372091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef715e2e-8ade-46db-8a6d-953d0f35e2a2 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:41.372371 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef715e2e-8ade-46db-8a6d-953d0f35e2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:41.372652 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef715e2e-8ade-46db-8a6d-953d0f35e2a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:41.373492 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef715e2e-8ade-46db-8a6d-953d0f35e2a2 None admin] RBAC: Adding query filter params (role.id=19b4d737ab92430caeb4cd548049bcfc, scope.project.id=64b3d4ad1d654554b94c72c97041483c, user.id=94085ae3735f442984ddaf795ff562b3) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:41.373807 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef715e2e-8ade-46db-8a6d-953d0f35e2a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:41.375282 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef715e2e-8ade-46db-8a6d-953d0f35e2a2 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:41.380919 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 562/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:41:41 2022] GET /identity/v3/role_assignments?user.id=94085ae3735f442984ddaf795ff562b3&scope.project.id=64b3d4ad1d654554b94c72c97041483c&role.id=19b4d737ab92430caeb4cd548049bcfc => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:43.398602 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e23bcf-4a4f-449c-94d4-685f0fed1a1b None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:43.399558 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e23bcf-4a4f-449c-94d4-685f0fed1a1b None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:43.399558 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e23bcf-4a4f-449c-94d4-685f0fed1a1b None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:43.401766 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 556/1118] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:41:43.408103 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce5ab3-cc7a-4ca4-ba1a-b3c175b62256 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:43.408835 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce5ab3-cc7a-4ca4-ba1a-b3c175b62256 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:43.408979 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce5ab3-cc7a-4ca4-ba1a-b3c175b62256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:43.433073 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-d4ce5ab3-cc7a-4ca4-ba1a-b3c175b62256 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:43.434256 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-d4ce5ab3-cc7a-4ca4-ba1a-b3c175b62256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:43.502933 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:43.508635 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 563/1119] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:41:43.531320 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e23bcf-4a4f-449c-94d4-685f0fed1a1b None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:43.642347 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e23bcf-4a4f-449c-94d4-685f0fed1a1b None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:43.678150 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd3c0d-d62c-4ece-be11-27441a56f700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:43.679013 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd3c0d-d62c-4ece-be11-27441a56f700 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:43.679331 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd3c0d-d62c-4ece-be11-27441a56f700 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:43.679602 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd3c0d-d62c-4ece-be11-27441a56f700 None admin] PATH_INFO: `/v3/roles/19b4d737ab92430caeb4cd548049bcfc` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:43.681117 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd3c0d-d62c-4ece-be11-27441a56f700 None admin] RBAC: Authorizing `identity:get_role(role_id=19b4d737ab92430caeb4cd548049bcfc)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:43.682487 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd3c0d-d62c-4ece-be11-27441a56f700 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:43.683903 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 557/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:41:43 2022] GET /identity/v3/roles/19b4d737ab92430caeb4cd548049bcfc => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:43.690493 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce5ab3-cc7a-4ca4-ba1a-b3c175b62256 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:43.800179 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce5ab3-cc7a-4ca4-ba1a-b3c175b62256 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:43.835271 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e2ec7-6ac6-4bc2-814b-da63c9ba8724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:43.836173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e2ec7-6ac6-4bc2-814b-da63c9ba8724 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:43.836488 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e2ec7-6ac6-4bc2-814b-da63c9ba8724 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:43.836770 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e2ec7-6ac6-4bc2-814b-da63c9ba8724 None admin] PATH_INFO: `/v3/users/94085ae3735f442984ddaf795ff562b3` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:43.838080 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e2ec7-6ac6-4bc2-814b-da63c9ba8724 None admin] RBAC: Authorizing `identity:get_user(user_id=94085ae3735f442984ddaf795ff562b3)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:43.839549 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e2ec7-6ac6-4bc2-814b-da63c9ba8724 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:43.841190 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 564/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:41:43 2022] GET /identity/v3/users/94085ae3735f442984ddaf795ff562b3 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:43.847609 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd3c0d-d62c-4ece-be11-27441a56f700 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:43.901100 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:43.967686 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd3c0d-d62c-4ece-be11-27441a56f700 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:44.003502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9ebda-cb76-4bae-9545-199cd75fbfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:44.004374 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9ebda-cb76-4bae-9545-199cd75fbfc2 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:44.004657 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9ebda-cb76-4bae-9545-199cd75fbfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:44.004955 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9ebda-cb76-4bae-9545-199cd75fbfc2 None admin] PATH_INFO: `/v3/projects/64b3d4ad1d654554b94c72c97041483c` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:44.006201 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9ebda-cb76-4bae-9545-199cd75fbfc2 None admin] RBAC: Authorizing `identity:get_project(project_id=64b3d4ad1d654554b94c72c97041483c)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:44.007689 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9ebda-cb76-4bae-9545-199cd75fbfc2 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:44.009431 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 558/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:41:43 2022] GET /identity/v3/projects/64b3d4ad1d654554b94c72c97041483c => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:44.015885 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e2ec7-6ac6-4bc2-814b-da63c9ba8724 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:44.093897 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:44.130077 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e2ec7-6ac6-4bc2-814b-da63c9ba8724 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:44.167486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15676991-449b-4335-be40-9a6dbf84eb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:44.168370 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15676991-449b-4335-be40-9a6dbf84eb13 None admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:44.168656 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15676991-449b-4335-be40-9a6dbf84eb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:44.168934 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15676991-449b-4335-be40-9a6dbf84eb13 None admin] PATH_INFO: `/v3/projects/64b3d4ad1d654554b94c72c97041483c/users/94085ae3735f442984ddaf795ff562b3/roles/19b4d737ab92430caeb4cd548049bcfc` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:44.171338 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15676991-449b-4335-be40-9a6dbf84eb13 None admin] RBAC: Authorizing `identity:create_grant(project_id=64b3d4ad1d654554b94c72c97041483c, user_id=94085ae3735f442984ddaf795ff562b3, role_id=19b4d737ab92430caeb4cd548049bcfc)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:44.172783 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15676991-449b-4335-be40-9a6dbf84eb13 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:44.189228 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 565/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 10:41:44 2022] PUT /identity/v3/projects/64b3d4ad1d654554b94c72c97041483c/users/94085ae3735f442984ddaf795ff562b3/roles/19b4d737ab92430caeb4cd548049bcfc => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:41:46.221231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95569e-ccc1-4cac-84f2-a7fc874ba15b None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:46.221817 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95569e-ccc1-4cac-84f2-a7fc874ba15b None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:46.221817 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95569e-ccc1-4cac-84f2-a7fc874ba15b None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:46.223351 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 559/1124] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:41:46.229801 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b38602-78e2-496c-a0b4-7a521b60e342 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:46.230515 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b38602-78e2-496c-a0b4-7a521b60e342 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:46.230670 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b38602-78e2-496c-a0b4-7a521b60e342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:46.252601 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-24b38602-78e2-496c-a0b4-7a521b60e342 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:46.253803 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-24b38602-78e2-496c-a0b4-7a521b60e342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:46.343253 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 566/1125] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:41:46.375530 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95569e-ccc1-4cac-84f2-a7fc874ba15b None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:46.485372 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95569e-ccc1-4cac-84f2-a7fc874ba15b None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:46.503112 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:46.521231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b203db-fc28-40cb-9b91-15ad4184684d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:46.522093 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b203db-fc28-40cb-9b91-15ad4184684d None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:46.522379 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b203db-fc28-40cb-9b91-15ad4184684d None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:46.522660 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b203db-fc28-40cb-9b91-15ad4184684d None admin] PATH_INFO: `/v3/roles/19b4d737ab92430caeb4cd548049bcfc` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:46.524164 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b203db-fc28-40cb-9b91-15ad4184684d None admin] RBAC: Authorizing `identity:get_role(role_id=19b4d737ab92430caeb4cd548049bcfc)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:46.525536 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b203db-fc28-40cb-9b91-15ad4184684d None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:46.526900 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 560/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:41:46 2022] GET /identity/v3/roles/19b4d737ab92430caeb4cd548049bcfc => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:46.532982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b38602-78e2-496c-a0b4-7a521b60e342 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:46.599463 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:46.643710 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b38602-78e2-496c-a0b4-7a521b60e342 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:46.684113 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a11e30-02ae-483b-93ba-509ed833526b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:46.684988 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a11e30-02ae-483b-93ba-509ed833526b None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:46.685272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a11e30-02ae-483b-93ba-509ed833526b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:46.685903 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a11e30-02ae-483b-93ba-509ed833526b None admin] PATH_INFO: `/v3/users/94085ae3735f442984ddaf795ff562b3` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:46.687237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a11e30-02ae-483b-93ba-509ed833526b None admin] RBAC: Authorizing `identity:get_user(user_id=94085ae3735f442984ddaf795ff562b3)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:46.688690 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a11e30-02ae-483b-93ba-509ed833526b None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:46.690324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 567/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:41:46 2022] GET /identity/v3/users/94085ae3735f442984ddaf795ff562b3 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:46.696611 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b203db-fc28-40cb-9b91-15ad4184684d None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:46.803701 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b203db-fc28-40cb-9b91-15ad4184684d None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:46.845243 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384254d9-27df-412d-9615-734873e16e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:46.845886 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384254d9-27df-412d-9615-734873e16e06 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:46.846168 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384254d9-27df-412d-9615-734873e16e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:46.846445 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384254d9-27df-412d-9615-734873e16e06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:46.901397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:46.915996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384254d9-27df-412d-9615-734873e16e06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:46.917440 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384254d9-27df-412d-9615-734873e16e06 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:47.025582 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 561/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:41:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:41:47.035412 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a11e30-02ae-483b-93ba-509ed833526b None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:47.151967 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a11e30-02ae-483b-93ba-509ed833526b None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:47.179119 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:47.189552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f208fe-1d90-4deb-b7be-ef3c4a66fee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:47.190417 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f208fe-1d90-4deb-b7be-ef3c4a66fee4 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:47.190702 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f208fe-1d90-4deb-b7be-ef3c4a66fee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:47.190980 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f208fe-1d90-4deb-b7be-ef3c4a66fee4 None admin] PATH_INFO: `/v3/projects/64b3d4ad1d654554b94c72c97041483c` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:47.192307 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f208fe-1d90-4deb-b7be-ef3c4a66fee4 None admin] RBAC: Authorizing `identity:get_project(project_id=64b3d4ad1d654554b94c72c97041483c)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:47.193754 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f208fe-1d90-4deb-b7be-ef3c4a66fee4 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:47.195500 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 568/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:41:47 2022] GET /identity/v3/projects/64b3d4ad1d654554b94c72c97041483c => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:47.204718 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384254d9-27df-412d-9615-734873e16e06 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:47.293921 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:47.311669 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384254d9-27df-412d-9615-734873e16e06 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:47.348175 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6450d-7626-4425-844e-2e7a95d0e715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:47.348842 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6450d-7626-4425-844e-2e7a95d0e715 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:47.349195 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6450d-7626-4425-844e-2e7a95d0e715 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:47.349474 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6450d-7626-4425-844e-2e7a95d0e715 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:47.350302 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6450d-7626-4425-844e-2e7a95d0e715 None admin] RBAC: Adding query filter params (role.id=19b4d737ab92430caeb4cd548049bcfc, scope.project.id=64b3d4ad1d654554b94c72c97041483c, user.id=94085ae3735f442984ddaf795ff562b3) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:47.350612 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6450d-7626-4425-844e-2e7a95d0e715 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:47.352077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6450d-7626-4425-844e-2e7a95d0e715 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:47.358056 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 562/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:41:47 2022] GET /identity/v3/role_assignments?user.id=94085ae3735f442984ddaf795ff562b3&scope.project.id=64b3d4ad1d654554b94c72c97041483c&role.id=19b4d737ab92430caeb4cd548049bcfc => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:49.386518 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3d17f-0c30-48dd-9d45-487ebbc65385 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:49.387119 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3d17f-0c30-48dd-9d45-487ebbc65385 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:49.387119 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3d17f-0c30-48dd-9d45-487ebbc65385 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:49.388486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 569/1131] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:41:49.395001 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d5474-24da-401b-81d2-90841f900200 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:49.395827 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d5474-24da-401b-81d2-90841f900200 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:49.396300 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d5474-24da-401b-81d2-90841f900200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:49.425298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-7a6d5474-24da-401b-81d2-90841f900200 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:49.427128 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-7a6d5474-24da-401b-81d2-90841f900200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:49.500396 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 563/1132] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:41:49.525691 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3d17f-0c30-48dd-9d45-487ebbc65385 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:49.633684 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3d17f-0c30-48dd-9d45-487ebbc65385 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:49.669035 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a1780-8045-4730-909c-c64dc92da02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:49.669835 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a1780-8045-4730-909c-c64dc92da02c None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:49.670123 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a1780-8045-4730-909c-c64dc92da02c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:49.670392 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a1780-8045-4730-909c-c64dc92da02c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:49.671649 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a1780-8045-4730-909c-c64dc92da02c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:49.673090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a1780-8045-4730-909c-c64dc92da02c None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:49.674715 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 570/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:41:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:49.681064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d5474-24da-401b-81d2-90841f900200 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:49.764970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:49.786965 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d5474-24da-401b-81d2-90841f900200 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:49.820739 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810eadd1-14e9-4338-bfc6-46786b5d2348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:49.821426 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810eadd1-14e9-4338-bfc6-46786b5d2348 None admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:49.821709 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810eadd1-14e9-4338-bfc6-46786b5d2348 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:49.821944 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810eadd1-14e9-4338-bfc6-46786b5d2348 None admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:49.822666 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810eadd1-14e9-4338-bfc6-46786b5d2348 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:49.824127 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810eadd1-14e9-4338-bfc6-46786b5d2348 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:49.851878 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 564/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jun 24 10:41:49 2022] POST /identity/v3/projects => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:41:51.874735 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bad10-d0e0-404e-8c1a-89f888014c9f None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:51.875685 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bad10-d0e0-404e-8c1a-89f888014c9f None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:51.875685 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bad10-d0e0-404e-8c1a-89f888014c9f None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:51.877856 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 571/1135] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:41:51.883309 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f490a0b-cc7a-45e8-910e-c8eb709e2a9d None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:51.883753 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f490a0b-cc7a-45e8-910e-c8eb709e2a9d None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:51.883845 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f490a0b-cc7a-45e8-910e-c8eb709e2a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:51.902222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-3f490a0b-cc7a-45e8-910e-c8eb709e2a9d None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:51.903431 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-3f490a0b-cc7a-45e8-910e-c8eb709e2a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:51.973237 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 565/1136] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:41:51.998277 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934bad10-d0e0-404e-8c1a-89f888014c9f None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:52.064316 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:52.104645 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934bad10-d0e0-404e-8c1a-89f888014c9f None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:52.142372 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e873c8e-274a-46b0-8264-87bc70f6b6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:52.143200 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e873c8e-274a-46b0-8264-87bc70f6b6ad None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:52.143505 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e873c8e-274a-46b0-8264-87bc70f6b6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:52.143730 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e873c8e-274a-46b0-8264-87bc70f6b6ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:52.145033 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e873c8e-274a-46b0-8264-87bc70f6b6ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:52.146688 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e873c8e-274a-46b0-8264-87bc70f6b6ad None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:52.148325 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 572/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:41:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:52.157358 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f490a0b-cc7a-45e8-910e-c8eb709e2a9d None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:52.244903 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:52.286825 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f490a0b-cc7a-45e8-910e-c8eb709e2a9d None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:52.324540 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f3de1-4278-42fa-8837-4cc545739a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:52.325210 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f3de1-4278-42fa-8837-4cc545739a17 None admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:52.325493 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f3de1-4278-42fa-8837-4cc545739a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:52.325774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f3de1-4278-42fa-8837-4cc545739a17 None admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:52.326481 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f3de1-4278-42fa-8837-4cc545739a17 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:52.327963 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f3de1-4278-42fa-8837-4cc545739a17 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:52.356225 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 566/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 10:41:52 2022] POST /identity/v3/users => generated 286 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:41:54.443070 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b417209-e4c2-468c-aa96-f5bd37114737 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:54.443990 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b417209-e4c2-468c-aa96-f5bd37114737 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:54.443990 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b417209-e4c2-468c-aa96-f5bd37114737 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:54.446152 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 573/1139] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:41:54.452466 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2298e-1bd6-4ae0-89e1-b8aa15ab78d2 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:54.452911 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2298e-1bd6-4ae0-89e1-b8aa15ab78d2 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:54.453040 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2298e-1bd6-4ae0-89e1-b8aa15ab78d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:54.473692 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-39c2298e-1bd6-4ae0-89e1-b8aa15ab78d2 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:54.474882 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-39c2298e-1bd6-4ae0-89e1-b8aa15ab78d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:54.555719 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 567/1140] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:41:54.579957 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b417209-e4c2-468c-aa96-f5bd37114737 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:54.704081 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b417209-e4c2-468c-aa96-f5bd37114737 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:54.733559 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:54.744204 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f2f83-be69-44f4-bdcf-39dd80ed3282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:54.745379 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f2f83-be69-44f4-bdcf-39dd80ed3282 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:54.745745 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f2f83-be69-44f4-bdcf-39dd80ed3282 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:54.746176 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f2f83-be69-44f4-bdcf-39dd80ed3282 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:54.761428 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f2f83-be69-44f4-bdcf-39dd80ed3282 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:41:54.768962 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-104f2f83-be69-44f4-bdcf-39dd80ed3282 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:41:54.768962 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:54.768962 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:54.768962 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:54.768962 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:54.768962 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:54.768962 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:54.768962 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:54.768962 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:54.768962 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:54.768962 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:54.768962 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:54.768962 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:41:54.768962 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:41:54.768962 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:41:54.768962 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:41:54.770089 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:41:54.770089 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:41:54.770089 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:41:54.770089 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:41:54.770089 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:54.770089 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:54.770089 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:54.770089 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:54.770089 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:54.770089 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:54.770089 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:54.770089 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:54.770089 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:54.770089 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:54.770089 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:54.770089 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:54.771745 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:54.771745 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:54.771745 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:54.771745 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:54.771745 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:41:54.771745 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:41:54.771745 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:41:54.771745 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:41:54.771745 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:41:54.771745 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:41:54.771745 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:41:54.771745 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:54.775326 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 574/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:41:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:54.777059 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2298e-1bd6-4ae0-89e1-b8aa15ab78d2 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:54.831530 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:54.890738 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2298e-1bd6-4ae0-89e1-b8aa15ab78d2 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:54.927611 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed07d30-ef4e-4005-96f5-93e348777e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:54.928276 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed07d30-ef4e-4005-96f5-93e348777e66 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:54.928595 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed07d30-ef4e-4005-96f5-93e348777e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:54.929351 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed07d30-ef4e-4005-96f5-93e348777e66 None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:54.930114 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed07d30-ef4e-4005-96f5-93e348777e66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:54.930420 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed07d30-ef4e-4005-96f5-93e348777e66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:54.931819 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed07d30-ef4e-4005-96f5-93e348777e66 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:54.940388 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 568/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:41:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:54.946966 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f2f83-be69-44f4-bdcf-39dd80ed3282 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:55.052975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f2f83-be69-44f4-bdcf-39dd80ed3282 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:55.089294 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431c0e0-4742-4421-a75b-2bede3005ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:55.090154 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431c0e0-4742-4421-a75b-2bede3005ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:55.090431 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431c0e0-4742-4421-a75b-2bede3005ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:55.090702 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431c0e0-4742-4421-a75b-2bede3005ba4 None admin] PATH_INFO: `/v3/users/edc8422c155e4b179541f17ed171f208` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:55.104846 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0431c0e0-4742-4421-a75b-2bede3005ba4 None admin] RBAC: Authorizing `identity:get_user(user_id=edc8422c155e4b179541f17ed171f208)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:55.106273 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0431c0e0-4742-4421-a75b-2bede3005ba4 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:55.107916 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 575/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:41:54 2022] GET /identity/v3/users/edc8422c155e4b179541f17ed171f208 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:55.113884 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed07d30-ef4e-4005-96f5-93e348777e66 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:55.226406 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed07d30-ef4e-4005-96f5-93e348777e66 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:55.238040 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:55.264813 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a497f-3ffc-4aac-8f2b-a26ce3aad7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:55.265462 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a497f-3ffc-4aac-8f2b-a26ce3aad7da None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:55.265750 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a497f-3ffc-4aac-8f2b-a26ce3aad7da None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:55.266032 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a497f-3ffc-4aac-8f2b-a26ce3aad7da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:55.337171 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a497f-3ffc-4aac-8f2b-a26ce3aad7da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:55.338554 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a497f-3ffc-4aac-8f2b-a26ce3aad7da None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:55.443385 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 569/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:41:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:41:55.453726 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431c0e0-4742-4421-a75b-2bede3005ba4 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:55.510855 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:55.565853 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431c0e0-4742-4421-a75b-2bede3005ba4 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:55.617867 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdabfaf2-5111-48c5-8f1a-204f79242194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:55.618734 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabfaf2-5111-48c5-8f1a-204f79242194 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:55.619043 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabfaf2-5111-48c5-8f1a-204f79242194 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:55.619336 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabfaf2-5111-48c5-8f1a-204f79242194 None admin] PATH_INFO: `/v3/projects/8b40c641c2324017966c4c7500ee5602` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:55.620640 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdabfaf2-5111-48c5-8f1a-204f79242194 None admin] RBAC: Authorizing `identity:get_project(project_id=8b40c641c2324017966c4c7500ee5602)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:55.622086 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdabfaf2-5111-48c5-8f1a-204f79242194 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:55.623844 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 576/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:41:55 2022] GET /identity/v3/projects/8b40c641c2324017966c4c7500ee5602 => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:55.630222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a497f-3ffc-4aac-8f2b-a26ce3aad7da None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:55.642738 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:55.751335 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a497f-3ffc-4aac-8f2b-a26ce3aad7da None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:55.789023 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c9196-db91-4f05-81e2-7360bfe32c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:55.789682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c9196-db91-4f05-81e2-7360bfe32c77 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:55.789967 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c9196-db91-4f05-81e2-7360bfe32c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:55.790238 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c9196-db91-4f05-81e2-7360bfe32c77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:55.791086 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c9196-db91-4f05-81e2-7360bfe32c77 None admin] RBAC: Adding query filter params (role.id=4867b69c45554ce18e23167c05a02175, scope.project.id=8b40c641c2324017966c4c7500ee5602, user.id=edc8422c155e4b179541f17ed171f208) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:55.791419 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c9196-db91-4f05-81e2-7360bfe32c77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:55.792875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c9196-db91-4f05-81e2-7360bfe32c77 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:55.798492 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 570/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:41:55 2022] GET /identity/v3/role_assignments?user.id=edc8422c155e4b179541f17ed171f208&scope.project.id=8b40c641c2324017966c4c7500ee5602&role.id=4867b69c45554ce18e23167c05a02175 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:57.795284 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928f476-c848-45a7-8bcc-dccd3e81d4e6 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:57.796164 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928f476-c848-45a7-8bcc-dccd3e81d4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:57.796164 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928f476-c848-45a7-8bcc-dccd3e81d4e6 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:57.798497 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 577/1147] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:41:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:41:57.804994 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a49914-2976-46ff-b251-e596a868f88d None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:57.805422 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a49914-2976-46ff-b251-e596a868f88d None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:57.805545 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a49914-2976-46ff-b251-e596a868f88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:57.829114 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-66a49914-2976-46ff-b251-e596a868f88d None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:57.830293 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-66a49914-2976-46ff-b251-e596a868f88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:57.901800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 571/1148] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:41:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:41:57.924761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928f476-c848-45a7-8bcc-dccd3e81d4e6 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:58.037880 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928f476-c848-45a7-8bcc-dccd3e81d4e6 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:58.056215 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:58.085350 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6baa17-35e7-4fbf-93ea-20cde7dd7db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:58.086150 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6baa17-35e7-4fbf-93ea-20cde7dd7db8 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:58.086431 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6baa17-35e7-4fbf-93ea-20cde7dd7db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:58.086700 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6baa17-35e7-4fbf-93ea-20cde7dd7db8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:58.097383 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6baa17-35e7-4fbf-93ea-20cde7dd7db8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:41:58.104878 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-9e6baa17-35e7-4fbf-93ea-20cde7dd7db8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:41:58.104878 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:41:58.104878 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:41:58.104878 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:41:58.104878 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:41:58.104878 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:41:58.104878 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:41:58.104878 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:41:58.104878 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:41:58.104878 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:41:58.104878 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:41:58.104878 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:41:58.104878 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:41:58.104878 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:41:58.104878 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:41:58.104878 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:41:58.105901 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:41:58.105901 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:41:58.105901 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:41:58.105901 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:41:58.105901 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:41:58.105901 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:41:58.105901 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:41:58.105901 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:41:58.105901 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:41:58.105901 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:41:58.105901 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:41:58.105901 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:41:58.105901 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:41:58.105901 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:41:58.105901 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:41:58.105901 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:41:58.106913 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:41:58.106913 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:41:58.106913 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:41:58.106913 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:41:58.106913 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:41:58.106913 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:41:58.106913 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:41:58.106913 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:41:58.106913 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:41:58.106913 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:41:58.106913 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:41:58.106913 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:41:58.106913 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 578/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:41:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:41:58.112372 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a49914-2976-46ff-b251-e596a868f88d None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:58.115555 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:58.215713 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a49914-2976-46ff-b251-e596a868f88d None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:58.254228 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75b30c-f85b-43a4-a6e0-3d0b041a3094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:58.254897 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75b30c-f85b-43a4-a6e0-3d0b041a3094 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:58.255192 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75b30c-f85b-43a4-a6e0-3d0b041a3094 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:58.255476 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75b30c-f85b-43a4-a6e0-3d0b041a3094 None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:58.256220 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75b30c-f85b-43a4-a6e0-3d0b041a3094 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:58.256558 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75b30c-f85b-43a4-a6e0-3d0b041a3094 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:58.258058 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75b30c-f85b-43a4-a6e0-3d0b041a3094 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:58.266439 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 572/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:41:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:58.274671 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6baa17-35e7-4fbf-93ea-20cde7dd7db8 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:58.377490 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6baa17-35e7-4fbf-93ea-20cde7dd7db8 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:58.413652 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679a9de-748e-4824-8e88-2e9f3ecf22fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:58.414519 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679a9de-748e-4824-8e88-2e9f3ecf22fe None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:58.414791 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679a9de-748e-4824-8e88-2e9f3ecf22fe None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:58.415063 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679a9de-748e-4824-8e88-2e9f3ecf22fe None admin] PATH_INFO: `/v3/users/edc8422c155e4b179541f17ed171f208` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:58.416392 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679a9de-748e-4824-8e88-2e9f3ecf22fe None admin] RBAC: Authorizing `identity:get_user(user_id=edc8422c155e4b179541f17ed171f208)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:58.417824 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679a9de-748e-4824-8e88-2e9f3ecf22fe None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:58.419476 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 579/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:41:58 2022] GET /identity/v3/users/edc8422c155e4b179541f17ed171f208 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:58.425621 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75b30c-f85b-43a4-a6e0-3d0b041a3094 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:58.492444 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:58.544031 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75b30c-f85b-43a4-a6e0-3d0b041a3094 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:58.579536 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8034c68-7205-41f0-b29a-0ed2ae1792d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:58.580392 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8034c68-7205-41f0-b29a-0ed2ae1792d9 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:58.580675 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8034c68-7205-41f0-b29a-0ed2ae1792d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:58.580945 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8034c68-7205-41f0-b29a-0ed2ae1792d9 None admin] PATH_INFO: `/v3/projects/8b40c641c2324017966c4c7500ee5602` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:58.582172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8034c68-7205-41f0-b29a-0ed2ae1792d9 None admin] RBAC: Authorizing `identity:get_project(project_id=8b40c641c2324017966c4c7500ee5602)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:58.583648 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8034c68-7205-41f0-b29a-0ed2ae1792d9 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:58.585697 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 573/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:41:58 2022] GET /identity/v3/projects/8b40c641c2324017966c4c7500ee5602 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:58.591962 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679a9de-748e-4824-8e88-2e9f3ecf22fe None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:58.648111 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:58.705209 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679a9de-748e-4824-8e88-2e9f3ecf22fe None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:58.740634 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910c975-b9aa-4998-9815-3a591c23f8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:58.741574 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910c975-b9aa-4998-9815-3a591c23f8cc None admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:58.741862 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910c975-b9aa-4998-9815-3a591c23f8cc None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:58.742141 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910c975-b9aa-4998-9815-3a591c23f8cc None admin] PATH_INFO: `/v3/projects/8b40c641c2324017966c4c7500ee5602/users/edc8422c155e4b179541f17ed171f208/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:58.744475 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910c975-b9aa-4998-9815-3a591c23f8cc None admin] RBAC: Authorizing `identity:create_grant(project_id=8b40c641c2324017966c4c7500ee5602, user_id=edc8422c155e4b179541f17ed171f208, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:58.745865 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910c975-b9aa-4998-9815-3a591c23f8cc None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:58.762905 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 580/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 10:41:58 2022] PUT /identity/v3/projects/8b40c641c2324017966c4c7500ee5602/users/edc8422c155e4b179541f17ed171f208/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:00.799065 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a45e26-4bf5-4251-a42c-26bcc8e2b6a1 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:00.799651 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a45e26-4bf5-4251-a42c-26bcc8e2b6a1 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:00.799651 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a45e26-4bf5-4251-a42c-26bcc8e2b6a1 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:00.801003 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 574/1154] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:42:00.807962 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e492aec-83c8-4bc5-bc99-c6ae94e41c70 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:00.808686 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e492aec-83c8-4bc5-bc99-c6ae94e41c70 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:00.808857 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e492aec-83c8-4bc5-bc99-c6ae94e41c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:00.832147 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-5e492aec-83c8-4bc5-bc99-c6ae94e41c70 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:00.833357 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5e492aec-83c8-4bc5-bc99-c6ae94e41c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:00.916360 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 581/1155] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:42:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:42:00.940758 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a45e26-4bf5-4251-a42c-26bcc8e2b6a1 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:01.047241 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a45e26-4bf5-4251-a42c-26bcc8e2b6a1 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:01.082758 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625ab4a-9371-43d2-9d5a-56b897911dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:01.083587 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625ab4a-9371-43d2-9d5a-56b897911dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:01.083879 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625ab4a-9371-43d2-9d5a-56b897911dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:01.084152 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625ab4a-9371-43d2-9d5a-56b897911dd4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:01.086400 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:01.096521 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625ab4a-9371-43d2-9d5a-56b897911dd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:42:01.104143 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-3625ab4a-9371-43d2-9d5a-56b897911dd4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:42:01.104143 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:42:01.104143 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:42:01.104143 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:42:01.104143 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:42:01.104143 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:42:01.104143 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:42:01.104143 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:42:01.104143 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:42:01.104143 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:42:01.104143 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:42:01.104143 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:42:01.104143 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:42:01.104143 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:42:01.104143 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:42:01.104143 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:42:01.105215 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:42:01.105215 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:42:01.105215 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:42:01.105215 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:42:01.105215 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:42:01.105215 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:42:01.105215 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:42:01.105215 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:42:01.105215 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:42:01.105215 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:42:01.105215 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:42:01.105215 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:42:01.105215 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:42:01.105215 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:42:01.105215 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:42:01.105215 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:42:01.106103 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:42:01.106103 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:42:01.106103 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:42:01.106103 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:42:01.106103 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:42:01.106103 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:42:01.106103 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:42:01.106103 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:42:01.106103 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:42:01.106103 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:42:01.106103 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:42:01.106103 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:42:01.106103 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 575/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:42:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:42:01.114235 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e492aec-83c8-4bc5-bc99-c6ae94e41c70 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:01.149752 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:01.240479 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e492aec-83c8-4bc5-bc99-c6ae94e41c70 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:01.278539 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5963206-0193-4645-8d44-55746d068435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:01.279207 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5963206-0193-4645-8d44-55746d068435 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:01.279515 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5963206-0193-4645-8d44-55746d068435 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:01.279793 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5963206-0193-4645-8d44-55746d068435 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:01.280547 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5963206-0193-4645-8d44-55746d068435 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:42:01.280857 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5963206-0193-4645-8d44-55746d068435 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:01.282243 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5963206-0193-4645-8d44-55746d068435 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:01.292387 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 582/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:42:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:42:01.298560 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625ab4a-9371-43d2-9d5a-56b897911dd4 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:01.400645 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625ab4a-9371-43d2-9d5a-56b897911dd4 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:01.440060 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fbefb-6d4a-44fc-9c5e-e1e99405de0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:01.440920 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fbefb-6d4a-44fc-9c5e-e1e99405de0c None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:01.441203 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fbefb-6d4a-44fc-9c5e-e1e99405de0c None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:01.441479 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fbefb-6d4a-44fc-9c5e-e1e99405de0c None admin] PATH_INFO: `/v3/users/edc8422c155e4b179541f17ed171f208` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:01.442767 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0fbefb-6d4a-44fc-9c5e-e1e99405de0c None admin] RBAC: Authorizing `identity:get_user(user_id=edc8422c155e4b179541f17ed171f208)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:01.444322 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0fbefb-6d4a-44fc-9c5e-e1e99405de0c None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:01.445940 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 576/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:42:01 2022] GET /identity/v3/users/edc8422c155e4b179541f17ed171f208 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:42:01.451931 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5963206-0193-4645-8d44-55746d068435 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:01.555903 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:01.562665 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5963206-0193-4645-8d44-55746d068435 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:01.597635 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092bf93-0d6b-4255-a003-40ee4acc3231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:01.598279 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092bf93-0d6b-4255-a003-40ee4acc3231 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:01.598559 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092bf93-0d6b-4255-a003-40ee4acc3231 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:01.598839 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092bf93-0d6b-4255-a003-40ee4acc3231 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:01.676057 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092bf93-0d6b-4255-a003-40ee4acc3231 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:01.677519 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092bf93-0d6b-4255-a003-40ee4acc3231 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:01.770361 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:01.778323 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 583/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:42:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 10:42:01.785233 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fbefb-6d4a-44fc-9c5e-e1e99405de0c None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:01.856337 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:01.900843 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fbefb-6d4a-44fc-9c5e-e1e99405de0c None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:01.940057 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95b203-eeca-4c02-a0ce-17ddf98752bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:01.941316 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95b203-eeca-4c02-a0ce-17ddf98752bd None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:01.941698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95b203-eeca-4c02-a0ce-17ddf98752bd None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:01.942061 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95b203-eeca-4c02-a0ce-17ddf98752bd None admin] PATH_INFO: `/v3/projects/8b40c641c2324017966c4c7500ee5602` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:01.944243 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95b203-eeca-4c02-a0ce-17ddf98752bd None admin] RBAC: Authorizing `identity:get_project(project_id=8b40c641c2324017966c4c7500ee5602)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:01.946592 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95b203-eeca-4c02-a0ce-17ddf98752bd None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:01.949332 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 577/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:42:01 2022] GET /identity/v3/projects/8b40c641c2324017966c4c7500ee5602 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:42:01.959533 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092bf93-0d6b-4255-a003-40ee4acc3231 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:02.065551 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092bf93-0d6b-4255-a003-40ee4acc3231 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:02.101091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92338706-6fc3-4088-b6cf-cdef47707290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:02.101740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92338706-6fc3-4088-b6cf-cdef47707290 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:02.102022 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92338706-6fc3-4088-b6cf-cdef47707290 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:02.102297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92338706-6fc3-4088-b6cf-cdef47707290 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:02.103116 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92338706-6fc3-4088-b6cf-cdef47707290 None admin] RBAC: Adding query filter params (role.id=4867b69c45554ce18e23167c05a02175, scope.project.id=8b40c641c2324017966c4c7500ee5602, user.id=edc8422c155e4b179541f17ed171f208) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:42:02.103463 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92338706-6fc3-4088-b6cf-cdef47707290 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:02.104885 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92338706-6fc3-4088-b6cf-cdef47707290 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:02.111005 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 584/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:42:01 2022] GET /identity/v3/role_assignments?user.id=edc8422c155e4b179541f17ed171f208&scope.project.id=8b40c641c2324017966c4c7500ee5602&role.id=4867b69c45554ce18e23167c05a02175 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:42:04.136281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e5bed-b518-41ab-8697-9f8218d630c3 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:04.137119 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e5bed-b518-41ab-8697-9f8218d630c3 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:04.137119 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e5bed-b518-41ab-8697-9f8218d630c3 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:04.139386 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 578/1162] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:42:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:42:04.147979 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155762b5-e5fa-4ba8-be08-b3cfab21fab2 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:04.148400 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155762b5-e5fa-4ba8-be08-b3cfab21fab2 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:04.148491 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155762b5-e5fa-4ba8-be08-b3cfab21fab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:04.167241 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-155762b5-e5fa-4ba8-be08-b3cfab21fab2 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:04.168431 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-155762b5-e5fa-4ba8-be08-b3cfab21fab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:04.228485 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:04.240331 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 585/1163] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:42:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:42:04.263004 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e5bed-b518-41ab-8697-9f8218d630c3 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:04.366021 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e5bed-b518-41ab-8697-9f8218d630c3 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:04.395716 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:04.402807 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af07d24-2d55-474a-ad55-b30d6a2205d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:04.403506 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af07d24-2d55-474a-ad55-b30d6a2205d9 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:04.403791 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af07d24-2d55-474a-ad55-b30d6a2205d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:04.404056 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af07d24-2d55-474a-ad55-b30d6a2205d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:04.473253 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af07d24-2d55-474a-ad55-b30d6a2205d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:04.474695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af07d24-2d55-474a-ad55-b30d6a2205d9 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:04.583450 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 579/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:42:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:42:04.590036 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155762b5-e5fa-4ba8-be08-b3cfab21fab2 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:04.697251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155762b5-e5fa-4ba8-be08-b3cfab21fab2 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:04.732781 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d890a57-87fc-4956-97c3-8535e05f41ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:04.733584 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d890a57-87fc-4956-97c3-8535e05f41ab None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:04.733870 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d890a57-87fc-4956-97c3-8535e05f41ab None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:04.734145 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d890a57-87fc-4956-97c3-8535e05f41ab None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:04.741322 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d890a57-87fc-4956-97c3-8535e05f41ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:04.742763 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d890a57-87fc-4956-97c3-8535e05f41ab None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:04.757068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-8d890a57-87fc-4956-97c3-8535e05f41ab None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 24 10:42:04.757068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:42:04.757068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 24 10:42:04.757068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 24 10:42:04.757068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:42:04.757068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:42:04.757068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:42:04.757068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:42:04.757068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 24 10:42:04.757068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:42:04.757068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:42:04.757068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:42:04.757068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:42:04.757068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:42:04.757068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:42:04.757068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:42:04.757068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:42:04.758241 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:42:04.758241 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:42:04.758241 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:42:04.758241 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:42:04.758241 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:42:04.758241 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:42:04.758241 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:42:04.758241 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:42:04.758241 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:42:04.758241 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:42:04.758241 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:42:04.758241 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:42:04.758241 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:42:04.758241 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:42:04.758241 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:42:04.758241 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:42:04.759281 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:42:04.759281 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:42:04.759281 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:42:04.759281 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:42:04.759281 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:42:04.759281 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:42:04.759281 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:42:04.759281 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:42:04.759281 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:42:04.759281 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:42:04.759281 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 24 10:42:04.759281 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:42:04.759281 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 24 10:42:04.759281 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:42:04.763179 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 586/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jun 24 10:42:04 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:42:04.764416 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af07d24-2d55-474a-ad55-b30d6a2205d9 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:04.795387 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:04.871989 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af07d24-2d55-474a-ad55-b30d6a2205d9 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:04.908022 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0640f1-7b17-4b4f-b226-47e1fbf18845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:04.908619 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0640f1-7b17-4b4f-b226-47e1fbf18845 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:04.908904 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0640f1-7b17-4b4f-b226-47e1fbf18845 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:04.909182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0640f1-7b17-4b4f-b226-47e1fbf18845 None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:04.909904 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0640f1-7b17-4b4f-b226-47e1fbf18845 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:42:04.910209 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0640f1-7b17-4b4f-b226-47e1fbf18845 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:04.911637 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0640f1-7b17-4b4f-b226-47e1fbf18845 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:04.919071 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 580/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Fri Jun 24 10:42:04 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:42:06.906089 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bd350-c66d-4713-b5f0-632cc32aa7d8 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:06.906619 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bd350-c66d-4713-b5f0-632cc32aa7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:06.906619 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bd350-c66d-4713-b5f0-632cc32aa7d8 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:06.907958 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 587/1167] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:42:06.913731 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad4e5c-1930-4367-ad2a-02f89e6793b6 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:06.914157 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad4e5c-1930-4367-ad2a-02f89e6793b6 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:06.914276 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad4e5c-1930-4367-ad2a-02f89e6793b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:06.932093 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-f3ad4e5c-1930-4367-ad2a-02f89e6793b6 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:06.933292 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-f3ad4e5c-1930-4367-ad2a-02f89e6793b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:07.019564 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 581/1168] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:42:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:42:07.043118 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bd350-c66d-4713-b5f0-632cc32aa7d8 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:07.102026 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:07.156970 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bd350-c66d-4713-b5f0-632cc32aa7d8 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:07.192329 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234762e4-c3f8-4faf-a50f-9ed53e5a2e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:07.192982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234762e4-c3f8-4faf-a50f-9ed53e5a2e72 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:07.193270 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234762e4-c3f8-4faf-a50f-9ed53e5a2e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:07.193548 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234762e4-c3f8-4faf-a50f-9ed53e5a2e72 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:07.194352 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234762e4-c3f8-4faf-a50f-9ed53e5a2e72 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:07.195781 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234762e4-c3f8-4faf-a50f-9ed53e5a2e72 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:07.214286 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 588/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Fri Jun 24 10:42:07 2022] POST /identity/v3/domains => generated 267 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:42:09.248564 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc680f-3f6c-4155-9c34-11a5bd643e9e None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:09.249126 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc680f-3f6c-4155-9c34-11a5bd643e9e None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:09.249126 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc680f-3f6c-4155-9c34-11a5bd643e9e None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:09.250512 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 582/1170] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:42:09.256912 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c301d6-9b11-4201-b9f2-0510610cccd4 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:09.257676 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c301d6-9b11-4201-b9f2-0510610cccd4 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:09.258030 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c301d6-9b11-4201-b9f2-0510610cccd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:09.287787 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-97c301d6-9b11-4201-b9f2-0510610cccd4 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:09.289351 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-97c301d6-9b11-4201-b9f2-0510610cccd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:09.361492 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 589/1171] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:42:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:42:09.396611 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc680f-3f6c-4155-9c34-11a5bd643e9e None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:09.425177 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:09.521928 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc680f-3f6c-4155-9c34-11a5bd643e9e None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:09.560883 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5062cc-d6b9-4e1e-9a87-6c2543ca13c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:09.561759 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5062cc-d6b9-4e1e-9a87-6c2543ca13c4 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:09.562037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5062cc-d6b9-4e1e-9a87-6c2543ca13c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:09.562315 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5062cc-d6b9-4e1e-9a87-6c2543ca13c4 None admin] PATH_INFO: `/v3/domains/43b13a27f51e4112ada79d2aea155568` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:09.573414 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5062cc-d6b9-4e1e-9a87-6c2543ca13c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=43b13a27f51e4112ada79d2aea155568)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:09.574872 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5062cc-d6b9-4e1e-9a87-6c2543ca13c4 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:09.576538 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 583/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Fri Jun 24 10:42:09 2022] GET /identity/v3/domains/43b13a27f51e4112ada79d2aea155568 => generated 267 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:42:09.585663 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c301d6-9b11-4201-b9f2-0510610cccd4 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:09.634585 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:09.697292 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c301d6-9b11-4201-b9f2-0510610cccd4 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:09.734112 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c34493-0b7a-4528-87e9-63a779b6a784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:09.734763 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c34493-0b7a-4528-87e9-63a779b6a784 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:09.735045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c34493-0b7a-4528-87e9-63a779b6a784 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:09.735348 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c34493-0b7a-4528-87e9-63a779b6a784 None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:09.736068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c34493-0b7a-4528-87e9-63a779b6a784 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:09.737499 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c34493-0b7a-4528-87e9-63a779b6a784 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:09.765271 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 590/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jun 24 10:42:09 2022] POST /identity/v3/projects => generated 361 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:42:11.856879 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01aaae-bdcc-4b4b-8942-eaf4a52f5243 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:11.857807 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01aaae-bdcc-4b4b-8942-eaf4a52f5243 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:11.857807 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01aaae-bdcc-4b4b-8942-eaf4a52f5243 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:11.859970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 584/1174] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:42:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:42:11.868577 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bae8d-a880-4172-8cc2-51fa0f1d738d None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:11.869302 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bae8d-a880-4172-8cc2-51fa0f1d738d None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:11.869399 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bae8d-a880-4172-8cc2-51fa0f1d738d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:11.896941 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-bc7bae8d-a880-4172-8cc2-51fa0f1d738d None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:11.898155 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-bc7bae8d-a880-4172-8cc2-51fa0f1d738d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:11.977340 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 591/1175] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:42:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:42:12.000726 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01aaae-bdcc-4b4b-8942-eaf4a52f5243 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:12.090243 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:12.108755 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01aaae-bdcc-4b4b-8942-eaf4a52f5243 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:12.143366 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64268a-a500-48af-9d69-5b28c83400f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:12.144243 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64268a-a500-48af-9d69-5b28c83400f3 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:12.144522 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64268a-a500-48af-9d69-5b28c83400f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:12.144800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64268a-a500-48af-9d69-5b28c83400f3 None admin] PATH_INFO: `/v3/domains/43b13a27f51e4112ada79d2aea155568` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:12.146016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64268a-a500-48af-9d69-5b28c83400f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=43b13a27f51e4112ada79d2aea155568)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:12.147595 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64268a-a500-48af-9d69-5b28c83400f3 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:12.149224 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 585/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Fri Jun 24 10:42:11 2022] GET /identity/v3/domains/43b13a27f51e4112ada79d2aea155568 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:42:12.155429 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bae8d-a880-4172-8cc2-51fa0f1d738d None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:12.180320 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:12.258653 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bae8d-a880-4172-8cc2-51fa0f1d738d None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:12.299683 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40165c-d0d9-4b90-8719-0661a3f8f9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:12.300716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40165c-d0d9-4b90-8719-0661a3f8f9dc None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:12.301139 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40165c-d0d9-4b90-8719-0661a3f8f9dc None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:12.301573 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40165c-d0d9-4b90-8719-0661a3f8f9dc None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:12.302704 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40165c-d0d9-4b90-8719-0661a3f8f9dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:12.304581 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40165c-d0d9-4b90-8719-0661a3f8f9dc None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:12.327905 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 592/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 10:42:12 2022] POST /identity/v3/users => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:42:14.385053 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d8fc6-1f77-4603-920e-b07aa9bff48f None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:14.385642 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d8fc6-1f77-4603-920e-b07aa9bff48f None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:14.385642 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d8fc6-1f77-4603-920e-b07aa9bff48f None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:14.386958 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 586/1178] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:42:14.395623 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a33bca-a486-4e34-a1e3-e1e066b6cdc3 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:14.396056 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a33bca-a486-4e34-a1e3-e1e066b6cdc3 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:14.396226 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a33bca-a486-4e34-a1e3-e1e066b6cdc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:14.420345 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-40a33bca-a486-4e34-a1e3-e1e066b6cdc3 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:14.421533 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-40a33bca-a486-4e34-a1e3-e1e066b6cdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:14.495899 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 593/1179] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:42:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:42:14.520013 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d8fc6-1f77-4603-920e-b07aa9bff48f None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:14.627198 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d8fc6-1f77-4603-920e-b07aa9bff48f None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:14.664980 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d6231-62cd-4829-b853-97bbc8c55b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:14.665794 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d6231-62cd-4829-b853-97bbc8c55b92 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:14.666084 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d6231-62cd-4829-b853-97bbc8c55b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:14.666361 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d6231-62cd-4829-b853-97bbc8c55b92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:14.678429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1d6231-62cd-4829-b853-97bbc8c55b92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:42:14.686359 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-1c1d6231-62cd-4829-b853-97bbc8c55b92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:42:14.686359 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:42:14.686359 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:42:14.686359 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:42:14.686359 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:42:14.686359 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:42:14.686359 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:42:14.686359 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:42:14.686359 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:42:14.686359 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:42:14.686359 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:42:14.686359 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:42:14.686359 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:42:14.686359 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:42:14.686359 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:42:14.686359 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:42:14.687465 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:42:14.687465 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:42:14.687465 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:42:14.687465 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:42:14.687465 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:42:14.687465 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:42:14.687465 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:42:14.687465 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:42:14.687465 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:42:14.687465 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:42:14.687465 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:42:14.687465 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:42:14.687465 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:42:14.687465 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:42:14.687465 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:42:14.687465 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:42:14.688481 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:42:14.688481 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:42:14.688481 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:42:14.688481 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:42:14.688481 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:42:14.688481 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:42:14.688481 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:42:14.688481 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:42:14.688481 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:42:14.688481 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:42:14.688481 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:42:14.688481 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:42:14.688481 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 587/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:42:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:42:14.694011 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a33bca-a486-4e34-a1e3-e1e066b6cdc3 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:14.704732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:14.812856 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a33bca-a486-4e34-a1e3-e1e066b6cdc3 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:14.861026 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266cb14-0c29-469c-bf11-158f563e7d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:14.861968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266cb14-0c29-469c-bf11-158f563e7d94 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:14.862353 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266cb14-0c29-469c-bf11-158f563e7d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:14.862728 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266cb14-0c29-469c-bf11-158f563e7d94 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:14.863912 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266cb14-0c29-469c-bf11-158f563e7d94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:42:14.864326 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266cb14-0c29-469c-bf11-158f563e7d94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:14.866203 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266cb14-0c29-469c-bf11-158f563e7d94 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:14.874363 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 594/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:42:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:42:14.882871 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d6231-62cd-4829-b853-97bbc8c55b92 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:14.898670 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:15.001359 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d6231-62cd-4829-b853-97bbc8c55b92 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:15.042136 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4965b-c1de-4896-9433-19191873795a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:15.043005 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4965b-c1de-4896-9433-19191873795a None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:15.043333 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4965b-c1de-4896-9433-19191873795a None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:15.043611 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4965b-c1de-4896-9433-19191873795a None admin] PATH_INFO: `/v3/users/65082386897846e18c9f991a11d9a7a4` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:15.057325 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a4965b-c1de-4896-9433-19191873795a None admin] RBAC: Authorizing `identity:get_user(user_id=65082386897846e18c9f991a11d9a7a4)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:15.058772 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a4965b-c1de-4896-9433-19191873795a None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:15.060810 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 588/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:42:14 2022] GET /identity/v3/users/65082386897846e18c9f991a11d9a7a4 => generated 311 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:42:15.066850 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266cb14-0c29-469c-bf11-158f563e7d94 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:15.159182 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:15.195116 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266cb14-0c29-469c-bf11-158f563e7d94 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:15.230364 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b3307-e207-4ecb-b16c-ce409bef6097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:15.231016 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b3307-e207-4ecb-b16c-ce409bef6097 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:15.231331 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b3307-e207-4ecb-b16c-ce409bef6097 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:15.231602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b3307-e207-4ecb-b16c-ce409bef6097 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:15.305257 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b3307-e207-4ecb-b16c-ce409bef6097 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:15.306622 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b3307-e207-4ecb-b16c-ce409bef6097 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:15.375248 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:15.412640 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 595/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:42:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:42:15.418706 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4965b-c1de-4896-9433-19191873795a None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:15.508082 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:15.539895 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4965b-c1de-4896-9433-19191873795a None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:15.576540 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc297e2-aa68-44f6-b649-e3f94bb274f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:15.577340 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc297e2-aa68-44f6-b649-e3f94bb274f7 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:15.577621 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc297e2-aa68-44f6-b649-e3f94bb274f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:15.577891 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc297e2-aa68-44f6-b649-e3f94bb274f7 None admin] PATH_INFO: `/v3/projects/1e93d2ada14e4b3fabd686809fbf0f5d` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:15.579204 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc297e2-aa68-44f6-b649-e3f94bb274f7 None admin] RBAC: Authorizing `identity:get_project(project_id=1e93d2ada14e4b3fabd686809fbf0f5d)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:15.580633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc297e2-aa68-44f6-b649-e3f94bb274f7 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:15.582330 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 589/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:42:15 2022] GET /identity/v3/projects/1e93d2ada14e4b3fabd686809fbf0f5d => generated 361 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:42:15.589912 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b3307-e207-4ecb-b16c-ce409bef6097 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:15.702560 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b3307-e207-4ecb-b16c-ce409bef6097 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:15.737856 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712c1a1-e574-4687-bc99-ec112cad6a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:15.738501 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712c1a1-e574-4687-bc99-ec112cad6a9c None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:15.738781 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712c1a1-e574-4687-bc99-ec112cad6a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:15.739053 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712c1a1-e574-4687-bc99-ec112cad6a9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:15.739912 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712c1a1-e574-4687-bc99-ec112cad6a9c None admin] RBAC: Adding query filter params (role.id=4867b69c45554ce18e23167c05a02175, scope.project.id=1e93d2ada14e4b3fabd686809fbf0f5d, user.id=65082386897846e18c9f991a11d9a7a4) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:42:15.740221 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712c1a1-e574-4687-bc99-ec112cad6a9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:15.741721 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712c1a1-e574-4687-bc99-ec112cad6a9c None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:15.747308 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 596/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:42:15 2022] GET /identity/v3/role_assignments?user.id=65082386897846e18c9f991a11d9a7a4&scope.project.id=1e93d2ada14e4b3fabd686809fbf0f5d&role.id=4867b69c45554ce18e23167c05a02175 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:42:17.734528 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e4fa3-7b19-4f08-a8e8-988239db9ed1 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:17.735409 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e4fa3-7b19-4f08-a8e8-988239db9ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:17.735526 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e4fa3-7b19-4f08-a8e8-988239db9ed1 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:17.737652 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 590/1186] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:42:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:42:17.743396 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e622b29-21c2-4c05-9e7a-ac9325e2e72f None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:17.743836 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e622b29-21c2-4c05-9e7a-ac9325e2e72f None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:17.743934 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e622b29-21c2-4c05-9e7a-ac9325e2e72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:17.762519 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-0e622b29-21c2-4c05-9e7a-ac9325e2e72f None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:17.763779 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-0e622b29-21c2-4c05-9e7a-ac9325e2e72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:17.794386 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:17.849198 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 597/1187] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:42:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:42:17.878527 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e4fa3-7b19-4f08-a8e8-988239db9ed1 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:17.991495 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e4fa3-7b19-4f08-a8e8-988239db9ed1 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:18.026453 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a54f2-3beb-4628-adf4-246e236f230a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:18.027283 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a54f2-3beb-4628-adf4-246e236f230a None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:18.027555 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a54f2-3beb-4628-adf4-246e236f230a None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:18.027829 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a54f2-3beb-4628-adf4-246e236f230a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:18.034839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:18.039213 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a54f2-3beb-4628-adf4-246e236f230a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:42:18.047113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-a29a54f2-3beb-4628-adf4-246e236f230a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:42:18.047113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:42:18.047113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:42:18.047113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:42:18.047113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:42:18.047113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:42:18.047113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:42:18.047113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:42:18.047113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:42:18.047113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:42:18.047113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:42:18.047113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:42:18.047113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:42:18.047113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:42:18.047113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:42:18.047113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:42:18.048172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:42:18.048172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:42:18.048172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:42:18.048172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:42:18.048172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:42:18.048172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:42:18.048172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:42:18.048172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:42:18.048172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:42:18.048172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:42:18.048172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:42:18.048172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:42:18.048172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:42:18.048172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:42:18.048172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:42:18.048172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:42:18.049095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:42:18.049095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:42:18.049095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:42:18.049095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:42:18.049095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:42:18.049095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:42:18.049095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:42:18.049095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:42:18.049095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:42:18.049095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:42:18.049095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:42:18.049095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:42:18.049095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 591/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:42:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:42:18.057153 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e622b29-21c2-4c05-9e7a-ac9325e2e72f None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:18.163004 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e622b29-21c2-4c05-9e7a-ac9325e2e72f None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:18.201657 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f357d30-174e-42d2-b328-e8422a7a14bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:18.202324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f357d30-174e-42d2-b328-e8422a7a14bc None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:18.202614 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f357d30-174e-42d2-b328-e8422a7a14bc None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:18.202884 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f357d30-174e-42d2-b328-e8422a7a14bc None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:18.203661 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f357d30-174e-42d2-b328-e8422a7a14bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:42:18.203971 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f357d30-174e-42d2-b328-e8422a7a14bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:18.205341 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f357d30-174e-42d2-b328-e8422a7a14bc None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:18.214478 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 598/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:42:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:42:18.221345 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a54f2-3beb-4628-adf4-246e236f230a None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:18.332387 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a54f2-3beb-4628-adf4-246e236f230a None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:18.367668 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1cbc57-c37b-4e74-82d4-ca6e8bb24d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:18.368547 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cbc57-c37b-4e74-82d4-ca6e8bb24d00 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:18.368830 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cbc57-c37b-4e74-82d4-ca6e8bb24d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:18.369101 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cbc57-c37b-4e74-82d4-ca6e8bb24d00 None admin] PATH_INFO: `/v3/users/65082386897846e18c9f991a11d9a7a4` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:18.370423 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1cbc57-c37b-4e74-82d4-ca6e8bb24d00 None admin] RBAC: Authorizing `identity:get_user(user_id=65082386897846e18c9f991a11d9a7a4)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:18.371901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1cbc57-c37b-4e74-82d4-ca6e8bb24d00 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:18.373517 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 592/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:42:18 2022] GET /identity/v3/users/65082386897846e18c9f991a11d9a7a4 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:42:18.379459 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f357d30-174e-42d2-b328-e8422a7a14bc None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:18.408221 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:18.484952 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f357d30-174e-42d2-b328-e8422a7a14bc None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:18.524329 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e112414-8275-477c-8c4a-8b9a653fb97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:18.525189 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e112414-8275-477c-8c4a-8b9a653fb97e None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:18.525469 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e112414-8275-477c-8c4a-8b9a653fb97e None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:18.525758 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e112414-8275-477c-8c4a-8b9a653fb97e None admin] PATH_INFO: `/v3/projects/1e93d2ada14e4b3fabd686809fbf0f5d` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:18.527058 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e112414-8275-477c-8c4a-8b9a653fb97e None admin] RBAC: Authorizing `identity:get_project(project_id=1e93d2ada14e4b3fabd686809fbf0f5d)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:18.528518 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e112414-8275-477c-8c4a-8b9a653fb97e None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:18.530175 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 599/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:42:18 2022] GET /identity/v3/projects/1e93d2ada14e4b3fabd686809fbf0f5d => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:42:18.536757 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1cbc57-c37b-4e74-82d4-ca6e8bb24d00 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:18.612068 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:18.657898 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1cbc57-c37b-4e74-82d4-ca6e8bb24d00 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:18.695392 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fda9d-10cb-4851-8159-04ea47cdd62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:18.696295 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fda9d-10cb-4851-8159-04ea47cdd62e None admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:18.696576 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fda9d-10cb-4851-8159-04ea47cdd62e None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:18.696848 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fda9d-10cb-4851-8159-04ea47cdd62e None admin] PATH_INFO: `/v3/projects/1e93d2ada14e4b3fabd686809fbf0f5d/users/65082386897846e18c9f991a11d9a7a4/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:18.699104 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248fda9d-10cb-4851-8159-04ea47cdd62e None admin] RBAC: Authorizing `identity:create_grant(project_id=1e93d2ada14e4b3fabd686809fbf0f5d, user_id=65082386897846e18c9f991a11d9a7a4, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:18.700593 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248fda9d-10cb-4851-8159-04ea47cdd62e None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:18.716731 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 593/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 10:42:18 2022] PUT /identity/v3/projects/1e93d2ada14e4b3fabd686809fbf0f5d/users/65082386897846e18c9f991a11d9a7a4/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:20.792183 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea9e9b-33d3-45da-bb67-a749787b814e None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:20.793000 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea9e9b-33d3-45da-bb67-a749787b814e None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:20.793141 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea9e9b-33d3-45da-bb67-a749787b814e None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:20.795220 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 600/1193] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:42:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:42:20.800871 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e187485-34cd-4c1b-86ad-ec9955abe590 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:20.801277 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e187485-34cd-4c1b-86ad-ec9955abe590 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:20.801425 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e187485-34cd-4c1b-86ad-ec9955abe590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:20.826609 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-3e187485-34cd-4c1b-86ad-ec9955abe590 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:20.828529 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-3e187485-34cd-4c1b-86ad-ec9955abe590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:20.902761 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 594/1194] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:42:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:42:20.926995 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea9e9b-33d3-45da-bb67-a749787b814e None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:21.040646 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:21.049978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea9e9b-33d3-45da-bb67-a749787b814e None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:21.087274 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64016d5-4704-47ff-8642-fb10c9dbd50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:21.088067 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64016d5-4704-47ff-8642-fb10c9dbd50f None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:21.088355 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64016d5-4704-47ff-8642-fb10c9dbd50f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:21.088633 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64016d5-4704-47ff-8642-fb10c9dbd50f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:21.099974 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64016d5-4704-47ff-8642-fb10c9dbd50f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:42:21.107580 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-e64016d5-4704-47ff-8642-fb10c9dbd50f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:42:21.107580 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:42:21.107580 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:42:21.107580 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:42:21.107580 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:42:21.107580 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:42:21.107580 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:42:21.107580 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:42:21.107580 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:42:21.107580 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:42:21.107580 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:42:21.107580 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:42:21.107580 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:42:21.107580 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:42:21.107580 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:42:21.107580 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:42:21.108647 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:42:21.108647 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:42:21.108647 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:42:21.108647 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:42:21.108647 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:42:21.108647 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:42:21.108647 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:42:21.108647 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:42:21.108647 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:42:21.108647 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:42:21.108647 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:42:21.108647 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:42:21.108647 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:42:21.108647 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:42:21.108647 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:42:21.108647 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:42:21.109504 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:42:21.109504 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:42:21.109504 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:42:21.109504 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:42:21.109504 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:42:21.109504 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:42:21.109504 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:42:21.109504 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:42:21.109504 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:42:21.109504 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:42:21.109504 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:42:21.109504 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:42:21.109504 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 601/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:42:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:42:21.117472 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e187485-34cd-4c1b-86ad-ec9955abe590 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:21.183435 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:21.232462 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e187485-34cd-4c1b-86ad-ec9955abe590 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:21.267599 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8132b6-3f9e-4685-a2b0-6270966fa30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:21.268262 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8132b6-3f9e-4685-a2b0-6270966fa30c None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:21.268548 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8132b6-3f9e-4685-a2b0-6270966fa30c None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:21.268828 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8132b6-3f9e-4685-a2b0-6270966fa30c None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:21.269575 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8132b6-3f9e-4685-a2b0-6270966fa30c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:42:21.269887 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8132b6-3f9e-4685-a2b0-6270966fa30c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:21.271287 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8132b6-3f9e-4685-a2b0-6270966fa30c None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:21.279523 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 595/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:42:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:42:21.285653 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64016d5-4704-47ff-8642-fb10c9dbd50f None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:21.394516 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64016d5-4704-47ff-8642-fb10c9dbd50f None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:21.430384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f50f2c-562e-41c5-b4ea-4f5204585942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:21.431286 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f50f2c-562e-41c5-b4ea-4f5204585942 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:21.431570 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f50f2c-562e-41c5-b4ea-4f5204585942 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:21.431841 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f50f2c-562e-41c5-b4ea-4f5204585942 None admin] PATH_INFO: `/v3/users/65082386897846e18c9f991a11d9a7a4` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:21.433080 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f50f2c-562e-41c5-b4ea-4f5204585942 None admin] RBAC: Authorizing `identity:get_user(user_id=65082386897846e18c9f991a11d9a7a4)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:21.434936 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f50f2c-562e-41c5-b4ea-4f5204585942 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:21.436538 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 602/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 10:42:21 2022] GET /identity/v3/users/65082386897846e18c9f991a11d9a7a4 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:42:21.442587 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8132b6-3f9e-4685-a2b0-6270966fa30c None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:21.545037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8132b6-3f9e-4685-a2b0-6270966fa30c None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:21.562472 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:21.581814 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ef274-75f7-47ca-80d1-418b5fb8e5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:21.582464 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ef274-75f7-47ca-80d1-418b5fb8e5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:21.582746 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ef274-75f7-47ca-80d1-418b5fb8e5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:21.583027 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ef274-75f7-47ca-80d1-418b5fb8e5d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:21.656987 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ef274-75f7-47ca-80d1-418b5fb8e5d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:21.659303 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ef274-75f7-47ca-80d1-418b5fb8e5d5 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:21.777179 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 596/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:42:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 10:42:21.783981 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f50f2c-562e-41c5-b4ea-4f5204585942 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:21.815824 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:21.896458 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f50f2c-562e-41c5-b4ea-4f5204585942 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:21.933553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691160d-b9f9-4f6f-aec9-821c17d5de42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:21.934780 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691160d-b9f9-4f6f-aec9-821c17d5de42 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:21.935065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691160d-b9f9-4f6f-aec9-821c17d5de42 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:21.935379 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691160d-b9f9-4f6f-aec9-821c17d5de42 None admin] PATH_INFO: `/v3/projects/1e93d2ada14e4b3fabd686809fbf0f5d` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:21.936703 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2691160d-b9f9-4f6f-aec9-821c17d5de42 None admin] RBAC: Authorizing `identity:get_project(project_id=1e93d2ada14e4b3fabd686809fbf0f5d)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:21.938144 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2691160d-b9f9-4f6f-aec9-821c17d5de42 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:21.939861 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 603/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 10:42:21 2022] GET /identity/v3/projects/1e93d2ada14e4b3fabd686809fbf0f5d => generated 361 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:42:21.946324 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ef274-75f7-47ca-80d1-418b5fb8e5d5 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:21.965481 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:22.056405 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ef274-75f7-47ca-80d1-418b5fb8e5d5 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:22.092193 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7aecc2-b7ed-4f3f-819f-cba768794c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:22.092851 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7aecc2-b7ed-4f3f-819f-cba768794c3f None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:22.093135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7aecc2-b7ed-4f3f-819f-cba768794c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:22.093408 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7aecc2-b7ed-4f3f-819f-cba768794c3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:22.094236 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7aecc2-b7ed-4f3f-819f-cba768794c3f None admin] RBAC: Adding query filter params (role.id=4867b69c45554ce18e23167c05a02175, scope.project.id=1e93d2ada14e4b3fabd686809fbf0f5d, user.id=65082386897846e18c9f991a11d9a7a4) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:42:22.094545 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7aecc2-b7ed-4f3f-819f-cba768794c3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:22.096005 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7aecc2-b7ed-4f3f-819f-cba768794c3f None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:22.102051 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 597/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:42:21 2022] GET /identity/v3/role_assignments?user.id=65082386897846e18c9f991a11d9a7a4&scope.project.id=1e93d2ada14e4b3fabd686809fbf0f5d&role.id=4867b69c45554ce18e23167c05a02175 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:42:31.928566 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=55 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:32.099388 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=59 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:17.709932 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde75946-d154-4c6d-b9ba-595ab24f2650 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:17.710560 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde75946-d154-4c6d-b9ba-595ab24f2650 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:17.710560 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde75946-d154-4c6d-b9ba-595ab24f2650 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:17.711978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 604/1201] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:43:17.718234 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e6221-f751-4dfe-b718-d18b1eae9c01 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:17.718733 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e6221-f751-4dfe-b718-d18b1eae9c01 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:17.718833 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e6221-f751-4dfe-b718-d18b1eae9c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:17.742785 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-827e6221-f751-4dfe-b718-d18b1eae9c01 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:17.744500 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-827e6221-f751-4dfe-b718-d18b1eae9c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:17.849161 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 598/1202] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:43:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:43:17.874808 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde75946-d154-4c6d-b9ba-595ab24f2650 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:18.009752 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde75946-d154-4c6d-b9ba-595ab24f2650 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:18.056783 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54969b3-c588-4b91-9c50-37304a44df15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:18.057957 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54969b3-c588-4b91-9c50-37304a44df15 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:18.058244 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54969b3-c588-4b91-9c50-37304a44df15 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:18.058527 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54969b3-c588-4b91-9c50-37304a44df15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:18.073366 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54969b3-c588-4b91-9c50-37304a44df15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:18.074909 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54969b3-c588-4b91-9c50-37304a44df15 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:18.096019 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-f54969b3-c588-4b91-9c50-37304a44df15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:43:18.096019 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:18.096019 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:43:18.096019 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:43:18.096019 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:43:18.096019 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:43:18.096019 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:43:18.096019 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:43:18.096019 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:43:18.096019 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:43:18.096019 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:43:18.096019 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:43:18.096019 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:43:18.096019 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:43:18.096019 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:43:18.097176 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:43:18.097176 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:43:18.097176 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:43:18.097176 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:43:18.097176 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:43:18.097176 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:43:18.097176 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:43:18.097176 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:43:18.097176 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:43:18.097176 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:43:18.097176 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:43:18.097176 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:43:18.097176 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:43:18.097176 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:43:18.097176 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:43:18.097176 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:43:18.097176 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:43:18.101036 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:43:18.101036 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:43:18.101036 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:43:18.101036 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:43:18.101036 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 605/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:43:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:43:18.103920 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e6221-f751-4dfe-b718-d18b1eae9c01 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:18.255498 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e6221-f751-4dfe-b718-d18b1eae9c01 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:18.293090 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:18.299917 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577c4e8-2b7a-4b65-b1dc-fb05c1e9e2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:18.300974 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577c4e8-2b7a-4b65-b1dc-fb05c1e9e2ca None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:18.301259 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577c4e8-2b7a-4b65-b1dc-fb05c1e9e2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:18.301613 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577c4e8-2b7a-4b65-b1dc-fb05c1e9e2ca None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:18.302321 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577c4e8-2b7a-4b65-b1dc-fb05c1e9e2ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:18.302655 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577c4e8-2b7a-4b65-b1dc-fb05c1e9e2ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:18.304801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577c4e8-2b7a-4b65-b1dc-fb05c1e9e2ca None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:18.319020 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 599/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:43:18.325373 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54969b3-c588-4b91-9c50-37304a44df15 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:18.396595 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:18.454050 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54969b3-c588-4b91-9c50-37304a44df15 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:18.503093 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ad594-6c23-451f-91a5-1852f0e975c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:18.504056 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ad594-6c23-451f-91a5-1852f0e975c3 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:18.504325 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ad594-6c23-451f-91a5-1852f0e975c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:18.504599 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ad594-6c23-451f-91a5-1852f0e975c3 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:18.505353 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ad594-6c23-451f-91a5-1852f0e975c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:18.507054 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ad594-6c23-451f-91a5-1852f0e975c3 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:18.532779 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 606/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 10:43:18 2022] POST /identity/v3/users => generated 251 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:43:20.863544 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c77ad9-ab44-4ac8-8c1c-a0d1ccd51858 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:20.864248 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c77ad9-ab44-4ac8-8c1c-a0d1ccd51858 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:20.864248 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c77ad9-ab44-4ac8-8c1c-a0d1ccd51858 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:20.865668 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 600/1206] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:43:20.873345 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97a904-2354-451b-8ea1-7efa4302d7d0 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:20.873345 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97a904-2354-451b-8ea1-7efa4302d7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:20.873345 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97a904-2354-451b-8ea1-7efa4302d7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:20.890904 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-ce97a904-2354-451b-8ea1-7efa4302d7d0 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:20.892308 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-ce97a904-2354-451b-8ea1-7efa4302d7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:20.965327 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 607/1207] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:43:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:43:20.989424 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c77ad9-ab44-4ac8-8c1c-a0d1ccd51858 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:21.115275 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c77ad9-ab44-4ac8-8c1c-a0d1ccd51858 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:21.159878 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63cedd7-ace5-4d29-8129-ef06dee897ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:21.161909 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cedd7-ace5-4d29-8129-ef06dee897ad None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:21.161909 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cedd7-ace5-4d29-8129-ef06dee897ad None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:21.161909 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cedd7-ace5-4d29-8129-ef06dee897ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:21.174843 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63cedd7-ace5-4d29-8129-ef06dee897ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:43:21.183068 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-a63cedd7-ace5-4d29-8129-ef06dee897ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:43:21.183068 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:21.183068 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:43:21.183068 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:43:21.183068 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:43:21.183068 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:43:21.183068 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:43:21.183068 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:43:21.183068 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:43:21.183068 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:43:21.183068 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:43:21.183068 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:43:21.183068 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:43:21.183068 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:43:21.183068 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:43:21.183068 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:43:21.184054 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:43:21.184054 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:43:21.184054 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:43:21.184054 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:43:21.184054 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:43:21.184054 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:43:21.184054 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:43:21.184054 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:43:21.184054 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:43:21.184054 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:43:21.184054 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:43:21.184054 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:43:21.184054 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:43:21.184054 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:43:21.184054 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:43:21.184054 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:43:21.184931 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:43:21.184931 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:43:21.184931 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:43:21.184931 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:43:21.184931 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:43:21.184931 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:43:21.184931 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:43:21.184931 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:43:21.184931 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:43:21.184931 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:43:21.184931 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:43:21.184931 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:43:21.189360 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 601/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 10:43:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:43:21.190397 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97a904-2354-451b-8ea1-7efa4302d7d0 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:21.235266 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:21.301931 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97a904-2354-451b-8ea1-7efa4302d7d0 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:21.343352 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a58e7-b03a-446c-8de0-2e1bebf14a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:21.344131 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a58e7-b03a-446c-8de0-2e1bebf14a54 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:21.344479 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a58e7-b03a-446c-8de0-2e1bebf14a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:21.344818 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a58e7-b03a-446c-8de0-2e1bebf14a54 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:21.345639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a58e7-b03a-446c-8de0-2e1bebf14a54 None admin] RBAC: Adding query filter params (name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:21.346022 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a58e7-b03a-446c-8de0-2e1bebf14a54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:21.347432 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a58e7-b03a-446c-8de0-2e1bebf14a54 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:21.356416 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 608/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 10:43:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:21.362743 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63cedd7-ace5-4d29-8129-ef06dee897ad None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:21.422813 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:21.490336 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63cedd7-ace5-4d29-8129-ef06dee897ad None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:21.530880 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4916ab-21c5-4699-9063-2e10bf24a057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:21.531794 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4916ab-21c5-4699-9063-2e10bf24a057 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:21.532080 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4916ab-21c5-4699-9063-2e10bf24a057 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:21.532380 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4916ab-21c5-4699-9063-2e10bf24a057 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:21.544765 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4916ab-21c5-4699-9063-2e10bf24a057 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:21.546252 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4916ab-21c5-4699-9063-2e10bf24a057 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:21.565698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-be4916ab-21c5-4699-9063-2e10bf24a057 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:43:21.565698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:21.565698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:43:21.565698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:43:21.565698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:43:21.565698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:43:21.565698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:43:21.565698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:43:21.565698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:43:21.565698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:43:21.565698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:43:21.565698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:43:21.565698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:43:21.565698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:43:21.565698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:43:21.567460 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:43:21.567460 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:43:21.567460 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:43:21.567460 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:43:21.567460 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:43:21.567460 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:43:21.567460 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:43:21.567460 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:43:21.567460 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:43:21.567460 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:43:21.567460 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:43:21.567460 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:43:21.567460 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:43:21.567460 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:43:21.567460 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:43:21.567460 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:43:21.567460 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:43:21.569216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:43:21.569216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:43:21.569216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:43:21.569216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:43:21.572669 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 602/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:43:21.573944 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a58e7-b03a-446c-8de0-2e1bebf14a54 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:21.682831 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:21.686242 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a58e7-b03a-446c-8de0-2e1bebf14a54 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:21.722565 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7285bba-ba51-4de9-89aa-3a9c3c697eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:21.723224 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7285bba-ba51-4de9-89aa-3a9c3c697eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:21.723501 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7285bba-ba51-4de9-89aa-3a9c3c697eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:21.723765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7285bba-ba51-4de9-89aa-3a9c3c697eb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:21.724506 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7285bba-ba51-4de9-89aa-3a9c3c697eb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:21.724817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7285bba-ba51-4de9-89aa-3a9c3c697eb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:21.726589 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7285bba-ba51-4de9-89aa-3a9c3c697eb5 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:21.740762 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 609/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:21.746480 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4916ab-21c5-4699-9063-2e10bf24a057 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:21.866941 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4916ab-21c5-4699-9063-2e10bf24a057 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:21.868601 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:21.906968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18aa3c-a404-46d1-942e-9889a348bc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:21.907863 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18aa3c-a404-46d1-942e-9889a348bc9a None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:21.908141 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18aa3c-a404-46d1-942e-9889a348bc9a None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:21.908455 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18aa3c-a404-46d1-942e-9889a348bc9a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:21.917622 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18aa3c-a404-46d1-942e-9889a348bc9a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:21.920080 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18aa3c-a404-46d1-942e-9889a348bc9a None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:21.937815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-4e18aa3c-a404-46d1-942e-9889a348bc9a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 10:43:21.937815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:21.937815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:43:21.937815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:43:21.937815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:43:21.937815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:43:21.937815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:43:21.937815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:43:21.937815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:43:21.937815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:43:21.937815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:43:21.937815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:43:21.937815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:43:21.937815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:43:21.937815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:43:21.937815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:43:21.939222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:43:21.939222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:43:21.939222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:43:21.939222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:43:21.939222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:43:21.939222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:43:21.939222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:43:21.939222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:43:21.939222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:43:21.939222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:43:21.939222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:43:21.939222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:43:21.939222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:43:21.939222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:43:21.939222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:43:21.939222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:43:21.939222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:43:21.939222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:43:21.940224 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:43:21.940224 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:43:21.940224 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:43:21.940224 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:43:21.940224 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:43:21.940224 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:43:21.940224 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:43:21.940224 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:43:21.940224 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 10:43:21.940224 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:43:21.940224 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 603/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:43:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:43:21.945403 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7285bba-ba51-4de9-89aa-3a9c3c697eb5 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:22.058212 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7285bba-ba51-4de9-89aa-3a9c3c697eb5 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:22.094055 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c1444-6089-4fbe-b4b1-292198014083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:22.099174 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c1444-6089-4fbe-b4b1-292198014083 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:22.099174 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c1444-6089-4fbe-b4b1-292198014083 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:22.099174 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c1444-6089-4fbe-b4b1-292198014083 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:22.099174 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c1444-6089-4fbe-b4b1-292198014083 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:22.099174 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c1444-6089-4fbe-b4b1-292198014083 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:22.099174 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c1444-6089-4fbe-b4b1-292198014083 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:22.120478 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 610/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Jun 24 10:43:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:22.126221 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18aa3c-a404-46d1-942e-9889a348bc9a None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:22.257510 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18aa3c-a404-46d1-942e-9889a348bc9a None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:22.298084 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281cefc4-32a9-428b-a959-db10bdde229b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:22.298839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281cefc4-32a9-428b-a959-db10bdde229b None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:22.299611 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281cefc4-32a9-428b-a959-db10bdde229b None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:22.299611 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281cefc4-32a9-428b-a959-db10bdde229b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:22.337075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:22.385014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281cefc4-32a9-428b-a959-db10bdde229b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:22.386909 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281cefc4-32a9-428b-a959-db10bdde229b None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:22.510833 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 604/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:43:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:43:22.517654 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c1444-6089-4fbe-b4b1-292198014083 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:22.537527 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:22.626501 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c1444-6089-4fbe-b4b1-292198014083 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:22.670192 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4bd05-6e85-476c-9da1-c8c4838a8795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:22.671005 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4bd05-6e85-476c-9da1-c8c4838a8795 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:22.671325 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4bd05-6e85-476c-9da1-c8c4838a8795 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:22.671599 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4bd05-6e85-476c-9da1-c8c4838a8795 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:22.683922 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb4bd05-6e85-476c-9da1-c8c4838a8795 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:22.685692 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb4bd05-6e85-476c-9da1-c8c4838a8795 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:22.708975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-8fb4bd05-6e85-476c-9da1-c8c4838a8795 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:43:22.708975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:22.708975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:43:22.708975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:43:22.708975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:43:22.708975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:43:22.708975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:43:22.708975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:43:22.708975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:43:22.708975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:43:22.708975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:43:22.708975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:43:22.708975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:43:22.708975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:43:22.708975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:43:22.711351 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:43:22.711351 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:43:22.711351 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:43:22.711351 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:43:22.711351 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:43:22.711351 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:43:22.711351 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:43:22.711351 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:43:22.711351 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:43:22.711351 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:43:22.711351 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:43:22.711351 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:43:22.711351 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:43:22.711351 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:43:22.711351 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:43:22.711351 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:43:22.711351 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:43:22.712508 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:43:22.712508 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:43:22.712508 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:43:22.712508 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:43:22.712508 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 611/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:43:22.716968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281cefc4-32a9-428b-a959-db10bdde229b None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:22.796087 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:22.851884 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281cefc4-32a9-428b-a959-db10bdde229b None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:22.893086 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbefbdf-2a2c-4724-aaee-191351b426b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:22.894052 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbefbdf-2a2c-4724-aaee-191351b426b6 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:22.894421 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbefbdf-2a2c-4724-aaee-191351b426b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:22.894826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbefbdf-2a2c-4724-aaee-191351b426b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:22.895884 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbefbdf-2a2c-4724-aaee-191351b426b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:22.896469 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbefbdf-2a2c-4724-aaee-191351b426b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:22.898553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbefbdf-2a2c-4724-aaee-191351b426b6 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:22.915506 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 605/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:22.922415 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4bd05-6e85-476c-9da1-c8c4838a8795 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:23.009948 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:23.053936 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4bd05-6e85-476c-9da1-c8c4838a8795 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:23.097274 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4354c-9398-41b4-b2c2-9b70cfa1123c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:23.098322 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4354c-9398-41b4-b2c2-9b70cfa1123c None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:23.098743 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4354c-9398-41b4-b2c2-9b70cfa1123c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:23.099205 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4354c-9398-41b4-b2c2-9b70cfa1123c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:23.107269 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c4354c-9398-41b4-b2c2-9b70cfa1123c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:23.108914 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c4354c-9398-41b4-b2c2-9b70cfa1123c None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:23.127637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-64c4354c-9398-41b4-b2c2-9b70cfa1123c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:43:23.127637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:23.127637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:43:23.127637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:43:23.127637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:43:23.127637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:43:23.127637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:43:23.127637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:43:23.127637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:43:23.127637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:43:23.127637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:43:23.127637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:43:23.127637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:43:23.127637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:43:23.127637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:43:23.128806 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:43:23.128806 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:43:23.128806 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:43:23.128806 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:43:23.128806 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:43:23.128806 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:43:23.128806 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:43:23.128806 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:43:23.128806 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:43:23.128806 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:43:23.128806 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:43:23.128806 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:43:23.128806 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:43:23.128806 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:43:23.128806 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:43:23.128806 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:43:23.128806 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:43:23.134803 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:43:23.134803 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:43:23.134803 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:43:23.134803 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:43:23.134803 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:43:23.134803 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:43:23.134803 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:43:23.134803 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:43:23.134803 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 612/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:43:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:43:23.136328 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbefbdf-2a2c-4724-aaee-191351b426b6 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:23.259539 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbefbdf-2a2c-4724-aaee-191351b426b6 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:23.290119 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:23.305531 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855668e9-0a16-43d0-9b48-231f728f4ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:23.306296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855668e9-0a16-43d0-9b48-231f728f4ddc None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:23.306628 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855668e9-0a16-43d0-9b48-231f728f4ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:23.306928 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855668e9-0a16-43d0-9b48-231f728f4ddc None admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:23.308267 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855668e9-0a16-43d0-9b48-231f728f4ddc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:23.308557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855668e9-0a16-43d0-9b48-231f728f4ddc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:23.310150 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855668e9-0a16-43d0-9b48-231f728f4ddc None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:23.333150 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 606/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:43:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:23.334710 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4354c-9398-41b4-b2c2-9b70cfa1123c None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:23.448079 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4354c-9398-41b4-b2c2-9b70cfa1123c None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:23.480241 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:23.487635 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6809e8-b748-4e8d-a772-56bf1cee55ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:23.488372 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6809e8-b748-4e8d-a772-56bf1cee55ae None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:23.488726 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6809e8-b748-4e8d-a772-56bf1cee55ae None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:23.489070 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6809e8-b748-4e8d-a772-56bf1cee55ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:23.489972 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6809e8-b748-4e8d-a772-56bf1cee55ae None admin] RBAC: Adding query filter params (role.id=7bab53c1ac3d4e04b18c87286e2ab0aa, scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user.id=b365d9dd635e4518a41181649c323062) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:23.490358 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6809e8-b748-4e8d-a772-56bf1cee55ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:23.491956 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6809e8-b748-4e8d-a772-56bf1cee55ae None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:23.503181 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 613/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:43:23 2022] GET /identity/v3/role_assignments?user.id=b365d9dd635e4518a41181649c323062&scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e&role.id=7bab53c1ac3d4e04b18c87286e2ab0aa => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:25.567308 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d04999-68ee-4119-97eb-92ec8920a4f9 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:25.567939 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d04999-68ee-4119-97eb-92ec8920a4f9 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:25.567939 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d04999-68ee-4119-97eb-92ec8920a4f9 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:25.569487 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 607/1220] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:43:25.574922 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e8210-8914-4ac0-9d22-f82ad75f0d00 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:25.575437 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e8210-8914-4ac0-9d22-f82ad75f0d00 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:25.575547 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e8210-8914-4ac0-9d22-f82ad75f0d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:25.593367 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-700e8210-8914-4ac0-9d22-f82ad75f0d00 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:25.594723 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-700e8210-8914-4ac0-9d22-f82ad75f0d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:25.677756 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 614/1221] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:43:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:43:25.702446 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d04999-68ee-4119-97eb-92ec8920a4f9 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:25.815208 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d04999-68ee-4119-97eb-92ec8920a4f9 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:25.854701 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a55c0e-c19a-4d18-8994-27c834cd1a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:25.855758 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a55c0e-c19a-4d18-8994-27c834cd1a40 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:25.856108 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a55c0e-c19a-4d18-8994-27c834cd1a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:25.856443 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a55c0e-c19a-4d18-8994-27c834cd1a40 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:25.869477 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a55c0e-c19a-4d18-8994-27c834cd1a40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:43:25.879094 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-31a55c0e-c19a-4d18-8994-27c834cd1a40 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:43:25.879094 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:25.879094 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:43:25.879094 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:43:25.879094 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:43:25.879094 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:43:25.879094 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:43:25.879094 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:43:25.879094 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:43:25.879094 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:43:25.879094 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:43:25.879094 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:43:25.879094 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:43:25.879094 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:43:25.879094 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:43:25.879094 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:43:25.880253 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:43:25.880253 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:43:25.880253 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:43:25.880253 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:43:25.880253 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:43:25.880253 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:43:25.880253 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:43:25.880253 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:43:25.880253 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:43:25.880253 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:43:25.880253 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:43:25.880253 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:43:25.880253 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:43:25.880253 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:43:25.880253 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:43:25.880253 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:43:25.881774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:43:25.881774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:43:25.881774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:43:25.881774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:43:25.881774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:43:25.881774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:43:25.881774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:43:25.881774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:43:25.881774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:43:25.881774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:43:25.881774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:43:25.881774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:43:25.881774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 608/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 10:43:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:43:25.886952 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e8210-8914-4ac0-9d22-f82ad75f0d00 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:25.993147 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e8210-8914-4ac0-9d22-f82ad75f0d00 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:26.017928 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:26.031013 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def151a8-d62b-48ca-a61f-02f129db0d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:26.031791 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def151a8-d62b-48ca-a61f-02f129db0d70 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:26.032138 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def151a8-d62b-48ca-a61f-02f129db0d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:26.032476 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def151a8-d62b-48ca-a61f-02f129db0d70 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:26.033292 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def151a8-d62b-48ca-a61f-02f129db0d70 None admin] RBAC: Adding query filter params (name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:26.033596 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def151a8-d62b-48ca-a61f-02f129db0d70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:26.034965 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def151a8-d62b-48ca-a61f-02f129db0d70 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:26.043745 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 615/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 10:43:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:26.049661 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a55c0e-c19a-4d18-8994-27c834cd1a40 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:26.097542 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:26.158589 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a55c0e-c19a-4d18-8994-27c834cd1a40 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:26.197837 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db91a0-a833-4a90-977c-657ef50254d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:26.199028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db91a0-a833-4a90-977c-657ef50254d3 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:26.199420 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db91a0-a833-4a90-977c-657ef50254d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:26.199785 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db91a0-a833-4a90-977c-657ef50254d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:26.213015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db91a0-a833-4a90-977c-657ef50254d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:26.214618 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db91a0-a833-4a90-977c-657ef50254d3 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:26.232137 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-02db91a0-a833-4a90-977c-657ef50254d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:43:26.232137 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:26.232137 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:43:26.232137 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:43:26.232137 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:43:26.232137 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:43:26.232137 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:43:26.232137 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:43:26.232137 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:43:26.232137 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:43:26.232137 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:43:26.232137 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:43:26.232137 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:43:26.232137 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:43:26.232137 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:43:26.233310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:43:26.233310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:43:26.233310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:43:26.233310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:43:26.233310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:43:26.233310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:43:26.233310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:43:26.233310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:43:26.233310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:43:26.233310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:43:26.233310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:43:26.233310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:43:26.233310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:43:26.233310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:43:26.233310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:43:26.233310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:43:26.233310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:43:26.234397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:43:26.234397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:43:26.234397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:43:26.234397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:43:26.238314 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 609/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:43:26.239333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def151a8-d62b-48ca-a61f-02f129db0d70 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:26.352958 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def151a8-d62b-48ca-a61f-02f129db0d70 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:26.389747 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691de16-c04d-471d-b46e-9fcb17e2e91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:26.390416 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691de16-c04d-471d-b46e-9fcb17e2e91b None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:26.390698 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691de16-c04d-471d-b46e-9fcb17e2e91b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:26.390972 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691de16-c04d-471d-b46e-9fcb17e2e91b None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:26.391723 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2691de16-c04d-471d-b46e-9fcb17e2e91b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:26.392030 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2691de16-c04d-471d-b46e-9fcb17e2e91b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:26.393390 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2691de16-c04d-471d-b46e-9fcb17e2e91b None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:26.405247 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 616/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:26.411360 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db91a0-a833-4a90-977c-657ef50254d3 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:26.515070 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:26.522565 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db91a0-a833-4a90-977c-657ef50254d3 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:26.557839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f94e4-781d-4d26-b013-79030bbcceff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:26.558660 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f94e4-781d-4d26-b013-79030bbcceff None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:26.558932 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f94e4-781d-4d26-b013-79030bbcceff None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:26.559234 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f94e4-781d-4d26-b013-79030bbcceff None admin] PATH_INFO: `/v3/users/placement` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:26.568783 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f94e4-781d-4d26-b013-79030bbcceff None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:26.570685 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f94e4-781d-4d26-b013-79030bbcceff None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:26.588283 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-229f94e4-781d-4d26-b013-79030bbcceff None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 10:43:26.588283 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:26.588283 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:43:26.588283 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:43:26.588283 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:43:26.588283 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:43:26.588283 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:43:26.588283 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:43:26.588283 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:43:26.588283 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:43:26.588283 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:43:26.588283 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:43:26.588283 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:43:26.588283 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:43:26.588283 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:43:26.588283 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:43:26.589478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:43:26.589478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:43:26.589478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:43:26.589478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:43:26.589478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:43:26.589478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:43:26.589478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:43:26.589478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:43:26.589478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:43:26.589478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:43:26.589478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:43:26.589478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:43:26.589478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:43:26.589478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:43:26.589478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:43:26.589478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:43:26.589478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:43:26.589478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:43:26.595452 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:43:26.595452 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:43:26.595452 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:43:26.595452 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:43:26.595452 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:43:26.595452 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:43:26.595452 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:43:26.595452 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:43:26.595452 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 10:43:26.595452 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:43:26.595452 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 610/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:43:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:43:26.596203 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691de16-c04d-471d-b46e-9fcb17e2e91b None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:26.659072 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:26.731891 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691de16-c04d-471d-b46e-9fcb17e2e91b None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:26.770234 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08cf3ef-1ea5-4381-b290-f45f5248d7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:26.770899 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08cf3ef-1ea5-4381-b290-f45f5248d7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:26.771200 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08cf3ef-1ea5-4381-b290-f45f5248d7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:26.771479 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08cf3ef-1ea5-4381-b290-f45f5248d7f9 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:26.772674 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08cf3ef-1ea5-4381-b290-f45f5248d7f9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:26.772985 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08cf3ef-1ea5-4381-b290-f45f5248d7f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:26.774421 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08cf3ef-1ea5-4381-b290-f45f5248d7f9 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:26.792168 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 617/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Jun 24 10:43:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:26.798056 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f94e4-781d-4d26-b013-79030bbcceff None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:26.910709 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f94e4-781d-4d26-b013-79030bbcceff None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:26.950777 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723723c-69bf-4c74-a05f-f7c7ad2b6733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:26.952050 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723723c-69bf-4c74-a05f-f7c7ad2b6733 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:26.952501 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723723c-69bf-4c74-a05f-f7c7ad2b6733 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:26.952948 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723723c-69bf-4c74-a05f-f7c7ad2b6733 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:26.965035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723723c-69bf-4c74-a05f-f7c7ad2b6733 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:26.966748 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723723c-69bf-4c74-a05f-f7c7ad2b6733 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:26.984855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-c723723c-69bf-4c74-a05f-f7c7ad2b6733 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:43:26.984855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:26.984855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:43:26.984855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:43:26.984855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:43:26.984855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:43:26.984855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:43:26.984855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:43:26.984855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:43:26.984855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:43:26.984855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:43:26.984855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:43:26.984855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:43:26.984855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:43:26.984855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:43:26.985952 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:43:26.985952 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:43:26.985952 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:43:26.985952 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:43:26.985952 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:43:26.985952 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:43:26.985952 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:43:26.985952 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:43:26.985952 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:43:26.985952 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:43:26.985952 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:43:26.985952 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:43:26.985952 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:43:26.985952 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:43:26.985952 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:43:26.985952 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:43:26.985952 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:43:26.987336 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:43:26.987336 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:43:26.987336 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:43:26.987336 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:43:26.987336 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 611/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:43:26.992783 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08cf3ef-1ea5-4381-b290-f45f5248d7f9 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:27.110692 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08cf3ef-1ea5-4381-b290-f45f5248d7f9 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:27.113586 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:27.155777 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464191a-a3af-46b4-a370-fe6482ab0c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:27.156627 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464191a-a3af-46b4-a370-fe6482ab0c47 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:27.156946 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464191a-a3af-46b4-a370-fe6482ab0c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:27.157297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464191a-a3af-46b4-a370-fe6482ab0c47 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:27.158351 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8464191a-a3af-46b4-a370-fe6482ab0c47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:27.158806 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8464191a-a3af-46b4-a370-fe6482ab0c47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:27.160779 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8464191a-a3af-46b4-a370-fe6482ab0c47 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:27.175497 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 618/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:27.182471 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723723c-69bf-4c74-a05f-f7c7ad2b6733 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:27.192693 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:27.304804 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723723c-69bf-4c74-a05f-f7c7ad2b6733 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:27.342529 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a22ea-8920-4325-b4ea-9e59ec48b8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:27.343368 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a22ea-8920-4325-b4ea-9e59ec48b8cf None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:27.343649 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a22ea-8920-4325-b4ea-9e59ec48b8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:27.343919 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a22ea-8920-4325-b4ea-9e59ec48b8cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:27.351259 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a22ea-8920-4325-b4ea-9e59ec48b8cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:27.352706 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a22ea-8920-4325-b4ea-9e59ec48b8cf None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:27.367448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-130a22ea-8920-4325-b4ea-9e59ec48b8cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:43:27.367448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:27.367448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:43:27.367448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:43:27.367448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:43:27.367448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:43:27.367448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:43:27.367448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:43:27.367448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:43:27.367448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:43:27.367448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:43:27.367448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:43:27.367448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:43:27.367448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:43:27.367448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:43:27.371584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:43:27.371584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:43:27.371584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:43:27.371584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:43:27.371584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:43:27.371584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:43:27.371584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:43:27.371584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:43:27.371584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:43:27.371584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:43:27.371584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:43:27.371584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:43:27.371584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:43:27.371584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:43:27.371584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:43:27.371584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:43:27.371584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:43:27.372557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:43:27.372557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:43:27.372557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:43:27.372557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:43:27.372557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:43:27.372557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:43:27.372557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:43:27.372557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:43:27.372557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 612/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:43:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:43:27.375115 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464191a-a3af-46b4-a370-fe6482ab0c47 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:27.488103 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464191a-a3af-46b4-a370-fe6482ab0c47 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:27.526109 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690aecb7-f107-4851-a722-477a2618e640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:27.526862 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690aecb7-f107-4851-a722-477a2618e640 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:27.527178 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690aecb7-f107-4851-a722-477a2618e640 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:27.527505 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690aecb7-f107-4851-a722-477a2618e640 None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:27.528253 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690aecb7-f107-4851-a722-477a2618e640 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:27.528585 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690aecb7-f107-4851-a722-477a2618e640 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:27.530038 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690aecb7-f107-4851-a722-477a2618e640 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:27.543006 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 619/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:43:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:27.549283 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a22ea-8920-4325-b4ea-9e59ec48b8cf None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:27.622302 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:27.660363 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a22ea-8920-4325-b4ea-9e59ec48b8cf None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:27.701039 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42053fa9-bcbd-4074-90ec-52df4aa4650a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:27.701950 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42053fa9-bcbd-4074-90ec-52df4aa4650a None admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:27.702234 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42053fa9-bcbd-4074-90ec-52df4aa4650a None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:27.702508 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42053fa9-bcbd-4074-90ec-52df4aa4650a None admin] PATH_INFO: `/v3/projects/61b2f5f9674c4fd3a1ec5db2f3b4b26e/users/b365d9dd635e4518a41181649c323062/roles/7bab53c1ac3d4e04b18c87286e2ab0aa` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:27.717855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42053fa9-bcbd-4074-90ec-52df4aa4650a None admin] RBAC: Authorizing `identity:create_grant(project_id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user_id=b365d9dd635e4518a41181649c323062, role_id=7bab53c1ac3d4e04b18c87286e2ab0aa)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:27.719509 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42053fa9-bcbd-4074-90ec-52df4aa4650a None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:27.734029 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 613/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 10:43:27 2022] PUT /identity/v3/projects/61b2f5f9674c4fd3a1ec5db2f3b4b26e/users/b365d9dd635e4518a41181649c323062/roles/7bab53c1ac3d4e04b18c87286e2ab0aa => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:29.921852 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867abf1-b9a5-4f08-bd73-57fb35dc6ded None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:29.922484 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867abf1-b9a5-4f08-bd73-57fb35dc6ded None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:29.922484 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867abf1-b9a5-4f08-bd73-57fb35dc6ded None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:29.923769 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 620/1233] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:43:29.929537 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9208f2-b4bb-4784-8519-04270475f81d None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:29.930076 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9208f2-b4bb-4784-8519-04270475f81d None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:29.930184 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9208f2-b4bb-4784-8519-04270475f81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:29.948360 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-8e9208f2-b4bb-4784-8519-04270475f81d None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:29.949590 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-8e9208f2-b4bb-4784-8519-04270475f81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:30.023367 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 614/1234] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:43:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:43:30.048175 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867abf1-b9a5-4f08-bd73-57fb35dc6ded None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:30.077572 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:30.167326 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867abf1-b9a5-4f08-bd73-57fb35dc6ded None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:30.204157 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81fb55-dc0c-41dc-924b-f74df266fc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:30.205191 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81fb55-dc0c-41dc-924b-f74df266fc0c None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:30.205528 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81fb55-dc0c-41dc-924b-f74df266fc0c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:30.205893 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81fb55-dc0c-41dc-924b-f74df266fc0c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:30.217686 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e81fb55-dc0c-41dc-924b-f74df266fc0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:43:30.225941 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-0e81fb55-dc0c-41dc-924b-f74df266fc0c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:43:30.225941 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:30.225941 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:43:30.225941 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:43:30.225941 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:43:30.225941 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:43:30.225941 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:43:30.225941 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:43:30.225941 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:43:30.225941 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:43:30.225941 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:43:30.225941 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:43:30.225941 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:43:30.225941 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:43:30.225941 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:43:30.225941 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:43:30.227338 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:43:30.227338 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:43:30.227338 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:43:30.227338 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:43:30.227338 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:43:30.227338 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:43:30.227338 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:43:30.227338 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:43:30.227338 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:43:30.227338 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:43:30.227338 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:43:30.227338 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:43:30.227338 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:43:30.227338 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:43:30.227338 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:43:30.227338 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:43:30.228486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:43:30.228486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:43:30.228486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:43:30.228486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:43:30.228486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:43:30.228486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:43:30.228486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:43:30.228486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:43:30.228486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:43:30.228486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:43:30.228486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:43:30.228486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:43:30.228486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 621/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 10:43:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:43:30.233661 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9208f2-b4bb-4784-8519-04270475f81d None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:30.282440 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:30.348599 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9208f2-b4bb-4784-8519-04270475f81d None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:30.386549 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bebe4-bc87-48a7-9d4e-0e586118afbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:30.387262 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bebe4-bc87-48a7-9d4e-0e586118afbb None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:30.387548 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bebe4-bc87-48a7-9d4e-0e586118afbb None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:30.390960 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bebe4-bc87-48a7-9d4e-0e586118afbb None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:30.390960 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288bebe4-bc87-48a7-9d4e-0e586118afbb None admin] RBAC: Adding query filter params (name=service) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:30.390960 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288bebe4-bc87-48a7-9d4e-0e586118afbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:30.390960 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288bebe4-bc87-48a7-9d4e-0e586118afbb None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:30.399845 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 615/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 10:43:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:30.405950 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81fb55-dc0c-41dc-924b-f74df266fc0c None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:30.499167 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:30.516588 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81fb55-dc0c-41dc-924b-f74df266fc0c None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:30.553911 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8590da-4d97-445a-bb16-f9dfc3a4da28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:30.554807 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8590da-4d97-445a-bb16-f9dfc3a4da28 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:30.555099 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8590da-4d97-445a-bb16-f9dfc3a4da28 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:30.555450 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8590da-4d97-445a-bb16-f9dfc3a4da28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:30.569607 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8590da-4d97-445a-bb16-f9dfc3a4da28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:30.571307 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8590da-4d97-445a-bb16-f9dfc3a4da28 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:30.590890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-8f8590da-4d97-445a-bb16-f9dfc3a4da28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:43:30.590890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:30.590890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:43:30.590890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:43:30.590890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:43:30.590890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:43:30.590890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:43:30.590890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:43:30.590890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:43:30.590890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:43:30.590890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:43:30.590890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:43:30.590890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:43:30.590890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:43:30.590890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:43:30.592084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:43:30.592084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:43:30.592084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:43:30.592084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:43:30.592084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:43:30.592084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:43:30.592084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:43:30.592084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:43:30.592084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:43:30.592084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:43:30.592084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:43:30.592084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:43:30.592084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:43:30.592084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:43:30.592084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:43:30.592084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:43:30.592084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:43:30.593145 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:43:30.593145 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:43:30.593145 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:43:30.593145 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:43:30.593145 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 622/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:43:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:43:30.598035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bebe4-bc87-48a7-9d4e-0e586118afbb None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:30.716570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bebe4-bc87-48a7-9d4e-0e586118afbb None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:30.726900 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:30.754254 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d6ac9-29dc-4cf8-8e0e-a62564675cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:30.754940 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d6ac9-29dc-4cf8-8e0e-a62564675cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:30.755343 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d6ac9-29dc-4cf8-8e0e-a62564675cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:30.755623 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d6ac9-29dc-4cf8-8e0e-a62564675cd6 None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:30.756478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d6ac9-29dc-4cf8-8e0e-a62564675cd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:30.756787 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d6ac9-29dc-4cf8-8e0e-a62564675cd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:30.758171 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d6ac9-29dc-4cf8-8e0e-a62564675cd6 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:30.769956 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 616/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:43:30.776129 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8590da-4d97-445a-bb16-f9dfc3a4da28 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:30.889364 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8590da-4d97-445a-bb16-f9dfc3a4da28 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:30.932423 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e0cb5-f7a1-4965-bfbb-e10006e16417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:30.933238 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e0cb5-f7a1-4965-bfbb-e10006e16417 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:30.933520 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e0cb5-f7a1-4965-bfbb-e10006e16417 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:30.933791 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e0cb5-f7a1-4965-bfbb-e10006e16417 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:30.937342 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:30.943454 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e0cb5-f7a1-4965-bfbb-e10006e16417 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:30.945869 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e0cb5-f7a1-4965-bfbb-e10006e16417 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:30.961875 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-286e0cb5-f7a1-4965-bfbb-e10006e16417 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 10:43:30.961875 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:30.961875 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:43:30.961875 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:43:30.961875 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:43:30.961875 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:43:30.961875 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:43:30.961875 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:43:30.961875 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:43:30.961875 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:43:30.961875 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:43:30.961875 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:43:30.961875 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:43:30.961875 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:43:30.961875 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:43:30.961875 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:43:30.963052 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:43:30.963052 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:43:30.963052 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:43:30.963052 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:43:30.963052 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:43:30.963052 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:43:30.963052 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:43:30.963052 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:43:30.963052 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:43:30.963052 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:43:30.963052 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:43:30.963052 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:43:30.963052 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:43:30.963052 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:43:30.963052 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:43:30.963052 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:43:30.963052 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:43:30.963052 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:43:30.964188 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:43:30.964188 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:43:30.964188 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:43:30.964188 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:43:30.964188 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:43:30.964188 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:43:30.964188 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:43:30.964188 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:43:30.964188 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 10:43:30.964188 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:43:30.964188 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 623/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:43:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:43:30.969283 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d6ac9-29dc-4cf8-8e0e-a62564675cd6 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:31.078118 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d6ac9-29dc-4cf8-8e0e-a62564675cd6 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:31.112904 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498b56c-01ec-46e0-837d-819886bb497b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:31.113591 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498b56c-01ec-46e0-837d-819886bb497b None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:31.113873 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498b56c-01ec-46e0-837d-819886bb497b None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:31.114150 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498b56c-01ec-46e0-837d-819886bb497b None admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:31.115002 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498b56c-01ec-46e0-837d-819886bb497b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:31.115459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498b56c-01ec-46e0-837d-819886bb497b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:31.116959 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498b56c-01ec-46e0-837d-819886bb497b None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:31.134935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 617/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Jun 24 10:43:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:31.140913 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e0cb5-f7a1-4965-bfbb-e10006e16417 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:31.247398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e0cb5-f7a1-4965-bfbb-e10006e16417 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:31.282941 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3957d-39f1-4b3c-ba4e-59c56e675323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:31.283634 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3957d-39f1-4b3c-ba4e-59c56e675323 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:31.283916 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3957d-39f1-4b3c-ba4e-59c56e675323 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:31.284195 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3957d-39f1-4b3c-ba4e-59c56e675323 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:31.354882 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:31.362314 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3957d-39f1-4b3c-ba4e-59c56e675323 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:31.363802 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3957d-39f1-4b3c-ba4e-59c56e675323 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:31.473574 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 624/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:43:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:43:31.479643 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498b56c-01ec-46e0-837d-819886bb497b None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:31.511778 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:31.589386 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498b56c-01ec-46e0-837d-819886bb497b None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:31.626411 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa6466-c6b9-4dc9-8fdc-9d4e6d9082ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:31.627206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa6466-c6b9-4dc9-8fdc-9d4e6d9082ae None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:31.627520 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa6466-c6b9-4dc9-8fdc-9d4e6d9082ae None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:31.627823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa6466-c6b9-4dc9-8fdc-9d4e6d9082ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:31.640044 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa6466-c6b9-4dc9-8fdc-9d4e6d9082ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:31.641528 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa6466-c6b9-4dc9-8fdc-9d4e6d9082ae None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:31.660041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-04fa6466-c6b9-4dc9-8fdc-9d4e6d9082ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:43:31.660041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:31.660041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:43:31.660041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:43:31.660041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:43:31.660041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:43:31.660041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:43:31.660041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:43:31.660041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:43:31.660041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:43:31.660041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:43:31.660041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:43:31.660041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:43:31.660041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:43:31.660041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:43:31.661255 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:43:31.661255 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:43:31.661255 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:43:31.661255 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:43:31.661255 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:43:31.661255 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:43:31.661255 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:43:31.661255 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:43:31.661255 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:43:31.661255 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:43:31.661255 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:43:31.661255 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:43:31.661255 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:43:31.661255 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:43:31.661255 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:43:31.661255 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:43:31.661255 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:43:31.662437 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:43:31.662437 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:43:31.662437 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:43:31.662437 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:43:31.662437 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 618/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:43:31.667427 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3957d-39f1-4b3c-ba4e-59c56e675323 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:31.788888 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:31.796536 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3957d-39f1-4b3c-ba4e-59c56e675323 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:31.836663 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a18451-3b1f-496e-a361-24cfda1cf186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:31.837537 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a18451-3b1f-496e-a361-24cfda1cf186 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:31.837857 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a18451-3b1f-496e-a361-24cfda1cf186 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:31.838232 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a18451-3b1f-496e-a361-24cfda1cf186 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:31.839042 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a18451-3b1f-496e-a361-24cfda1cf186 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:31.839854 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a18451-3b1f-496e-a361-24cfda1cf186 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:31.840988 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a18451-3b1f-496e-a361-24cfda1cf186 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:31.854285 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 625/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:43:31.860178 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa6466-c6b9-4dc9-8fdc-9d4e6d9082ae None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:31.945558 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:31.973489 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa6466-c6b9-4dc9-8fdc-9d4e6d9082ae None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:32.011276 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376d867-c8d2-44ce-90c5-bb4e3324a4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:32.012093 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376d867-c8d2-44ce-90c5-bb4e3324a4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:32.012373 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376d867-c8d2-44ce-90c5-bb4e3324a4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:32.012648 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376d867-c8d2-44ce-90c5-bb4e3324a4a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:32.019728 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b376d867-c8d2-44ce-90c5-bb4e3324a4a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:32.021176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b376d867-c8d2-44ce-90c5-bb4e3324a4a9 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:32.035087 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-b376d867-c8d2-44ce-90c5-bb4e3324a4a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:43:32.035087 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:32.035087 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:43:32.035087 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:43:32.035087 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:43:32.035087 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:43:32.035087 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:43:32.035087 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:43:32.035087 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:43:32.035087 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:43:32.035087 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:43:32.035087 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:43:32.035087 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:43:32.035087 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:43:32.035087 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:43:32.036742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:43:32.036742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:43:32.036742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:43:32.036742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:43:32.036742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:43:32.036742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:43:32.036742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:43:32.036742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:43:32.036742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:43:32.036742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:43:32.036742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:43:32.036742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:43:32.036742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:43:32.036742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:43:32.036742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:43:32.036742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:43:32.036742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:43:32.038451 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:43:32.038451 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:43:32.038451 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:43:32.038451 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:43:32.038451 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:43:32.038451 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:43:32.038451 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:43:32.038451 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:43:32.038451 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 619/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:43:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:43:32.046155 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a18451-3b1f-496e-a361-24cfda1cf186 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:32.175786 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a18451-3b1f-496e-a361-24cfda1cf186 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:32.211239 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8e895-5af0-4b21-8b7a-26a3939c2161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:32.211895 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8e895-5af0-4b21-8b7a-26a3939c2161 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:32.212185 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8e895-5af0-4b21-8b7a-26a3939c2161 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:32.212474 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8e895-5af0-4b21-8b7a-26a3939c2161 None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:32.213334 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8e895-5af0-4b21-8b7a-26a3939c2161 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:32.213641 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8e895-5af0-4b21-8b7a-26a3939c2161 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:32.215184 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8e895-5af0-4b21-8b7a-26a3939c2161 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:32.229048 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 626/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:43:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:32.235068 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376d867-c8d2-44ce-90c5-bb4e3324a4a9 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:32.356016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376d867-c8d2-44ce-90c5-bb4e3324a4a9 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:32.396280 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e164c-540e-4033-b404-7499b71fc636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:32.396950 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e164c-540e-4033-b404-7499b71fc636 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:32.397252 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e164c-540e-4033-b404-7499b71fc636 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:32.397798 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e164c-540e-4033-b404-7499b71fc636 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:32.399006 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e164c-540e-4033-b404-7499b71fc636 None admin] RBAC: Adding query filter params (role.id=7bab53c1ac3d4e04b18c87286e2ab0aa, scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user.id=b365d9dd635e4518a41181649c323062) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:32.399344 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e164c-540e-4033-b404-7499b71fc636 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:32.400780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e164c-540e-4033-b404-7499b71fc636 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:32.406675 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 620/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:43:32 2022] GET /identity/v3/role_assignments?user.id=b365d9dd635e4518a41181649c323062&scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e&role.id=7bab53c1ac3d4e04b18c87286e2ab0aa => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:34.505394 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392afe7-6d2c-4520-99db-38267257622d None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:34.506171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392afe7-6d2c-4520-99db-38267257622d None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:34.506372 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392afe7-6d2c-4520-99db-38267257622d None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:34.508148 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 627/1247] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:43:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:43:34.514119 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a0d81-b4bc-4bba-832f-4d90a85d6667 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:34.514569 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a0d81-b4bc-4bba-832f-4d90a85d6667 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:34.514685 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a0d81-b4bc-4bba-832f-4d90a85d6667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:34.520920 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:34.536722 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-483a0d81-b4bc-4bba-832f-4d90a85d6667 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:34.538402 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-483a0d81-b4bc-4bba-832f-4d90a85d6667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:34.621361 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 621/1248] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:43:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:43:34.645833 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392afe7-6d2c-4520-99db-38267257622d None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:34.668243 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:34.763857 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392afe7-6d2c-4520-99db-38267257622d None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:34.802573 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee0da2-0682-4abc-9065-ed472b7caade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:34.803745 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee0da2-0682-4abc-9065-ed472b7caade None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:34.804018 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee0da2-0682-4abc-9065-ed472b7caade None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:34.804205 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee0da2-0682-4abc-9065-ed472b7caade None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:34.816230 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee0da2-0682-4abc-9065-ed472b7caade None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:43:34.824696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-d2ee0da2-0682-4abc-9065-ed472b7caade None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:43:34.824696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:34.824696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:43:34.824696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:43:34.824696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:43:34.824696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:43:34.824696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:43:34.824696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:43:34.824696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:43:34.824696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:43:34.824696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:43:34.824696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:43:34.824696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:43:34.824696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:43:34.824696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:43:34.824696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:43:34.825940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:43:34.825940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:43:34.825940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:43:34.825940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:43:34.825940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:43:34.825940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:43:34.825940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:43:34.825940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:43:34.825940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:43:34.825940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:43:34.825940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:43:34.825940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:43:34.825940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:43:34.825940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:43:34.825940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:43:34.825940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:43:34.826834 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:43:34.826834 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:43:34.826834 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:43:34.826834 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:43:34.826834 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:43:34.826834 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:43:34.826834 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:43:34.826834 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:43:34.826834 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:43:34.826834 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:43:34.826834 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:43:34.826834 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:43:34.826834 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 628/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:43:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:43:34.832822 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a0d81-b4bc-4bba-832f-4d90a85d6667 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:34.943339 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a0d81-b4bc-4bba-832f-4d90a85d6667 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:34.976480 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:34.982983 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c3382-c2d3-4800-bff5-afdbd7e7cbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:34.983804 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c3382-c2d3-4800-bff5-afdbd7e7cbd3 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:34.984090 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c3382-c2d3-4800-bff5-afdbd7e7cbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:34.984366 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c3382-c2d3-4800-bff5-afdbd7e7cbd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:34.985136 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c3382-c2d3-4800-bff5-afdbd7e7cbd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:34.985435 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c3382-c2d3-4800-bff5-afdbd7e7cbd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:34.986830 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c3382-c2d3-4800-bff5-afdbd7e7cbd3 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:34.997086 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 622/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:43:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:35.003186 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee0da2-0682-4abc-9065-ed472b7caade None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:35.090952 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:35.116268 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee0da2-0682-4abc-9065-ed472b7caade None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:35.153893 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc66a9d-659c-4890-92d8-a5d4ceaeb111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:35.154856 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc66a9d-659c-4890-92d8-a5d4ceaeb111 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:35.155201 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc66a9d-659c-4890-92d8-a5d4ceaeb111 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:35.155484 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc66a9d-659c-4890-92d8-a5d4ceaeb111 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:35.167748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc66a9d-659c-4890-92d8-a5d4ceaeb111 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:35.169293 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc66a9d-659c-4890-92d8-a5d4ceaeb111 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:35.187063 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-3cc66a9d-659c-4890-92d8-a5d4ceaeb111 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:43:35.187063 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:35.187063 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:43:35.187063 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:43:35.187063 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:43:35.187063 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:43:35.187063 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:43:35.187063 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:43:35.187063 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:43:35.187063 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:43:35.187063 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:43:35.187063 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:43:35.187063 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:43:35.187063 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:43:35.187063 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:43:35.188363 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:43:35.188363 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:43:35.188363 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:43:35.188363 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:43:35.188363 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:43:35.188363 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:43:35.188363 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:43:35.188363 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:43:35.188363 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:43:35.188363 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:43:35.188363 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:43:35.188363 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:43:35.188363 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:43:35.188363 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:43:35.188363 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:43:35.188363 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:43:35.188363 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:43:35.189685 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:43:35.189685 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:43:35.189685 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:43:35.189685 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:43:35.189685 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 629/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:43:35.194304 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c3382-c2d3-4800-bff5-afdbd7e7cbd3 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:35.307945 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c3382-c2d3-4800-bff5-afdbd7e7cbd3 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:35.349742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2110f-adf4-4c77-8900-c0dc95a5b1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:35.351017 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2110f-adf4-4c77-8900-c0dc95a5b1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:35.351386 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2110f-adf4-4c77-8900-c0dc95a5b1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:35.351667 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2110f-adf4-4c77-8900-c0dc95a5b1d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:35.352503 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2110f-adf4-4c77-8900-c0dc95a5b1d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:35.352894 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2110f-adf4-4c77-8900-c0dc95a5b1d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:35.354456 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2110f-adf4-4c77-8900-c0dc95a5b1d3 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:35.370129 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 623/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:35.376216 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc66a9d-659c-4890-92d8-a5d4ceaeb111 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:35.485473 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc66a9d-659c-4890-92d8-a5d4ceaeb111 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:35.515402 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:35.525064 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63d9c8-c4b5-4803-9630-c86107505148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:35.526085 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63d9c8-c4b5-4803-9630-c86107505148 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:35.526370 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63d9c8-c4b5-4803-9630-c86107505148 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:35.526692 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63d9c8-c4b5-4803-9630-c86107505148 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:35.535448 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df63d9c8-c4b5-4803-9630-c86107505148 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:35.537011 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df63d9c8-c4b5-4803-9630-c86107505148 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:35.555091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-df63d9c8-c4b5-4803-9630-c86107505148 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 10:43:35.555091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:35.555091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:43:35.555091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:43:35.555091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:43:35.555091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:43:35.555091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:43:35.555091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:43:35.555091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:43:35.555091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:43:35.555091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:43:35.555091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:43:35.555091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:43:35.555091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:43:35.555091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:43:35.555091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:43:35.556415 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:43:35.556415 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:43:35.556415 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:43:35.556415 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:43:35.556415 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:43:35.556415 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:43:35.556415 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:43:35.556415 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:43:35.556415 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:43:35.556415 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:43:35.556415 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:43:35.556415 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:43:35.556415 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:43:35.556415 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:43:35.556415 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:43:35.556415 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:43:35.556415 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:43:35.556415 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:43:35.557896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:43:35.557896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:43:35.557896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:43:35.557896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:43:35.557896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:43:35.557896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:43:35.557896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:43:35.557896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:43:35.557896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 10:43:35.557896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:43:35.557896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 630/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:43:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:43:35.564332 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2110f-adf4-4c77-8900-c0dc95a5b1d3 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:35.632585 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:35.684996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2110f-adf4-4c77-8900-c0dc95a5b1d3 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:35.724503 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e6a4f-2326-4aa6-962b-cfff4971c87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:35.725193 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e6a4f-2326-4aa6-962b-cfff4971c87d None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:35.725678 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e6a4f-2326-4aa6-962b-cfff4971c87d None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:35.725678 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e6a4f-2326-4aa6-962b-cfff4971c87d None admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:35.726738 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e6a4f-2326-4aa6-962b-cfff4971c87d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:35.727049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e6a4f-2326-4aa6-962b-cfff4971c87d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:35.728526 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e6a4f-2326-4aa6-962b-cfff4971c87d None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:35.747141 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 624/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Jun 24 10:43:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:35.753183 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63d9c8-c4b5-4803-9630-c86107505148 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:35.860238 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63d9c8-c4b5-4803-9630-c86107505148 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:35.895829 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430f19e-aa00-4496-9fb4-8927683422b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:35.896414 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430f19e-aa00-4496-9fb4-8927683422b9 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:35.896690 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430f19e-aa00-4496-9fb4-8927683422b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:35.896983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430f19e-aa00-4496-9fb4-8927683422b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:35.966059 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:35.981295 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430f19e-aa00-4496-9fb4-8927683422b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:35.982830 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430f19e-aa00-4496-9fb4-8927683422b9 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:36.092572 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 631/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:43:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:43:36.098679 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e6a4f-2326-4aa6-962b-cfff4971c87d None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:36.204956 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e6a4f-2326-4aa6-962b-cfff4971c87d None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:36.220990 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:36.242290 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff2110-ea5f-48b7-bfe9-b7f98f6f06b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:36.243110 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff2110-ea5f-48b7-bfe9-b7f98f6f06b3 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:36.243419 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff2110-ea5f-48b7-bfe9-b7f98f6f06b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:36.243693 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff2110-ea5f-48b7-bfe9-b7f98f6f06b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:36.261003 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff2110-ea5f-48b7-bfe9-b7f98f6f06b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:36.262640 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff2110-ea5f-48b7-bfe9-b7f98f6f06b3 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:36.282451 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-b8ff2110-ea5f-48b7-bfe9-b7f98f6f06b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:43:36.282451 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:36.282451 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:43:36.282451 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:43:36.282451 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:43:36.282451 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:43:36.282451 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:43:36.282451 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:43:36.282451 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:43:36.282451 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:43:36.282451 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:43:36.282451 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:43:36.282451 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:43:36.282451 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:43:36.282451 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:43:36.283471 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:43:36.283471 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:43:36.283471 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:43:36.283471 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:43:36.283471 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:43:36.283471 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:43:36.283471 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:43:36.283471 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:43:36.283471 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:43:36.283471 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:43:36.283471 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:43:36.283471 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:43:36.283471 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:43:36.283471 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:43:36.283471 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:43:36.283471 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:43:36.283471 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:43:36.284369 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:43:36.284369 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:43:36.284369 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:43:36.284369 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:43:36.284369 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 625/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:43:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:43:36.292092 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430f19e-aa00-4496-9fb4-8927683422b9 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:36.399509 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:36.413981 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430f19e-aa00-4496-9fb4-8927683422b9 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:36.455131 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8faf25-96b3-49e0-8396-a84964fed1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:36.455763 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8faf25-96b3-49e0-8396-a84964fed1fd None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:36.456052 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8faf25-96b3-49e0-8396-a84964fed1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:36.456420 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8faf25-96b3-49e0-8396-a84964fed1fd None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:36.457316 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8faf25-96b3-49e0-8396-a84964fed1fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:36.457718 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8faf25-96b3-49e0-8396-a84964fed1fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:36.459411 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8faf25-96b3-49e0-8396-a84964fed1fd None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:36.473800 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 632/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:36.480841 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff2110-ea5f-48b7-bfe9-b7f98f6f06b3 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:36.590198 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff2110-ea5f-48b7-bfe9-b7f98f6f06b3 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:36.624746 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e0e88-63d2-4a73-b1a8-1ff9d0214b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:36.625577 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e0e88-63d2-4a73-b1a8-1ff9d0214b2a None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:36.625875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e0e88-63d2-4a73-b1a8-1ff9d0214b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:36.626142 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e0e88-63d2-4a73-b1a8-1ff9d0214b2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:36.633451 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e0e88-63d2-4a73-b1a8-1ff9d0214b2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:36.634902 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e0e88-63d2-4a73-b1a8-1ff9d0214b2a None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:36.648656 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-286e0e88-63d2-4a73-b1a8-1ff9d0214b2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:43:36.648656 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:36.648656 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:43:36.648656 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:43:36.648656 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:43:36.648656 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:43:36.648656 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:43:36.648656 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:43:36.648656 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:43:36.648656 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:43:36.648656 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:43:36.648656 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:43:36.648656 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:43:36.648656 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:43:36.648656 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:43:36.649800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:43:36.649800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:43:36.649800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:43:36.649800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:43:36.649800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:43:36.649800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:43:36.649800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:43:36.649800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:43:36.649800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:43:36.649800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:43:36.649800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:43:36.649800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:43:36.649800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:43:36.649800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:43:36.649800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:43:36.649800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:43:36.649800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:43:36.650741 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:43:36.650741 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:43:36.650741 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:43:36.650741 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:43:36.650741 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:43:36.650741 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:43:36.650741 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:43:36.650741 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:43:36.650741 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 626/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:43:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:43:36.658629 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8faf25-96b3-49e0-8396-a84964fed1fd None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:36.770863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8faf25-96b3-49e0-8396-a84964fed1fd None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:36.806114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432a712-dfda-4b3e-a5d2-c783bd47ea4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:36.806786 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432a712-dfda-4b3e-a5d2-c783bd47ea4f None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:36.807461 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432a712-dfda-4b3e-a5d2-c783bd47ea4f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:36.807766 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432a712-dfda-4b3e-a5d2-c783bd47ea4f None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:36.808528 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432a712-dfda-4b3e-a5d2-c783bd47ea4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:36.808837 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432a712-dfda-4b3e-a5d2-c783bd47ea4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:36.810274 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432a712-dfda-4b3e-a5d2-c783bd47ea4f None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:36.822830 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 633/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:43:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:43:36.829016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e0e88-63d2-4a73-b1a8-1ff9d0214b2a None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:36.861209 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:36.953038 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e0e88-63d2-4a73-b1a8-1ff9d0214b2a None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:36.988928 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b242439-8e52-4e4e-be7b-00183ba05b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:36.989603 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b242439-8e52-4e4e-be7b-00183ba05b7f None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:36.989891 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b242439-8e52-4e4e-be7b-00183ba05b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:36.990175 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b242439-8e52-4e4e-be7b-00183ba05b7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:36.991134 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b242439-8e52-4e4e-be7b-00183ba05b7f None admin] RBAC: Adding query filter params (role.id=4867b69c45554ce18e23167c05a02175, scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user.id=b365d9dd635e4518a41181649c323062) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:36.991484 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b242439-8e52-4e4e-be7b-00183ba05b7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:36.992927 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b242439-8e52-4e4e-be7b-00183ba05b7f None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:36.998961 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 627/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:43:36 2022] GET /identity/v3/role_assignments?user.id=b365d9dd635e4518a41181649c323062&scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e&role.id=4867b69c45554ce18e23167c05a02175 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:43:38.987810 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fe92a-c710-4484-aaf3-01df733ab8d6 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:38.988334 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fe92a-c710-4484-aaf3-01df733ab8d6 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:38.988334 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fe92a-c710-4484-aaf3-01df733ab8d6 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:38.989650 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 634/1261] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:43:38.996115 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2cdfa-7117-4376-9717-b3c918348e63 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:38.996573 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2cdfa-7117-4376-9717-b3c918348e63 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:38.996690 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2cdfa-7117-4376-9717-b3c918348e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:39.019883 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-bfa2cdfa-7117-4376-9717-b3c918348e63 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:39.021067 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-bfa2cdfa-7117-4376-9717-b3c918348e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:39.093088 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 628/1262] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:43:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:43:39.115968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fe92a-c710-4484-aaf3-01df733ab8d6 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:39.127968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:39.224997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fe92a-c710-4484-aaf3-01df733ab8d6 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:39.261924 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc39f2-025f-451e-95d5-d722b7060a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:39.262661 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc39f2-025f-451e-95d5-d722b7060a4b None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:39.262952 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc39f2-025f-451e-95d5-d722b7060a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:39.263258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc39f2-025f-451e-95d5-d722b7060a4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:39.274031 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc39f2-025f-451e-95d5-d722b7060a4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:43:39.281712 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-23fc39f2-025f-451e-95d5-d722b7060a4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:43:39.281712 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:39.281712 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:43:39.281712 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:43:39.281712 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:43:39.281712 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:43:39.281712 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:43:39.281712 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:43:39.281712 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:43:39.281712 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:43:39.281712 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:43:39.281712 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:43:39.281712 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:43:39.281712 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:43:39.281712 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:43:39.281712 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:43:39.282800 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:43:39.282800 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:43:39.282800 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:43:39.282800 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:43:39.282800 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:43:39.282800 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:43:39.282800 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:43:39.282800 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:43:39.282800 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:43:39.282800 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:43:39.282800 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:43:39.282800 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:43:39.282800 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:43:39.282800 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:43:39.282800 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:43:39.282800 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:43:39.283819 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:43:39.283819 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:43:39.283819 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:43:39.283819 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:43:39.283819 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:43:39.283819 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:43:39.283819 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:43:39.283819 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:43:39.283819 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:43:39.283819 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:43:39.283819 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:43:39.283819 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:43:39.283819 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 635/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:43:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:43:39.289210 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2cdfa-7117-4376-9717-b3c918348e63 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:39.310747 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:39.395521 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2cdfa-7117-4376-9717-b3c918348e63 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:39.431126 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179b2e9-71ef-476f-a40c-4852f2581b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:39.432192 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179b2e9-71ef-476f-a40c-4852f2581b09 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:39.432480 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179b2e9-71ef-476f-a40c-4852f2581b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:39.432729 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179b2e9-71ef-476f-a40c-4852f2581b09 None admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:39.433480 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179b2e9-71ef-476f-a40c-4852f2581b09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:39.433778 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179b2e9-71ef-476f-a40c-4852f2581b09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:39.435177 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179b2e9-71ef-476f-a40c-4852f2581b09 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:39.443548 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 629/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:43:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:39.452326 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc39f2-025f-451e-95d5-d722b7060a4b None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:39.520979 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:39.559539 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc39f2-025f-451e-95d5-d722b7060a4b None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:39.594328 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1ce28-fd5f-437f-be38-9c37bf193d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:39.595114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1ce28-fd5f-437f-be38-9c37bf193d22 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:39.595434 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1ce28-fd5f-437f-be38-9c37bf193d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:39.595697 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1ce28-fd5f-437f-be38-9c37bf193d22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:39.609387 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1ce28-fd5f-437f-be38-9c37bf193d22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:39.610853 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1ce28-fd5f-437f-be38-9c37bf193d22 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:39.635136 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-02d1ce28-fd5f-437f-be38-9c37bf193d22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:43:39.635136 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:39.635136 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:43:39.635136 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:43:39.635136 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:43:39.635136 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:43:39.635136 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:43:39.635136 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:43:39.635136 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:43:39.635136 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:43:39.635136 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:43:39.635136 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:43:39.635136 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:43:39.635136 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:43:39.635136 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:43:39.636217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:43:39.636217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:43:39.636217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:43:39.636217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:43:39.636217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:43:39.636217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:43:39.636217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:43:39.636217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:43:39.636217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:43:39.636217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:43:39.636217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:43:39.636217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:43:39.636217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:43:39.636217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:43:39.636217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:43:39.636217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:43:39.636217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:43:39.637155 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:43:39.637155 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:43:39.637155 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:43:39.637155 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:43:39.637155 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 636/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:43:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:43:39.642674 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179b2e9-71ef-476f-a40c-4852f2581b09 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:39.731819 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:39.752087 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179b2e9-71ef-476f-a40c-4852f2581b09 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:39.789723 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c07fee-13b9-4ca1-ae98-406090288428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:39.790325 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c07fee-13b9-4ca1-ae98-406090288428 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:39.790609 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c07fee-13b9-4ca1-ae98-406090288428 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:39.790876 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c07fee-13b9-4ca1-ae98-406090288428 None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:39.791642 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c07fee-13b9-4ca1-ae98-406090288428 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:39.791948 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c07fee-13b9-4ca1-ae98-406090288428 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:39.793325 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c07fee-13b9-4ca1-ae98-406090288428 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:39.811270 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 630/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:39.817809 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1ce28-fd5f-437f-be38-9c37bf193d22 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:39.925365 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1ce28-fd5f-437f-be38-9c37bf193d22 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:39.946192 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:39.961861 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483e399-dda1-4783-a913-f6db67f3d852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:39.962675 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483e399-dda1-4783-a913-f6db67f3d852 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:39.962955 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483e399-dda1-4783-a913-f6db67f3d852 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:39.963251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483e399-dda1-4783-a913-f6db67f3d852 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:39.971919 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483e399-dda1-4783-a913-f6db67f3d852 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:39.973385 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483e399-dda1-4783-a913-f6db67f3d852 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:39.990590 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-0483e399-dda1-4783-a913-f6db67f3d852 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 10:43:39.990590 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:39.990590 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:43:39.990590 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:43:39.990590 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:43:39.990590 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:43:39.990590 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:43:39.990590 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:43:39.990590 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:43:39.990590 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:43:39.990590 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:43:39.990590 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:43:39.990590 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:43:39.990590 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:43:39.990590 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:43:39.990590 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:43:39.992294 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:43:39.992294 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:43:39.992294 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:43:39.992294 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:43:39.992294 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:43:39.992294 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:43:39.992294 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:43:39.992294 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:43:39.992294 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:43:39.992294 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:43:39.992294 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:43:39.992294 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:43:39.992294 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:43:39.992294 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:43:39.992294 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:43:39.992294 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:43:39.992294 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:43:39.992294 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:43:39.994234 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:43:39.994234 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:43:39.994234 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:43:39.994234 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:43:39.994234 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:43:39.994234 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:43:39.994234 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:43:39.994234 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:43:39.994234 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 10:43:39.994234 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:43:39.994234 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 637/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:43:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:43:40.001054 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c07fee-13b9-4ca1-ae98-406090288428 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:40.114367 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c07fee-13b9-4ca1-ae98-406090288428 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:40.150057 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5b22b-69a5-4528-8cd0-4f42a908df37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:40.150722 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5b22b-69a5-4528-8cd0-4f42a908df37 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:40.151024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5b22b-69a5-4528-8cd0-4f42a908df37 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:40.151322 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5b22b-69a5-4528-8cd0-4f42a908df37 None admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:40.152154 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5b22b-69a5-4528-8cd0-4f42a908df37 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:40.152461 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5b22b-69a5-4528-8cd0-4f42a908df37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:40.153886 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5b22b-69a5-4528-8cd0-4f42a908df37 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:40.162506 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:40.177094 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 631/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Jun 24 10:43:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:40.183398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483e399-dda1-4783-a913-f6db67f3d852 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:40.290025 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483e399-dda1-4783-a913-f6db67f3d852 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:40.327142 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c557e-5d59-45ab-bf04-42350acc796b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:40.327972 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c557e-5d59-45ab-bf04-42350acc796b None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:40.328249 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c557e-5d59-45ab-bf04-42350acc796b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:40.328523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c557e-5d59-45ab-bf04-42350acc796b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:40.340243 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c557e-5d59-45ab-bf04-42350acc796b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:40.341688 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c557e-5d59-45ab-bf04-42350acc796b None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:40.358553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-413c557e-5d59-45ab-bf04-42350acc796b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:43:40.358553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:40.358553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:43:40.358553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:43:40.358553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:43:40.358553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:43:40.358553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:43:40.358553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:43:40.358553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:43:40.358553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:43:40.358553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:43:40.358553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:43:40.358553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:43:40.358553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:43:40.358553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:43:40.359664 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:43:40.359664 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:43:40.359664 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:43:40.359664 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:43:40.359664 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:43:40.359664 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:43:40.359664 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:43:40.359664 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:43:40.359664 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:43:40.359664 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:43:40.359664 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:43:40.359664 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:43:40.359664 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:43:40.359664 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:43:40.359664 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:43:40.359664 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:43:40.359664 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:43:40.361001 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:43:40.361001 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:43:40.361001 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:43:40.361001 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:43:40.361001 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 638/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:43:40.369278 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5b22b-69a5-4528-8cd0-4f42a908df37 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:40.478926 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5b22b-69a5-4528-8cd0-4f42a908df37 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:40.514682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71630a1f-da73-493b-b7e9-744417183599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:40.515373 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71630a1f-da73-493b-b7e9-744417183599 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:40.515656 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71630a1f-da73-493b-b7e9-744417183599 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:40.515933 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71630a1f-da73-493b-b7e9-744417183599 None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:40.516658 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71630a1f-da73-493b-b7e9-744417183599 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:40.516963 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71630a1f-da73-493b-b7e9-744417183599 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:40.518331 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71630a1f-da73-493b-b7e9-744417183599 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:40.529809 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 632/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:40.536294 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c557e-5d59-45ab-bf04-42350acc796b None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:40.575253 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:40.649329 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c557e-5d59-45ab-bf04-42350acc796b None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:40.685282 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901efa4-235f-4464-a0e4-b3063fd5b65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:40.686078 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901efa4-235f-4464-a0e4-b3063fd5b65f None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:40.686357 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901efa4-235f-4464-a0e4-b3063fd5b65f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:40.686643 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901efa4-235f-4464-a0e4-b3063fd5b65f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:40.693521 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901efa4-235f-4464-a0e4-b3063fd5b65f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:40.695172 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901efa4-235f-4464-a0e4-b3063fd5b65f None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:40.709854 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-8901efa4-235f-4464-a0e4-b3063fd5b65f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:43:40.709854 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:40.709854 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:43:40.709854 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:43:40.709854 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:43:40.709854 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:43:40.709854 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:43:40.709854 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:43:40.709854 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:43:40.709854 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:43:40.709854 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:43:40.709854 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:43:40.709854 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:43:40.709854 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:43:40.709854 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:43:40.710840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:43:40.710840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:43:40.710840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:43:40.710840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:43:40.710840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:43:40.710840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:43:40.710840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:43:40.710840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:43:40.710840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:43:40.710840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:43:40.710840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:43:40.710840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:43:40.710840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:43:40.710840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:43:40.710840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:43:40.710840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:43:40.710840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:43:40.712039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:43:40.712039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:43:40.712039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:43:40.712039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:43:40.712039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:43:40.712039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:43:40.712039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:43:40.712039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:43:40.712039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 639/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:43:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:43:40.720271 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71630a1f-da73-493b-b7e9-744417183599 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:40.787307 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:40.847175 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71630a1f-da73-493b-b7e9-744417183599 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:40.884481 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1585f-5f3f-4ebc-820f-b8b32b744a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:40.885138 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1585f-5f3f-4ebc-820f-b8b32b744a4e None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:40.885417 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1585f-5f3f-4ebc-820f-b8b32b744a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:40.885692 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1585f-5f3f-4ebc-820f-b8b32b744a4e None admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:40.886459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1585f-5f3f-4ebc-820f-b8b32b744a4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:40.886765 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1585f-5f3f-4ebc-820f-b8b32b744a4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:40.888218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1585f-5f3f-4ebc-820f-b8b32b744a4e None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:40.901411 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 633/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:43:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:40.907555 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901efa4-235f-4464-a0e4-b3063fd5b65f None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:41.003524 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:41.013421 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901efa4-235f-4464-a0e4-b3063fd5b65f None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:41.049124 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c6742-6e6c-4a30-9913-1366de3d2134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:41.050002 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c6742-6e6c-4a30-9913-1366de3d2134 None admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:41.050283 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c6742-6e6c-4a30-9913-1366de3d2134 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:41.050561 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c6742-6e6c-4a30-9913-1366de3d2134 None admin] PATH_INFO: `/v3/projects/61b2f5f9674c4fd3a1ec5db2f3b4b26e/users/b365d9dd635e4518a41181649c323062/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:41.052735 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c6742-6e6c-4a30-9913-1366de3d2134 None admin] RBAC: Authorizing `identity:create_grant(project_id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user_id=b365d9dd635e4518a41181649c323062, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:41.054510 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c6742-6e6c-4a30-9913-1366de3d2134 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:41.074411 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 640/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 10:43:40 2022] PUT /identity/v3/projects/61b2f5f9674c4fd3a1ec5db2f3b4b26e/users/b365d9dd635e4518a41181649c323062/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:43.074616 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf111ab-ce75-42d6-9583-04906d47b612 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:43.075619 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf111ab-ce75-42d6-9583-04906d47b612 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:43.075619 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf111ab-ce75-42d6-9583-04906d47b612 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:43.077648 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 634/1274] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:43:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:43:43.083998 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f3069-0069-45fc-977e-2ea0a1afdd20 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:43.084495 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f3069-0069-45fc-977e-2ea0a1afdd20 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:43.085083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f3069-0069-45fc-977e-2ea0a1afdd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:43.104382 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-9f7f3069-0069-45fc-977e-2ea0a1afdd20 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:43.105607 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9f7f3069-0069-45fc-977e-2ea0a1afdd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:43.176959 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 641/1275] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:43:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:43:43.214074 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf111ab-ce75-42d6-9583-04906d47b612 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:43.332807 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf111ab-ce75-42d6-9583-04906d47b612 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:43.356729 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:43.375220 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac4560-8744-4985-9389-d6c9eac8f689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:43.376020 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac4560-8744-4985-9389-d6c9eac8f689 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:43.376301 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac4560-8744-4985-9389-d6c9eac8f689 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:43.376608 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac4560-8744-4985-9389-d6c9eac8f689 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:43.387640 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac4560-8744-4985-9389-d6c9eac8f689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:43:43.395176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-66ac4560-8744-4985-9389-d6c9eac8f689 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:43:43.395176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:43.395176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:43:43.395176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:43:43.395176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:43:43.395176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:43:43.395176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:43:43.395176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:43:43.395176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:43:43.395176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:43:43.395176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:43:43.395176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:43:43.395176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:43:43.395176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:43:43.395176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:43:43.395176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:43:43.396307 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:43:43.396307 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:43:43.396307 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:43:43.396307 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:43:43.396307 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:43:43.396307 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:43:43.396307 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:43:43.396307 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:43:43.396307 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:43:43.396307 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:43:43.396307 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:43:43.396307 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:43:43.396307 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:43:43.396307 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:43:43.396307 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:43:43.396307 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:43:43.397937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:43:43.397937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:43:43.397937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:43:43.397937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:43:43.397937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:43:43.397937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:43:43.397937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:43:43.397937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:43:43.397937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:43:43.397937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:43:43.397937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:43:43.397937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:43:43.399333 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 635/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 10:43:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:43:43.402346 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f3069-0069-45fc-977e-2ea0a1afdd20 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:43.486939 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:43.514448 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f3069-0069-45fc-977e-2ea0a1afdd20 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:43.550182 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99204fab-b9cc-4663-80eb-2be43e523920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:43.550840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99204fab-b9cc-4663-80eb-2be43e523920 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:43.551122 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99204fab-b9cc-4663-80eb-2be43e523920 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:43.551427 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99204fab-b9cc-4663-80eb-2be43e523920 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:43.552183 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99204fab-b9cc-4663-80eb-2be43e523920 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:43.552492 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99204fab-b9cc-4663-80eb-2be43e523920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:43.554060 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99204fab-b9cc-4663-80eb-2be43e523920 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:43.562480 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 642/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 10:43:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:43.569073 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac4560-8744-4985-9389-d6c9eac8f689 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:43.682390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac4560-8744-4985-9389-d6c9eac8f689 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:43.724363 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982250e8-777a-41c1-90ce-80008b542b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:43.725232 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982250e8-777a-41c1-90ce-80008b542b1d None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:43.725495 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982250e8-777a-41c1-90ce-80008b542b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:43.725794 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982250e8-777a-41c1-90ce-80008b542b1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:43.738437 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982250e8-777a-41c1-90ce-80008b542b1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:43.740818 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982250e8-777a-41c1-90ce-80008b542b1d None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:43.759037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-982250e8-777a-41c1-90ce-80008b542b1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:43:43.759037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:43.759037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:43:43.759037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:43:43.759037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:43:43.759037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:43:43.759037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:43:43.759037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:43:43.759037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:43:43.759037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:43:43.759037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:43:43.759037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:43:43.759037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:43:43.759037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:43:43.759037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:43:43.760177 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:43:43.760177 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:43:43.760177 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:43:43.760177 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:43:43.760177 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:43:43.760177 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:43:43.760177 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:43:43.760177 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:43:43.760177 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:43:43.760177 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:43:43.760177 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:43:43.760177 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:43:43.760177 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:43:43.760177 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:43:43.760177 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:43:43.760177 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:43:43.760177 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:43:43.761557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:43:43.761557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:43:43.761557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:43:43.761557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:43:43.761557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 636/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:43:43.769163 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99204fab-b9cc-4663-80eb-2be43e523920 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:43.877279 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99204fab-b9cc-4663-80eb-2be43e523920 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:43.919689 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8676d-bb61-472b-aa2d-aa9efae76507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:43.920280 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8676d-bb61-472b-aa2d-aa9efae76507 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:43.920559 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8676d-bb61-472b-aa2d-aa9efae76507 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:43.920832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8676d-bb61-472b-aa2d-aa9efae76507 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:43.921552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8676d-bb61-472b-aa2d-aa9efae76507 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:43.921865 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8676d-bb61-472b-aa2d-aa9efae76507 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:43.923255 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8676d-bb61-472b-aa2d-aa9efae76507 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:43.936106 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 643/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:43.944722 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982250e8-777a-41c1-90ce-80008b542b1d None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:43.983366 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:44.062719 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982250e8-777a-41c1-90ce-80008b542b1d None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:44.099229 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4868bd-b110-4c7d-9349-42865a33a475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:44.100031 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4868bd-b110-4c7d-9349-42865a33a475 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:44.100313 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4868bd-b110-4c7d-9349-42865a33a475 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:44.100584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4868bd-b110-4c7d-9349-42865a33a475 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:44.108997 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4868bd-b110-4c7d-9349-42865a33a475 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:44.110446 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4868bd-b110-4c7d-9349-42865a33a475 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:44.125183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-5b4868bd-b110-4c7d-9349-42865a33a475 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 10:43:44.125183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:44.125183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:43:44.125183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:43:44.125183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:43:44.125183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:43:44.125183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:43:44.125183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:43:44.125183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:43:44.125183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:43:44.125183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:43:44.125183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:43:44.125183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:43:44.125183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:43:44.125183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:43:44.125183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:43:44.126281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:43:44.126281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:43:44.126281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:43:44.126281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:43:44.126281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:43:44.126281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:43:44.126281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:43:44.126281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:43:44.126281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:43:44.126281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:43:44.126281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:43:44.126281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:43:44.126281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:43:44.126281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:43:44.126281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:43:44.126281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:43:44.126281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:43:44.126281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:43:44.127337 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:43:44.127337 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:43:44.127337 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:43:44.127337 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:43:44.127337 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:43:44.127337 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:43:44.127337 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:43:44.127337 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:43:44.127337 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 10:43:44.127337 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:43:44.127337 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 637/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:43:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:43:44.132774 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8676d-bb61-472b-aa2d-aa9efae76507 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:44.138559 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:44.254302 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8676d-bb61-472b-aa2d-aa9efae76507 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:44.290259 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e9685-504b-43d6-99c5-fb502cdd6429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:44.290921 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e9685-504b-43d6-99c5-fb502cdd6429 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:44.291238 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e9685-504b-43d6-99c5-fb502cdd6429 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:44.291511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e9685-504b-43d6-99c5-fb502cdd6429 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:44.292349 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e9685-504b-43d6-99c5-fb502cdd6429 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:44.292661 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e9685-504b-43d6-99c5-fb502cdd6429 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:44.294091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e9685-504b-43d6-99c5-fb502cdd6429 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:44.311542 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 644/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Jun 24 10:43:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:44.318097 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4868bd-b110-4c7d-9349-42865a33a475 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:44.417249 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:44.428244 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4868bd-b110-4c7d-9349-42865a33a475 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:44.465655 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5268b6-95ed-47ba-bf39-30a81d74a3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:44.466298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5268b6-95ed-47ba-bf39-30a81d74a3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:44.466581 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5268b6-95ed-47ba-bf39-30a81d74a3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:44.466849 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5268b6-95ed-47ba-bf39-30a81d74a3c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:44.540587 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5268b6-95ed-47ba-bf39-30a81d74a3c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:44.541972 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5268b6-95ed-47ba-bf39-30a81d74a3c5 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:44.638400 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:44.651587 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 638/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 10:43:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:43:44.657514 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e9685-504b-43d6-99c5-fb502cdd6429 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:44.724358 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:44.765248 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e9685-504b-43d6-99c5-fb502cdd6429 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:44.803969 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af61b03-93d2-40be-9161-df09e2609b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:44.804745 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af61b03-93d2-40be-9161-df09e2609b16 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:44.805035 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af61b03-93d2-40be-9161-df09e2609b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:44.805311 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af61b03-93d2-40be-9161-df09e2609b16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:44.816380 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af61b03-93d2-40be-9161-df09e2609b16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:44.817838 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af61b03-93d2-40be-9161-df09e2609b16 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:44.836531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-9af61b03-93d2-40be-9161-df09e2609b16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:43:44.836531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:44.836531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:43:44.836531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:43:44.836531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:43:44.836531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:43:44.836531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:43:44.836531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:43:44.836531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:43:44.836531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:43:44.836531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:43:44.836531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:43:44.836531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:43:44.836531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:43:44.836531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:43:44.837571 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:43:44.837571 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:43:44.837571 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:43:44.837571 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:43:44.837571 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:43:44.837571 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:43:44.837571 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:43:44.837571 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:43:44.837571 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:43:44.837571 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:43:44.837571 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:43:44.837571 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:43:44.837571 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:43:44.837571 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:43:44.837571 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:43:44.837571 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:43:44.837571 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:43:44.842046 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:43:44.842046 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:43:44.842046 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:43:44.842046 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:43:44.842046 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 645/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:43:44.843568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5268b6-95ed-47ba-bf39-30a81d74a3c5 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:44.951519 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5268b6-95ed-47ba-bf39-30a81d74a3c5 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:44.989813 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d59bb3-38ee-4070-ae47-4bf5edd04a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:44.990478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d59bb3-38ee-4070-ae47-4bf5edd04a2d None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:44.990768 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d59bb3-38ee-4070-ae47-4bf5edd04a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:44.991047 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d59bb3-38ee-4070-ae47-4bf5edd04a2d None admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:44.991833 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d59bb3-38ee-4070-ae47-4bf5edd04a2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:44.992406 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d59bb3-38ee-4070-ae47-4bf5edd04a2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:44.993514 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d59bb3-38ee-4070-ae47-4bf5edd04a2d None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:45.005057 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 639/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 10:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:45.011790 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af61b03-93d2-40be-9161-df09e2609b16 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:45.125045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af61b03-93d2-40be-9161-df09e2609b16 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:45.139101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:45.162540 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571f45f-237d-4d36-9ddb-2dcd3f3c3efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:45.163367 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571f45f-237d-4d36-9ddb-2dcd3f3c3efe None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:45.163651 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571f45f-237d-4d36-9ddb-2dcd3f3c3efe None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:45.164004 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571f45f-237d-4d36-9ddb-2dcd3f3c3efe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:45.172467 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571f45f-237d-4d36-9ddb-2dcd3f3c3efe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:45.174858 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571f45f-237d-4d36-9ddb-2dcd3f3c3efe None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:45.197857 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-3571f45f-237d-4d36-9ddb-2dcd3f3c3efe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:43:45.197857 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:45.197857 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:43:45.197857 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:43:45.197857 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:43:45.197857 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:43:45.197857 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:43:45.197857 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:43:45.197857 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:43:45.197857 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:43:45.197857 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:43:45.197857 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:43:45.197857 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:43:45.197857 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:43:45.197857 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:43:45.198908 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:43:45.198908 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:43:45.198908 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:43:45.198908 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:43:45.198908 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:43:45.198908 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:43:45.198908 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:43:45.198908 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:43:45.198908 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 24 10:43:45.198908 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:43:45.198908 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:43:45.198908 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:43:45.198908 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:43:45.198908 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:43:45.198908 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:43:45.198908 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:43:45.198908 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:43:45.200037 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:43:45.200037 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:43:45.200037 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:43:45.200037 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:43:45.200037 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:43:45.200037 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:43:45.200037 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:43:45.200037 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 24 10:43:45.200037 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 646/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 10:43:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:43:45.205701 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d59bb3-38ee-4070-ae47-4bf5edd04a2d None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:45.260685 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:45.314338 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d59bb3-38ee-4070-ae47-4bf5edd04a2d None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:45.351828 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29867c3a-0bd0-4426-ab81-4e7416f9efe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:45.352487 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29867c3a-0bd0-4426-ab81-4e7416f9efe3 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:45.352770 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29867c3a-0bd0-4426-ab81-4e7416f9efe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:45.353051 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29867c3a-0bd0-4426-ab81-4e7416f9efe3 None admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:45.353911 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29867c3a-0bd0-4426-ab81-4e7416f9efe3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:45.354224 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29867c3a-0bd0-4426-ab81-4e7416f9efe3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:45.355781 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29867c3a-0bd0-4426-ab81-4e7416f9efe3 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:45.373883 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 640/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 10:43:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:45.380319 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571f45f-237d-4d36-9ddb-2dcd3f3c3efe None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:45.510453 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571f45f-237d-4d36-9ddb-2dcd3f3c3efe None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:45.546499 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6c98f-ad10-4f89-9290-054b247c2f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:45.547186 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6c98f-ad10-4f89-9290-054b247c2f0d None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:45.547458 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6c98f-ad10-4f89-9290-054b247c2f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:45.547732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6c98f-ad10-4f89-9290-054b247c2f0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:45.548562 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6c98f-ad10-4f89-9290-054b247c2f0d None admin] RBAC: Adding query filter params (role.id=4867b69c45554ce18e23167c05a02175, scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e, user.id=b365d9dd635e4518a41181649c323062) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:45.548872 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6c98f-ad10-4f89-9290-054b247c2f0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:45.550309 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6c98f-ad10-4f89-9290-054b247c2f0d None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:45.556428 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 647/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 10:43:45 2022] GET /identity/v3/role_assignments?user.id=b365d9dd635e4518a41181649c323062&scope.project.id=61b2f5f9674c4fd3a1ec5db2f3b4b26e&role.id=4867b69c45554ce18e23167c05a02175 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:47.600840 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc014f60-f1a6-477d-a29c-361e49a86902 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:47.601733 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc014f60-f1a6-477d-a29c-361e49a86902 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:47.601733 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc014f60-f1a6-477d-a29c-361e49a86902 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:47.604283 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 641/1288] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:43:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:43:47.609792 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821d8cd-a588-486a-af2d-15495b5d233f None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:47.610234 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821d8cd-a588-486a-af2d-15495b5d233f None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:47.610334 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821d8cd-a588-486a-af2d-15495b5d233f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:47.629017 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-3821d8cd-a588-486a-af2d-15495b5d233f None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:47.630209 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-3821d8cd-a588-486a-af2d-15495b5d233f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:47.663066 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:47.702315 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 648/1289] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:43:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:43:47.725398 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc014f60-f1a6-477d-a29c-361e49a86902 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:47.834851 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc014f60-f1a6-477d-a29c-361e49a86902 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:47.845886 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:47.875776 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638298e5-e7df-4a8d-9a09-90babbb89dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:47.876504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638298e5-e7df-4a8d-9a09-90babbb89dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:47.876783 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638298e5-e7df-4a8d-9a09-90babbb89dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:47.877058 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638298e5-e7df-4a8d-9a09-90babbb89dc7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:47.877703 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638298e5-e7df-4a8d-9a09-90babbb89dc7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:47.879074 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638298e5-e7df-4a8d-9a09-90babbb89dc7 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:47.891136 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-638298e5-e7df-4a8d-9a09-90babbb89dc7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 10:43:47.891136 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:47.891136 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:43:47.891136 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:43:47.891136 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:43:47.891136 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:43:47.891136 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:43:47.891136 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:43:47.891136 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 10:43:47.891136 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:43:47.891136 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:43:47.891136 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:43:47.891136 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:47.891136 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:43:47.891136 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:43:47.891136 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:43:47.891136 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:43:47.892343 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:43:47.892343 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:43:47.892343 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:43:47.892343 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:43:47.892343 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:43:47.892343 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:43:47.892343 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:43:47.892343 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:43:47.892343 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:43:47.892343 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:43:47.892343 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:43:47.892343 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:43:47.892343 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:43:47.892343 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:43:47.892343 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:43:47.892343 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:43:47.893591 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:43:47.893591 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:43:47.893591 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:43:47.893591 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:43:47.893591 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:43:47.893591 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:43:47.893591 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:43:47.893591 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:43:47.893591 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:43:47.893591 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:43:47.893591 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:43:47.893591 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:43:47.893591 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 10:43:47.893591 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:43:47.893591 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 642/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jun 24 10:43:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:43:47.899076 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821d8cd-a588-486a-af2d-15495b5d233f None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:48.008945 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821d8cd-a588-486a-af2d-15495b5d233f None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:48.046769 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82edda-fdea-4db1-a249-90964b855b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:48.047461 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82edda-fdea-4db1-a249-90964b855b11 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:48.047743 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82edda-fdea-4db1-a249-90964b855b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:48.048021 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82edda-fdea-4db1-a249-90964b855b11 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:48.048734 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca82edda-fdea-4db1-a249-90964b855b11 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:48.049041 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca82edda-fdea-4db1-a249-90964b855b11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:48.050418 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca82edda-fdea-4db1-a249-90964b855b11 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:48.055817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 649/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Fri Jun 24 10:43:47 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:48.063458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638298e5-e7df-4a8d-9a09-90babbb89dc7 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:48.171892 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638298e5-e7df-4a8d-9a09-90babbb89dc7 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:48.206578 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf48e8-b4b5-4f06-8580-931d7e170320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:48.207254 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf48e8-b4b5-4f06-8580-931d7e170320 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:48.207543 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf48e8-b4b5-4f06-8580-931d7e170320 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:48.207814 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf48e8-b4b5-4f06-8580-931d7e170320 None admin] PATH_INFO: `/v3/services` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:48.208519 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf48e8-b4b5-4f06-8580-931d7e170320 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:48.208823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf48e8-b4b5-4f06-8580-931d7e170320 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:48.210220 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf48e8-b4b5-4f06-8580-931d7e170320 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:48.214870 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 643/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Fri Jun 24 10:43:48 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:50.237738 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2146e59-bbd7-4d73-b58f-c7eebf06fc36 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:50.238636 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2146e59-bbd7-4d73-b58f-c7eebf06fc36 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:50.238636 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2146e59-bbd7-4d73-b58f-c7eebf06fc36 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:50.240890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 650/1293] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:43:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:43:50.246216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4866cd-7545-493a-8390-91f6db6a7760 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:50.246650 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4866cd-7545-493a-8390-91f6db6a7760 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:50.246747 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4866cd-7545-493a-8390-91f6db6a7760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:50.264904 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-cc4866cd-7545-493a-8390-91f6db6a7760 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:50.266073 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-cc4866cd-7545-493a-8390-91f6db6a7760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:50.298485 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:50.346829 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 644/1294] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:43:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:43:50.373040 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2146e59-bbd7-4d73-b58f-c7eebf06fc36 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:50.407032 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:50.484397 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2146e59-bbd7-4d73-b58f-c7eebf06fc36 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:50.519133 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f18b96-0f9c-4811-bf37-3d8557b257b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:50.519752 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f18b96-0f9c-4811-bf37-3d8557b257b2 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:50.520036 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f18b96-0f9c-4811-bf37-3d8557b257b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:50.520309 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f18b96-0f9c-4811-bf37-3d8557b257b2 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:50.521039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f18b96-0f9c-4811-bf37-3d8557b257b2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:50.522412 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f18b96-0f9c-4811-bf37-3d8557b257b2 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:50.542329 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 651/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jun 24 10:43:50 2022] POST /identity/v3/services => generated 246 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:43:52.557024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e9f43-f4b7-4bab-80b1-19112f2933cc None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:52.557875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e9f43-f4b7-4bab-80b1-19112f2933cc None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:52.557875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e9f43-f4b7-4bab-80b1-19112f2933cc None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:52.560206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 645/1296] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:43:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:43:52.565719 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ba113-a93d-4362-9ccd-626613da918d None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:52.566133 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ba113-a93d-4362-9ccd-626613da918d None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:52.566249 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ba113-a93d-4362-9ccd-626613da918d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:52.584810 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-7d3ba113-a93d-4362-9ccd-626613da918d None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:52.586023 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-7d3ba113-a93d-4362-9ccd-626613da918d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:52.669136 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 652/1297] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:43:52 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:43:52.692698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e9f43-f4b7-4bab-80b1-19112f2933cc None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:52.808281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e9f43-f4b7-4bab-80b1-19112f2933cc None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:52.844717 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea901e4-f8c6-4645-899e-085fef6dc96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:52.845523 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea901e4-f8c6-4645-899e-085fef6dc96c None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:52.845805 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea901e4-f8c6-4645-899e-085fef6dc96c None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:52.846085 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea901e4-f8c6-4645-899e-085fef6dc96c None admin] PATH_INFO: `/v3/services/placement` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:52.846737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea901e4-f8c6-4645-899e-085fef6dc96c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:52.848153 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea901e4-f8c6-4645-899e-085fef6dc96c None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:52.860538 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-1ea901e4-f8c6-4645-899e-085fef6dc96c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 10:43:52.860538 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:52.860538 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:43:52.860538 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:43:52.860538 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:43:52.860538 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:43:52.860538 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:43:52.860538 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:43:52.860538 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 10:43:52.860538 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:43:52.860538 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:43:52.860538 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:43:52.860538 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:52.860538 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:43:52.860538 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:43:52.860538 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:43:52.860538 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:43:52.861563 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:43:52.861563 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:43:52.861563 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:43:52.861563 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:43:52.861563 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:43:52.861563 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:43:52.861563 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:43:52.861563 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:43:52.861563 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:43:52.861563 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:43:52.861563 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:43:52.861563 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:43:52.861563 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:43:52.861563 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:43:52.861563 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:43:52.861563 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:43:52.862434 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:43:52.862434 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:43:52.862434 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:43:52.862434 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:43:52.862434 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:43:52.862434 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:43:52.862434 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:43:52.862434 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:43:52.862434 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:43:52.862434 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:43:52.862434 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:43:52.862434 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:43:52.862434 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 10:43:52.862434 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:43:52.862434 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 646/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jun 24 10:43:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:43:52.868833 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ba113-a93d-4362-9ccd-626613da918d None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:52.899232 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:52.983660 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ba113-a93d-4362-9ccd-626613da918d None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:53.030200 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b9a8e-4652-4f0d-8874-3e7372fe8e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:53.030870 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b9a8e-4652-4f0d-8874-3e7372fe8e57 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:53.031174 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b9a8e-4652-4f0d-8874-3e7372fe8e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:53.031469 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b9a8e-4652-4f0d-8874-3e7372fe8e57 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:53.032185 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b9a8e-4652-4f0d-8874-3e7372fe8e57 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:53.032497 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b9a8e-4652-4f0d-8874-3e7372fe8e57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:53.033884 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b9a8e-4652-4f0d-8874-3e7372fe8e57 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:53.039512 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 653/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Fri Jun 24 10:43:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:53.045786 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea901e4-f8c6-4645-899e-085fef6dc96c None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:53.080165 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:53.151759 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea901e4-f8c6-4645-899e-085fef6dc96c None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:53.187688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf81b20-4a09-41ef-b02c-3a3e34e9e589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:53.188351 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf81b20-4a09-41ef-b02c-3a3e34e9e589 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:53.188637 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf81b20-4a09-41ef-b02c-3a3e34e9e589 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:53.188918 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf81b20-4a09-41ef-b02c-3a3e34e9e589 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:53.189703 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf81b20-4a09-41ef-b02c-3a3e34e9e589 None admin] RBAC: Adding query filter params (interface=public, service_id=70cd70143a1a41498a25ec7ae498c918, region_id=RegionOne) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:53.190015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf81b20-4a09-41ef-b02c-3a3e34e9e589 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:53.191393 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf81b20-4a09-41ef-b02c-3a3e34e9e589 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:53.196694 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 647/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Jun 24 10:43:53 2022] GET /identity/v3/endpoints?service_id=70cd70143a1a41498a25ec7ae498c918&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:53.202655 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b9a8e-4652-4f0d-8874-3e7372fe8e57 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:53.293650 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:53.314360 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b9a8e-4652-4f0d-8874-3e7372fe8e57 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:53.349684 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b1e2b-c404-4af7-9a10-0b0e064661f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:53.350344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b1e2b-c404-4af7-9a10-0b0e064661f8 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:53.350624 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b1e2b-c404-4af7-9a10-0b0e064661f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:53.350900 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b1e2b-c404-4af7-9a10-0b0e064661f8 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:53.351652 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b1e2b-c404-4af7-9a10-0b0e064661f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:53.353029 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b1e2b-c404-4af7-9a10-0b0e064661f8 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:53.359959 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 654/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Jun 24 10:43:53 2022] GET /identity/v3/services => generated 2191 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:43:55.410089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40fe9a-4c4d-4709-9281-755642e24cdc None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:55.410678 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40fe9a-4c4d-4709-9281-755642e24cdc None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:55.410678 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40fe9a-4c4d-4709-9281-755642e24cdc None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:55.412055 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 648/1302] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:43:55.418417 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780792a-663b-4695-aa5a-ecd0c7906baf None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:55.419091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780792a-663b-4695-aa5a-ecd0c7906baf None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:55.419353 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780792a-663b-4695-aa5a-ecd0c7906baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:55.447688 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-9780792a-663b-4695-aa5a-ecd0c7906baf None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:55.448886 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9780792a-663b-4695-aa5a-ecd0c7906baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:55.522565 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 655/1303] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:43:55 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:43:55.546129 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40fe9a-4c4d-4709-9281-755642e24cdc None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:55.651348 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:55.659411 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40fe9a-4c4d-4709-9281-755642e24cdc None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:55.699438 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88a922-50fc-4221-a6b6-0a18b601f187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:55.700183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88a922-50fc-4221-a6b6-0a18b601f187 None admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:55.700466 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88a922-50fc-4221-a6b6-0a18b601f187 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:55.700742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88a922-50fc-4221-a6b6-0a18b601f187 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:55.701388 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88a922-50fc-4221-a6b6-0a18b601f187 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:55.702752 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88a922-50fc-4221-a6b6-0a18b601f187 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:55.715502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application [None req-9d88a922-50fc-4221-a6b6-0a18b601f187 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 10:43:55.715502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:55.715502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:43:55.715502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:43:55.715502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:43:55.715502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:43:55.715502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:43:55.715502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:43:55.715502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 10:43:55.715502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:43:55.715502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:43:55.715502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:43:55.715502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:43:55.715502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:43:55.715502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:43:55.715502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:43:55.715502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:43:55.716688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:43:55.716688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:43:55.716688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:43:55.716688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:43:55.716688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:43:55.716688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:43:55.716688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:43:55.716688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:43:55.716688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:43:55.716688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:43:55.716688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:43:55.716688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:43:55.716688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:43:55.716688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:43:55.716688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:43:55.716688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:43:55.717715 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:43:55.717715 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application with Lock( Jun 24 10:43:55.717715 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:43:55.717715 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:43:55.717715 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:43:55.717715 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:43:55.717715 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:43:55.717715 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:43:55.717715 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:43:55.717715 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:43:55.717715 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:43:55.717715 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:43:55.717715 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 10:43:55.717715 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: ERROR keystone.server.flask.application Jun 24 10:43:55.717715 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 649/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jun 24 10:43:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:43:55.722972 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780792a-663b-4695-aa5a-ecd0c7906baf None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:55.804244 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:55.840784 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780792a-663b-4695-aa5a-ecd0c7906baf None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:55.877066 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005d582-dc07-48db-99d2-bdabd02ec324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:55.877726 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005d582-dc07-48db-99d2-bdabd02ec324 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:55.878016 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005d582-dc07-48db-99d2-bdabd02ec324 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:55.878293 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005d582-dc07-48db-99d2-bdabd02ec324 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:55.879006 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005d582-dc07-48db-99d2-bdabd02ec324 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:55.879344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005d582-dc07-48db-99d2-bdabd02ec324 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:55.880823 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005d582-dc07-48db-99d2-bdabd02ec324 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:55.886329 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 656/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Fri Jun 24 10:43:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:55.895577 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88a922-50fc-4221-a6b6-0a18b601f187 None admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:56.015337 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88a922-50fc-4221-a6b6-0a18b601f187 None admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:56.049791 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e22ae7-8510-4b07-9c19-11bdc958ec74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:56.050439 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e22ae7-8510-4b07-9c19-11bdc958ec74 None admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:56.050721 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e22ae7-8510-4b07-9c19-11bdc958ec74 None admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:56.051185 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e22ae7-8510-4b07-9c19-11bdc958ec74 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:56.051918 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e22ae7-8510-4b07-9c19-11bdc958ec74 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:56.053284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e22ae7-8510-4b07-9c19-11bdc958ec74 None admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:56.076886 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 650/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Jun 24 10:43:55 2022] POST /identity/v3/endpoints => generated 331 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:44:05.882957 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=30 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:06.072728 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:59.301899 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebea27-3133-4a4d-9fc9-109725cf77bf None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:59.302395 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebea27-3133-4a4d-9fc9-109725cf77bf None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:59.302493 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebea27-3133-4a4d-9fc9-109725cf77bf None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:59.303905 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 657/1307] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:44:59.310089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268e18b-cca2-4411-a40e-4c7fc0be86d2 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:59.310568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268e18b-cca2-4411-a40e-4c7fc0be86d2 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:59.310675 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268e18b-cca2-4411-a40e-4c7fc0be86d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:59.448326 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-8268e18b-cca2-4411-a40e-4c7fc0be86d2 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:44:59.450282 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-8268e18b-cca2-4411-a40e-4c7fc0be86d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:59.565354 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 651/1308] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:44:59.618953 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbe56e-0f7e-4215-ae48-588dce26c272 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:59.619806 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbe56e-0f7e-4215-ae48-588dce26c272 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:59.620276 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbe56e-0f7e-4215-ae48-588dce26c272 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:59.622645 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 658/1309] 10.222.0.16 () {54 vars in 964 bytes} [Fri Jun 24 10:44:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:44:59.632472 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da253c-1658-4b60-9d1e-4cbbf7657ae7 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:59.632736 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da253c-1658-4b60-9d1e-4cbbf7657ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:59.633047 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da253c-1658-4b60-9d1e-4cbbf7657ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:59.724645 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-58da253c-1658-4b60-9d1e-4cbbf7657ae7 None None] MFA Rules not processed for user `9c20321abda7406c843b4ee691da2106`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:44:59.726065 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-58da253c-1658-4b60-9d1e-4cbbf7657ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:59.750991 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:59.812429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 652/1310] 10.222.0.16 () {58 vars in 1061 bytes} [Fri Jun 24 10:44:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:44:59.821677 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbe56e-0f7e-4215-ae48-588dce26c272 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:59.823662 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-10cbe56e-0f7e-4215-ae48-588dce26c272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:59.947543 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbe56e-0f7e-4215-ae48-588dce26c272 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:45:00.025902 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c8f50-2815-469c-8b29-ce33f101fe16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:45:00.026769 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c8f50-2815-469c-8b29-ce33f101fe16 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:00.027142 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c8f50-2815-469c-8b29-ce33f101fe16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:00.027558 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c8f50-2815-469c-8b29-ce33f101fe16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:00.029356 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-3a1c8f50-2815-469c-8b29-ce33f101fe16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:00.087101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:45:00.145549 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c8f50-2815-469c-8b29-ce33f101fe16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:45:00.147196 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c8f50-2815-469c-8b29-ce33f101fe16 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:45:00.167648 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 659/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:44:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:45:02.511188 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf521e13-ca25-46d2-9118-16c6c5b13550 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:02.511769 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf521e13-ca25-46d2-9118-16c6c5b13550 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:02.511769 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf521e13-ca25-46d2-9118-16c6c5b13550 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:02.513347 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 653/1312] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:45:02.518602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a24c63-b4a4-4849-b823-c278cd2fb3bc None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:02.519047 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a24c63-b4a4-4849-b823-c278cd2fb3bc None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:02.519382 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a24c63-b4a4-4849-b823-c278cd2fb3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:02.608922 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-16a24c63-b4a4-4849-b823-c278cd2fb3bc None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:45:02.610335 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-16a24c63-b4a4-4849-b823-c278cd2fb3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:02.735203 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 660/1313] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:45:02.770491 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf521e13-ca25-46d2-9118-16c6c5b13550 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:45:02.772297 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-bf521e13-ca25-46d2-9118-16c6c5b13550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:02.891604 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf521e13-ca25-46d2-9118-16c6c5b13550 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:45:02.969352 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:45:02.972318 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5ce4d-01e6-44c1-851c-aea00395d440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:45:02.972994 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5ce4d-01e6-44c1-851c-aea00395d440 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:02.973515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5ce4d-01e6-44c1-851c-aea00395d440 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:02.973877 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5ce4d-01e6-44c1-851c-aea00395d440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:02.976174 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-7ca5ce4d-01e6-44c1-851c-aea00395d440 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:03.093873 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5ce4d-01e6-44c1-851c-aea00395d440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:45:03.095371 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5ce4d-01e6-44c1-851c-aea00395d440 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:45:03.116050 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 654/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:45:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:45:05.484786 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d8ac4-124e-4b7a-8c4a-0852fdb4ce3f None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:05.485324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d8ac4-124e-4b7a-8c4a-0852fdb4ce3f None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:05.485324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d8ac4-124e-4b7a-8c4a-0852fdb4ce3f None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:05.486638 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 661/1315] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:45:05.493334 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3087f-0fe2-4d23-8c9e-9268fba0321a None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:05.493765 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3087f-0fe2-4d23-8c9e-9268fba0321a None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:05.493859 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3087f-0fe2-4d23-8c9e-9268fba0321a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:05.567031 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-4dc3087f-0fe2-4d23-8c9e-9268fba0321a None None] MFA Rules not processed for user `b5108aa3ec1f4fa59fb30f4446107485`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:45:05.568490 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-4dc3087f-0fe2-4d23-8c9e-9268fba0321a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:05.622476 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:45:05.683031 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 655/1316] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:45:05 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:45:05.746377 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60062104-d20c-4156-b5ee-26886dc2ed2c None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:05.746588 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60062104-d20c-4156-b5ee-26886dc2ed2c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:05.746870 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60062104-d20c-4156-b5ee-26886dc2ed2c None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:05.748368 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 662/1317] 10.222.0.16 () {54 vars in 964 bytes} [Fri Jun 24 10:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:45:05.757579 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1256611-ce26-46c4-9e75-c2abeb906d76 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:05.758056 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1256611-ce26-46c4-9e75-c2abeb906d76 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:05.758514 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1256611-ce26-46c4-9e75-c2abeb906d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:05.842382 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-e1256611-ce26-46c4-9e75-c2abeb906d76 None None] MFA Rules not processed for user `9c20321abda7406c843b4ee691da2106`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:45:05.843618 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-e1256611-ce26-46c4-9e75-c2abeb906d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:05.926161 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 656/1318] 10.222.0.16 () {58 vars in 1061 bytes} [Fri Jun 24 10:45:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:45:05.936713 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60062104-d20c-4156-b5ee-26886dc2ed2c None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:45:05.939220 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-60062104-d20c-4156-b5ee-26886dc2ed2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:05.951385 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:45:06.052801 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60062104-d20c-4156-b5ee-26886dc2ed2c None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:45:06.140008 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4f5ad-4e15-4862-adc9-6157fc3c6cfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:45:06.140655 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4f5ad-4e15-4862-adc9-6157fc3c6cfc service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:06.140943 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4f5ad-4e15-4862-adc9-6157fc3c6cfc service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:06.141224 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4f5ad-4e15-4862-adc9-6157fc3c6cfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:06.142889 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a2e4f5ad-4e15-4862-adc9-6157fc3c6cfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:06.207106 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:45:06.256562 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e4f5ad-4e15-4862-adc9-6157fc3c6cfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:45:06.258009 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e4f5ad-4e15-4862-adc9-6157fc3c6cfc service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:45:06.276517 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 663/1319] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:45:05 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:45:09.227048 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92beb0-1599-407e-9865-e9f29d86d764 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:09.228139 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92beb0-1599-407e-9865-e9f29d86d764 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:09.228139 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92beb0-1599-407e-9865-e9f29d86d764 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:09.229160 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 657/1320] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:45:09.235490 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3ffb6-e5f6-4933-8aed-122bed32c095 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:09.235948 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3ffb6-e5f6-4933-8aed-122bed32c095 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:09.236069 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3ffb6-e5f6-4933-8aed-122bed32c095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:09.308970 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-92c3ffb6-e5f6-4933-8aed-122bed32c095 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:45:09.310270 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-92c3ffb6-e5f6-4933-8aed-122bed32c095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:09.410251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 664/1321] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:45:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:45:09.458442 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92beb0-1599-407e-9865-e9f29d86d764 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:45:09.460847 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-7f92beb0-1599-407e-9865-e9f29d86d764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:09.527494 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:45:09.585986 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92beb0-1599-407e-9865-e9f29d86d764 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:45:09.674746 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4184a95-6989-4065-8bdb-8640b5e8b929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:45:09.675367 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4184a95-6989-4065-8bdb-8640b5e8b929 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:09.675645 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4184a95-6989-4065-8bdb-8640b5e8b929 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:09.675920 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4184a95-6989-4065-8bdb-8640b5e8b929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:09.677570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-e4184a95-6989-4065-8bdb-8640b5e8b929 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:09.778141 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:45:09.792817 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4184a95-6989-4065-8bdb-8640b5e8b929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:45:09.794272 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4184a95-6989-4065-8bdb-8640b5e8b929 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:45:09.813964 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 658/1322] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:45:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:45:12.569934 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad050c0f-d8d9-46da-b44f-a202b4f266e1 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:12.570546 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad050c0f-d8d9-46da-b44f-a202b4f266e1 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:12.570546 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad050c0f-d8d9-46da-b44f-a202b4f266e1 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:12.572657 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 665/1323] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:45:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:45:12.577957 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d98ca-2c32-4784-86e7-fa705c3aec87 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:12.578386 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d98ca-2c32-4784-86e7-fa705c3aec87 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:12.578646 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d98ca-2c32-4784-86e7-fa705c3aec87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:12.657833 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-187d98ca-2c32-4784-86e7-fa705c3aec87 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:45:12.659083 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-187d98ca-2c32-4784-86e7-fa705c3aec87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:12.769765 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 659/1324] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:45:12.807486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad050c0f-d8d9-46da-b44f-a202b4f266e1 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:45:12.809069 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-ad050c0f-d8d9-46da-b44f-a202b4f266e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:12.830083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:45:12.928407 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad050c0f-d8d9-46da-b44f-a202b4f266e1 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:45:13.006641 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f301e2-123d-4936-b2c1-51f8c3f5ec8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:45:13.007310 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f301e2-123d-4936-b2c1-51f8c3f5ec8e service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:13.007598 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f301e2-123d-4936-b2c1-51f8c3f5ec8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:13.007867 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f301e2-123d-4936-b2c1-51f8c3f5ec8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:13.009993 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-36f301e2-123d-4936-b2c1-51f8c3f5ec8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:13.085210 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:45:13.125638 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f301e2-123d-4936-b2c1-51f8c3f5ec8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:45:13.127082 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f301e2-123d-4936-b2c1-51f8c3f5ec8e service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:45:13.145334 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 666/1325] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:45:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:45:15.237039 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4bc9b-cebd-4713-8fd5-5c507839c3fc None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:15.237610 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4bc9b-cebd-4713-8fd5-5c507839c3fc None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:15.237610 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4bc9b-cebd-4713-8fd5-5c507839c3fc None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:15.238902 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 660/1326] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:45:15.244733 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30cd58-ca95-4ebc-99f7-171dff0fafa8 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:15.245195 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30cd58-ca95-4ebc-99f7-171dff0fafa8 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:15.245320 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30cd58-ca95-4ebc-99f7-171dff0fafa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:15.317607 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-ec30cd58-ca95-4ebc-99f7-171dff0fafa8 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:45:15.318825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-ec30cd58-ca95-4ebc-99f7-171dff0fafa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:15.421193 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 667/1327] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:45:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:45:15.457351 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4bc9b-cebd-4713-8fd5-5c507839c3fc None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:45:15.458890 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-dab4bc9b-cebd-4713-8fd5-5c507839c3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:15.520495 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:45:15.568494 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4bc9b-cebd-4713-8fd5-5c507839c3fc None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:45:15.651800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3110d248-8271-4f14-b8a4-97d820e44dcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:45:15.652474 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110d248-8271-4f14-b8a4-97d820e44dcf service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:15.652761 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110d248-8271-4f14-b8a4-97d820e44dcf service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:15.653033 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110d248-8271-4f14-b8a4-97d820e44dcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:15.654707 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-3110d248-8271-4f14-b8a4-97d820e44dcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:15.770688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:45:15.773494 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3110d248-8271-4f14-b8a4-97d820e44dcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:45:15.775854 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3110d248-8271-4f14-b8a4-97d820e44dcf service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:45:15.796729 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 661/1328] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:45:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:45:17.853141 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbc303-a798-41e2-89b8-2173443db347 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:17.853720 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbc303-a798-41e2-89b8-2173443db347 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:17.853720 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbc303-a798-41e2-89b8-2173443db347 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:17.855103 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 668/1329] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:45:17.860429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d3d1d-4d2c-4a5b-885b-23bf7292c8aa None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:17.860874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d3d1d-4d2c-4a5b-885b-23bf7292c8aa None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:17.860972 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d3d1d-4d2c-4a5b-885b-23bf7292c8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:17.934109 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-813d3d1d-4d2c-4a5b-885b-23bf7292c8aa None None] MFA Rules not processed for user `b5108aa3ec1f4fa59fb30f4446107485`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:45:17.935400 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-813d3d1d-4d2c-4a5b-885b-23bf7292c8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:18.039908 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 662/1330] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:45:17 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:45:18.077879 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbc303-a798-41e2-89b8-2173443db347 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:45:18.079461 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-93dbc303-a798-41e2-89b8-2173443db347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:18.113043 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:45:18.195241 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbc303-a798-41e2-89b8-2173443db347 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:45:18.270896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c6535-733b-4e27-8267-d1b3a8f7d082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:45:18.271599 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c6535-733b-4e27-8267-d1b3a8f7d082 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:18.271884 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c6535-733b-4e27-8267-d1b3a8f7d082 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:18.272142 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c6535-733b-4e27-8267-d1b3a8f7d082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:18.273789 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-385c6535-733b-4e27-8267-d1b3a8f7d082 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:18.373439 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:45:18.405404 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c6535-733b-4e27-8267-d1b3a8f7d082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:45:18.406897 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c6535-733b-4e27-8267-d1b3a8f7d082 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:45:18.427925 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 669/1331] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:45:18 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:45:20.700746 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45078908-decc-4498-a66a-1de70775174a None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:20.701534 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45078908-decc-4498-a66a-1de70775174a None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:20.701804 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45078908-decc-4498-a66a-1de70775174a None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:20.704044 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 663/1332] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:45:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:45:20.709718 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fee942-6d7e-4080-b41c-cbd8512f1046 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:20.710164 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fee942-6d7e-4080-b41c-cbd8512f1046 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:20.710258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fee942-6d7e-4080-b41c-cbd8512f1046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:20.785947 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-26fee942-6d7e-4080-b41c-cbd8512f1046 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:45:20.787186 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-26fee942-6d7e-4080-b41c-cbd8512f1046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:20.909511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 670/1333] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:45:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:45:20.948586 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45078908-decc-4498-a66a-1de70775174a None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:45:20.951044 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-45078908-decc-4498-a66a-1de70775174a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:21.036345 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:45:21.077143 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45078908-decc-4498-a66a-1de70775174a None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:45:21.156607 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a3afb-0f07-4dca-b590-2614b682e2c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:45:21.157275 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a3afb-0f07-4dca-b590-2614b682e2c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:21.157562 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a3afb-0f07-4dca-b590-2614b682e2c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:21.157841 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a3afb-0f07-4dca-b590-2614b682e2c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:21.159588 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-de5a3afb-0f07-4dca-b590-2614b682e2c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:21.271409 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a3afb-0f07-4dca-b590-2614b682e2c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:45:21.272847 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a3afb-0f07-4dca-b590-2614b682e2c7 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:45:21.283219 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:45:21.293597 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 664/1334] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:45:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:45:23.460857 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641d90e-6cc1-4544-9551-1b86666a9258 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:23.461674 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641d90e-6cc1-4544-9551-1b86666a9258 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:23.461674 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641d90e-6cc1-4544-9551-1b86666a9258 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:23.464920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 671/1335] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:45:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:45:23.474054 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a90ea2-77a0-4757-a0f9-6d2d1256a3b1 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:23.474512 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a90ea2-77a0-4757-a0f9-6d2d1256a3b1 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:23.474616 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a90ea2-77a0-4757-a0f9-6d2d1256a3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:23.545273 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-86a90ea2-77a0-4757-a0f9-6d2d1256a3b1 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:45:23.546473 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-86a90ea2-77a0-4757-a0f9-6d2d1256a3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:23.671481 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 665/1336] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:45:23.715478 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641d90e-6cc1-4544-9551-1b86666a9258 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:45:23.717740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c641d90e-6cc1-4544-9551-1b86666a9258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:23.773530 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:45:23.839614 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641d90e-6cc1-4544-9551-1b86666a9258 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:45:23.914934 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec40dff-53b2-4589-9152-f7369c6c2228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:45:23.915768 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec40dff-53b2-4589-9152-f7369c6c2228 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:23.916035 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec40dff-53b2-4589-9152-f7369c6c2228 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:23.916301 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec40dff-53b2-4589-9152-f7369c6c2228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:23.918016 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-dec40dff-53b2-4589-9152-f7369c6c2228 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:24.013968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:45:24.050259 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec40dff-53b2-4589-9152-f7369c6c2228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:45:24.051749 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec40dff-53b2-4589-9152-f7369c6c2228 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:45:24.074857 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 672/1337] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:45:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:45:26.590012 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1df3e-bdce-4115-93d9-fc4e1721472c None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:26.590567 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1df3e-bdce-4115-93d9-fc4e1721472c None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:26.590567 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1df3e-bdce-4115-93d9-fc4e1721472c None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:26.591903 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 666/1338] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:45:26.598386 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ea77d-a7dc-47c1-bb9f-67ffc403f879 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:26.598824 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ea77d-a7dc-47c1-bb9f-67ffc403f879 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:26.598986 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ea77d-a7dc-47c1-bb9f-67ffc403f879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:26.679974 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-bb0ea77d-a7dc-47c1-bb9f-67ffc403f879 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:45:26.681797 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-bb0ea77d-a7dc-47c1-bb9f-67ffc403f879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:26.791654 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 673/1339] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:45:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:45:26.828477 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1df3e-bdce-4115-93d9-fc4e1721472c None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:45:26.830024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-7ee1df3e-bdce-4115-93d9-fc4e1721472c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:26.915318 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:45:26.946642 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1df3e-bdce-4115-93d9-fc4e1721472c None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:45:27.027753 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab3f61-42de-438f-8c01-7a01defc0ff4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:45:27.028405 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab3f61-42de-438f-8c01-7a01defc0ff4 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:27.028678 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab3f61-42de-438f-8c01-7a01defc0ff4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:27.028958 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab3f61-42de-438f-8c01-7a01defc0ff4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:27.030587 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-98ab3f61-42de-438f-8c01-7a01defc0ff4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:27.156698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab3f61-42de-438f-8c01-7a01defc0ff4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:45:27.158165 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab3f61-42de-438f-8c01-7a01defc0ff4 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:45:27.180827 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 667/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:45:26 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:45:31.306171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd8d30-f079-4da3-b31d-a20d2138bc7d None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:31.306854 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd8d30-f079-4da3-b31d-a20d2138bc7d None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:31.306854 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd8d30-f079-4da3-b31d-a20d2138bc7d None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:31.308317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 674/1341] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:45:31.314167 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714ab97-86a3-4d24-90d4-29ccc9e96f74 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:31.315235 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714ab97-86a3-4d24-90d4-29ccc9e96f74 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:31.315580 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714ab97-86a3-4d24-90d4-29ccc9e96f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:31.322749 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:45:31.394020 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-3714ab97-86a3-4d24-90d4-29ccc9e96f74 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:45:31.395312 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-3714ab97-86a3-4d24-90d4-29ccc9e96f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:31.505412 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 668/1342] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:45:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:45:31.545234 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd8d30-f079-4da3-b31d-a20d2138bc7d None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:45:31.547531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-52fd8d30-f079-4da3-b31d-a20d2138bc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:31.597738 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:45:31.645102 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd8d30-f079-4da3-b31d-a20d2138bc7d None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:45:31.648882 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed9d9f-cb1f-4dc4-bd68-07df30b2ca71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:45:31.649538 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed9d9f-cb1f-4dc4-bd68-07df30b2ca71 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:31.649822 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed9d9f-cb1f-4dc4-bd68-07df30b2ca71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:31.650128 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed9d9f-cb1f-4dc4-bd68-07df30b2ca71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:31.660194 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed9d9f-cb1f-4dc4-bd68-07df30b2ca71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:45:31.661636 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed9d9f-cb1f-4dc4-bd68-07df30b2ca71 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:45:31.671491 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 675/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:45:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:45:34.293939 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d0190-4341-4b94-bc8c-1950f92d4d70 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:34.294559 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d0190-4341-4b94-bc8c-1950f92d4d70 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:34.294559 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d0190-4341-4b94-bc8c-1950f92d4d70 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:34.295902 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 669/1344] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:45:34.301433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abd558-0941-4bb0-b3bc-96d177ad9d99 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:34.301860 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abd558-0941-4bb0-b3bc-96d177ad9d99 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:34.301973 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abd558-0941-4bb0-b3bc-96d177ad9d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:34.332873 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-c3abd558-0941-4bb0-b3bc-96d177ad9d99 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:45:34.334166 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c3abd558-0941-4bb0-b3bc-96d177ad9d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:34.412794 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 676/1345] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:45:34 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:45:34.451907 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d0190-4341-4b94-bc8c-1950f92d4d70 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:45:34.463588 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d0190-4341-4b94-bc8c-1950f92d4d70 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:45:34.467499 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea0af6-e059-452e-8e39-1562e69a6864 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:45:34.468172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea0af6-e059-452e-8e39-1562e69a6864 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:34.468456 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea0af6-e059-452e-8e39-1562e69a6864 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:34.468732 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea0af6-e059-452e-8e39-1562e69a6864 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:34.478911 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea0af6-e059-452e-8e39-1562e69a6864 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:45:34.480423 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea0af6-e059-452e-8e39-1562e69a6864 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:45:34.490992 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 670/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:45:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:45:38.756656 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292553ec-fdc2-4450-b18d-699c2aa995b5 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:38.757170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292553ec-fdc2-4450-b18d-699c2aa995b5 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:38.757271 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292553ec-fdc2-4450-b18d-699c2aa995b5 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:38.758802 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 677/1347] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:45:38.764426 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dda979-9d5a-40d2-94bd-dfdac8257478 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:38.764892 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dda979-9d5a-40d2-94bd-dfdac8257478 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:38.765098 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dda979-9d5a-40d2-94bd-dfdac8257478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:38.784126 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-22dda979-9d5a-40d2-94bd-dfdac8257478 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:45:38.785350 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-22dda979-9d5a-40d2-94bd-dfdac8257478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:38.794913 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 671/1348] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:45:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:45:38.833705 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292553ec-fdc2-4450-b18d-699c2aa995b5 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:45:38.845799 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292553ec-fdc2-4450-b18d-699c2aa995b5 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:45:38.849887 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15f681-6e65-4389-8d7c-d4c1e4195ed5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:45:38.850548 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15f681-6e65-4389-8d7c-d4c1e4195ed5 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:38.850831 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15f681-6e65-4389-8d7c-d4c1e4195ed5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:38.851112 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15f681-6e65-4389-8d7c-d4c1e4195ed5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:38.861012 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e15f681-6e65-4389-8d7c-d4c1e4195ed5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:45:38.862444 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e15f681-6e65-4389-8d7c-d4c1e4195ed5 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:45:38.872320 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 678/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:45:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:45:43.797919 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2e9fb-a24b-4b19-a0c9-b0c7ca5b1cda None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:43.798388 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2e9fb-a24b-4b19-a0c9-b0c7ca5b1cda None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:43.798476 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2e9fb-a24b-4b19-a0c9-b0c7ca5b1cda None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:43.801801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 672/1350] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jun 24 10:45:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:45:43.807493 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c4361-0aaf-4226-a4b4-9b41f7af6158 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:43.807957 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c4361-0aaf-4226-a4b4-9b41f7af6158 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:43.808037 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c4361-0aaf-4226-a4b4-9b41f7af6158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:43.911513 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-444c4361-0aaf-4226-a4b4-9b41f7af6158 None None] MFA Rules not processed for user `b365d9dd635e4518a41181649c323062`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:45:43.913251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-444c4361-0aaf-4226-a4b4-9b41f7af6158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:43.951364 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:45:44.023188 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 679/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jun 24 10:45:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:45:48.432439 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d743c-d668-4dc2-bb54-841dae4a5811 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:48.433073 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d743c-d668-4dc2-bb54-841dae4a5811 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:48.433073 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d743c-d668-4dc2-bb54-841dae4a5811 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:48.434544 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 673/1352] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jun 24 10:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:45:48.439617 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942aa5e-a174-4d27-b74d-6fa556c2ce0e None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:48.440647 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942aa5e-a174-4d27-b74d-6fa556c2ce0e None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:48.441126 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942aa5e-a174-4d27-b74d-6fa556c2ce0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:48.461297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-3942aa5e-a174-4d27-b74d-6fa556c2ce0e None None] MFA Rules not processed for user `b365d9dd635e4518a41181649c323062`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:45:48.462748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-3942aa5e-a174-4d27-b74d-6fa556c2ce0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:48.477242 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 680/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jun 24 10:45:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:45:48.778695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=72 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:45:49.777752 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfd3ce-64cc-4c86-ad07-c59e2df165ec None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:49.778421 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfd3ce-64cc-4c86-ad07-c59e2df165ec None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:49.778421 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfd3ce-64cc-4c86-ad07-c59e2df165ec None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:49.780022 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 674/1354] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jun 24 10:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:45:49.785170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c701c2-1431-4331-9744-ac1b12ff5a67 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:49.785597 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c701c2-1431-4331-9744-ac1b12ff5a67 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:49.785776 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c701c2-1431-4331-9744-ac1b12ff5a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:49.806018 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-c7c701c2-1431-4331-9744-ac1b12ff5a67 None None] MFA Rules not processed for user `b365d9dd635e4518a41181649c323062`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:45:49.807278 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c7c701c2-1431-4331-9744-ac1b12ff5a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:49.816583 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 681/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jun 24 10:45:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:45:53.410801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f57214-f13f-4cb4-b746-d036bb0142c2 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:53.411740 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f57214-f13f-4cb4-b746-d036bb0142c2 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:53.412023 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f57214-f13f-4cb4-b746-d036bb0142c2 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:53.418909 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 675/1356] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:45:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:45:53.419761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c617d68-7c5d-4fad-9e35-50a4cf5b2dbd None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:53.420224 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c617d68-7c5d-4fad-9e35-50a4cf5b2dbd None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:53.420443 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c617d68-7c5d-4fad-9e35-50a4cf5b2dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:53.440442 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-2c617d68-7c5d-4fad-9e35-50a4cf5b2dbd None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:45:53.441727 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-2c617d68-7c5d-4fad-9e35-50a4cf5b2dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:53.450602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 682/1357] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:45:53.506988 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58990bcf-5534-4a54-9b0a-bb7024e08dd2 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:53.508039 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58990bcf-5534-4a54-9b0a-bb7024e08dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:53.508608 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58990bcf-5534-4a54-9b0a-bb7024e08dd2 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:53.510840 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 676/1358] 10.222.0.16 () {54 vars in 961 bytes} [Fri Jun 24 10:45:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:45:53.521159 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d2586-269f-4910-ac7b-f6c9fb6074f2 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:53.521660 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d2586-269f-4910-ac7b-f6c9fb6074f2 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:53.522475 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d2586-269f-4910-ac7b-f6c9fb6074f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:53.577963 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-d36d2586-269f-4910-ac7b-f6c9fb6074f2 None None] MFA Rules not processed for user `e8034bad51144002a7386c975e412992`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:45:53.579231 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-d36d2586-269f-4910-ac7b-f6c9fb6074f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:53.674246 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 683/1359] 10.222.0.16 () {58 vars in 1058 bytes} [Fri Jun 24 10:45:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:45:53.682809 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58990bcf-5534-4a54-9b0a-bb7024e08dd2 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:45:53.698410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58990bcf-5534-4a54-9b0a-bb7024e08dd2 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:45:53.704277 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb067715-4a52-4499-9689-92af8441843f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:45:53.705194 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb067715-4a52-4499-9689-92af8441843f service nova] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:53.705564 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb067715-4a52-4499-9689-92af8441843f service nova] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:53.705957 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb067715-4a52-4499-9689-92af8441843f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:53.715267 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb067715-4a52-4499-9689-92af8441843f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:45:53.716983 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb067715-4a52-4499-9689-92af8441843f service nova] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:45:53.727222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 677/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:45:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:45:55.962752 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23d354-f08a-497f-907f-488fe9eef76b None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:55.963379 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23d354-f08a-497f-907f-488fe9eef76b None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:55.963379 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23d354-f08a-497f-907f-488fe9eef76b None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:55.964999 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 684/1361] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:45:55.970353 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf0a30-d6ae-4f20-a92b-4a8708b1289f None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:55.970765 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf0a30-d6ae-4f20-a92b-4a8708b1289f None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:55.970936 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf0a30-d6ae-4f20-a92b-4a8708b1289f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:55.989401 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-bfaf0a30-d6ae-4f20-a92b-4a8708b1289f None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:45:55.990868 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-bfaf0a30-d6ae-4f20-a92b-4a8708b1289f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:56.000055 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 678/1362] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:45:56.045308 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23d354-f08a-497f-907f-488fe9eef76b None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:45:56.060980 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23d354-f08a-497f-907f-488fe9eef76b None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:45:56.066502 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce563f8-99d1-445f-a74e-fc4898e4c08e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:45:56.067174 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce563f8-99d1-445f-a74e-fc4898e4c08e service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:56.067454 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce563f8-99d1-445f-a74e-fc4898e4c08e service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:56.067747 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce563f8-99d1-445f-a74e-fc4898e4c08e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:56.076750 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce563f8-99d1-445f-a74e-fc4898e4c08e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:45:56.078342 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce563f8-99d1-445f-a74e-fc4898e4c08e service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:45:56.088290 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 685/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:45:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:45:58.447429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704cacc-8d0a-40ee-91e4-2e6dc4d71350 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:58.447920 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704cacc-8d0a-40ee-91e4-2e6dc4d71350 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:58.448033 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704cacc-8d0a-40ee-91e4-2e6dc4d71350 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:58.449400 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 679/1364] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:45:58.454717 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f79fd-634a-43d5-9151-3946e76e6cbc None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:58.455138 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f79fd-634a-43d5-9151-3946e76e6cbc None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:58.465012 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f79fd-634a-43d5-9151-3946e76e6cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:58.474357 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-931f79fd-634a-43d5-9151-3946e76e6cbc None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:45:58.475434 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-931f79fd-634a-43d5-9151-3946e76e6cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:58.484032 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 686/1365] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:45:58.538177 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d043d2-0e4f-46b7-9ff4-f873869f566f None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:58.538386 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d043d2-0e4f-46b7-9ff4-f873869f566f None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:58.538665 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d043d2-0e4f-46b7-9ff4-f873869f566f None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:58.540135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 680/1366] 10.222.0.16 () {54 vars in 961 bytes} [Fri Jun 24 10:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:45:58.546096 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9193f0-5683-4925-ac2e-0e934abb764a None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:58.546385 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9193f0-5683-4925-ac2e-0e934abb764a None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:58.546663 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9193f0-5683-4925-ac2e-0e934abb764a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:58.566743 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-bf9193f0-5683-4925-ac2e-0e934abb764a None None] MFA Rules not processed for user `e8034bad51144002a7386c975e412992`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:45:58.567963 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-bf9193f0-5683-4925-ac2e-0e934abb764a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:58.578895 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 687/1367] 10.222.0.16 () {58 vars in 1058 bytes} [Fri Jun 24 10:45:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:45:58.586966 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d043d2-0e4f-46b7-9ff4-f873869f566f None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:45:58.602054 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d043d2-0e4f-46b7-9ff4-f873869f566f None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:45:58.608436 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec373e86-7e09-486e-8ec4-9d11b72d4e56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:45:58.609093 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec373e86-7e09-486e-8ec4-9d11b72d4e56 service nova] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:58.609378 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec373e86-7e09-486e-8ec4-9d11b72d4e56 service nova] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:58.609653 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec373e86-7e09-486e-8ec4-9d11b72d4e56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:58.618615 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec373e86-7e09-486e-8ec4-9d11b72d4e56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:45:58.620255 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec373e86-7e09-486e-8ec4-9d11b72d4e56 service nova] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:45:58.630542 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 681/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:45:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:46:00.731002 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6157ef-be72-4a71-a012-65a4ce10dac3 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:00.731618 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6157ef-be72-4a71-a012-65a4ce10dac3 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:00.731703 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6157ef-be72-4a71-a012-65a4ce10dac3 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:00.733054 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 688/1369] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:46:00.738664 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8710d-c878-4409-b90a-fbec3bd0417b None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:00.739084 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8710d-c878-4409-b90a-fbec3bd0417b None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:00.739319 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8710d-c878-4409-b90a-fbec3bd0417b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:00.758453 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-9de8710d-c878-4409-b90a-fbec3bd0417b None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:46:00.759993 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-9de8710d-c878-4409-b90a-fbec3bd0417b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:46:00.768756 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 682/1370] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:46:00.816170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6157ef-be72-4a71-a012-65a4ce10dac3 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:46:00.831929 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6157ef-be72-4a71-a012-65a4ce10dac3 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:46:00.837666 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbda7db-364e-454c-bb5e-dbff2ec532f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:46:00.838335 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbda7db-364e-454c-bb5e-dbff2ec532f8 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:00.838629 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbda7db-364e-454c-bb5e-dbff2ec532f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:00.838901 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbda7db-364e-454c-bb5e-dbff2ec532f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:00.847400 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbda7db-364e-454c-bb5e-dbff2ec532f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:46:00.848982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbda7db-364e-454c-bb5e-dbff2ec532f8 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:46:00.859025 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 689/1371] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:46:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:46:01.513274 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa49dd8-6f5b-4073-8b1a-1f7405547861 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:01.513467 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa49dd8-6f5b-4073-8b1a-1f7405547861 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:01.513722 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa49dd8-6f5b-4073-8b1a-1f7405547861 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:01.515337 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 683/1372] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:46:01.520748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e41cd3-59f0-46ca-b87f-bd58ec2cc743 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:01.521045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e41cd3-59f0-46ca-b87f-bd58ec2cc743 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:01.521326 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e41cd3-59f0-46ca-b87f-bd58ec2cc743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:01.540637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-d9e41cd3-59f0-46ca-b87f-bd58ec2cc743 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:46:01.541966 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-d9e41cd3-59f0-46ca-b87f-bd58ec2cc743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:46:01.550173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 690/1373] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:46:01.898356 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd691c1-4b59-42ef-84e3-a960ee40b8e2 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:01.898356 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd691c1-4b59-42ef-84e3-a960ee40b8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:01.898356 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd691c1-4b59-42ef-84e3-a960ee40b8e2 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:01.900398 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 684/1374] 10.222.0.16 () {54 vars in 963 bytes} [Fri Jun 24 10:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:46:01.904714 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051c17b-5458-4b5a-a6e2-aaec4efdf05c None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:01.905221 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051c17b-5458-4b5a-a6e2-aaec4efdf05c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:01.905221 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051c17b-5458-4b5a-a6e2-aaec4efdf05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:01.913192 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:46:01.962094 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-7051c17b-5458-4b5a-a6e2-aaec4efdf05c None None] MFA Rules not processed for user `b2f6668cb6244bba9e547ff95b2e6f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:46:01.964475 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-7051c17b-5458-4b5a-a6e2-aaec4efdf05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:46:02.036136 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 691/1375] 10.222.0.16 () {58 vars in 1060 bytes} [Fri Jun 24 10:46:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:46:02.044628 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd691c1-4b59-42ef-84e3-a960ee40b8e2 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:46:02.057202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd691c1-4b59-42ef-84e3-a960ee40b8e2 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:46:02.060929 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac90191-599a-48a9-b9ba-da3d8ec47ca1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:46:02.061595 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac90191-599a-48a9-b9ba-da3d8ec47ca1 service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:02.061880 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac90191-599a-48a9-b9ba-da3d8ec47ca1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:02.062163 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac90191-599a-48a9-b9ba-da3d8ec47ca1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:02.072406 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac90191-599a-48a9-b9ba-da3d8ec47ca1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:46:02.073874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac90191-599a-48a9-b9ba-da3d8ec47ca1 service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:46:02.084331 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 685/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:46:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:46:02.909810 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec0d2b-77f7-48e8-8a66-1f8a01fe08d9 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:02.910390 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec0d2b-77f7-48e8-8a66-1f8a01fe08d9 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:02.910390 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec0d2b-77f7-48e8-8a66-1f8a01fe08d9 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:02.912046 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 692/1377] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:46:02.920465 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd6f4d-f176-4aec-bab0-becfdf4d67aa None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:02.921170 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd6f4d-f176-4aec-bab0-becfdf4d67aa None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:02.921170 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd6f4d-f176-4aec-bab0-becfdf4d67aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:02.942114 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-21fd6f4d-f176-4aec-bab0-becfdf4d67aa None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:46:02.943477 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-21fd6f4d-f176-4aec-bab0-becfdf4d67aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:46:02.955686 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 686/1378] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:46:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:46:02.996410 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec0d2b-77f7-48e8-8a66-1f8a01fe08d9 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:46:03.018034 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec0d2b-77f7-48e8-8a66-1f8a01fe08d9 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:46:03.024168 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa52a9-d660-466f-bf5a-afd6ef348e8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:46:03.024876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa52a9-d660-466f-bf5a-afd6ef348e8d service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:03.025302 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa52a9-d660-466f-bf5a-afd6ef348e8d service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:03.025698 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa52a9-d660-466f-bf5a-afd6ef348e8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:03.034433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa52a9-d660-466f-bf5a-afd6ef348e8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:46:03.036232 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa52a9-d660-466f-bf5a-afd6ef348e8d service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:46:03.046582 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 693/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:46:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:46:05.101503 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ac5a7-ac8b-4bab-8302-d6e03cefdc44 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:05.102071 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ac5a7-ac8b-4bab-8302-d6e03cefdc44 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:05.102071 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ac5a7-ac8b-4bab-8302-d6e03cefdc44 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:05.103786 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 687/1380] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:46:05.109064 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa05b3e-9388-4c1f-a682-33d75eb93b5b None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:05.109471 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa05b3e-9388-4c1f-a682-33d75eb93b5b None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:05.109588 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa05b3e-9388-4c1f-a682-33d75eb93b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:05.128392 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-6aa05b3e-9388-4c1f-a682-33d75eb93b5b None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:46:05.129587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6aa05b3e-9388-4c1f-a682-33d75eb93b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:46:05.138659 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 694/1381] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:46:05.187495 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ac5a7-ac8b-4bab-8302-d6e03cefdc44 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:46:05.204287 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ac5a7-ac8b-4bab-8302-d6e03cefdc44 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:46:05.209781 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc54a4-1802-4a62-b6c9-d4cfb5ff4ce3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:46:05.210520 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc54a4-1802-4a62-b6c9-d4cfb5ff4ce3 service nova] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:05.210870 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc54a4-1802-4a62-b6c9-d4cfb5ff4ce3 service nova] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:05.211170 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc54a4-1802-4a62-b6c9-d4cfb5ff4ce3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:05.219917 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc54a4-1802-4a62-b6c9-d4cfb5ff4ce3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:46:05.221504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc54a4-1802-4a62-b6c9-d4cfb5ff4ce3 service nova] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:46:05.231418 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 688/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:46:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:46:07.299797 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b07586-ac48-4687-941c-67de9e713afb None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:07.300367 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b07586-ac48-4687-941c-67de9e713afb None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:07.300764 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b07586-ac48-4687-941c-67de9e713afb None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:07.302310 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 695/1383] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:46:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:46:07.308119 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b8335-f93b-414a-9b9a-c9d76fd3e095 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:07.308588 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b8335-f93b-414a-9b9a-c9d76fd3e095 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:07.308668 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b8335-f93b-414a-9b9a-c9d76fd3e095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:07.327847 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-181b8335-f93b-414a-9b9a-c9d76fd3e095 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:46:07.329134 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-181b8335-f93b-414a-9b9a-c9d76fd3e095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:46:07.338067 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 689/1384] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:46:07.381400 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b07586-ac48-4687-941c-67de9e713afb None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:46:07.397703 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b07586-ac48-4687-941c-67de9e713afb None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:46:07.404371 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1491b-01b5-44de-af1c-35482ee6e1bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:46:07.405024 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1491b-01b5-44de-af1c-35482ee6e1bb service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:07.405308 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1491b-01b5-44de-af1c-35482ee6e1bb service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:07.405708 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1491b-01b5-44de-af1c-35482ee6e1bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:07.415489 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1491b-01b5-44de-af1c-35482ee6e1bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:46:07.417146 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1491b-01b5-44de-af1c-35482ee6e1bb service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:46:07.428385 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 696/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:46:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:46:09.485173 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a8ea7-8043-4d6d-aa99-b1ae9ae10a92 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:09.485800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a8ea7-8043-4d6d-aa99-b1ae9ae10a92 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:09.485800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a8ea7-8043-4d6d-aa99-b1ae9ae10a92 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:09.487093 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 690/1386] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:46:09.492661 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2333fc-222d-4a2e-b862-5de7898e1219 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:09.493163 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2333fc-222d-4a2e-b862-5de7898e1219 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:09.493863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2333fc-222d-4a2e-b862-5de7898e1219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:09.513079 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-eb2333fc-222d-4a2e-b862-5de7898e1219 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:46:09.514282 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-eb2333fc-222d-4a2e-b862-5de7898e1219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:46:09.522320 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 697/1387] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:46:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:46:09.567489 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a8ea7-8043-4d6d-aa99-b1ae9ae10a92 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:46:09.583735 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a8ea7-8043-4d6d-aa99-b1ae9ae10a92 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:46:09.589359 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b87b7-2d09-4f47-9a4c-bf89ac1521a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:46:09.590018 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b87b7-2d09-4f47-9a4c-bf89ac1521a8 service nova] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:09.590303 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b87b7-2d09-4f47-9a4c-bf89ac1521a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:09.590580 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b87b7-2d09-4f47-9a4c-bf89ac1521a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:09.602363 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b87b7-2d09-4f47-9a4c-bf89ac1521a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:46:09.604522 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b87b7-2d09-4f47-9a4c-bf89ac1521a8 service nova] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:46:09.618613 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 691/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:46:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:46:11.752638 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159af202-d6e6-4197-9a65-a7b132182def None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:11.753245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159af202-d6e6-4197-9a65-a7b132182def None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:11.753245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159af202-d6e6-4197-9a65-a7b132182def None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:11.754566 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 698/1389] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:46:11.760720 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4e243-b2fb-4d82-992a-85d7720223fa None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:11.761182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4e243-b2fb-4d82-992a-85d7720223fa None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:11.761293 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4e243-b2fb-4d82-992a-85d7720223fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:11.784019 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-19d4e243-b2fb-4d82-992a-85d7720223fa None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:46:11.785289 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-19d4e243-b2fb-4d82-992a-85d7720223fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:46:11.794419 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 692/1390] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:46:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:46:11.842127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159af202-d6e6-4197-9a65-a7b132182def None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:46:11.863120 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159af202-d6e6-4197-9a65-a7b132182def None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:46:11.871715 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b2828-299a-43ca-a119-7b30aad8ee27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:46:11.872400 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b2828-299a-43ca-a119-7b30aad8ee27 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:11.872678 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b2828-299a-43ca-a119-7b30aad8ee27 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:11.872969 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b2828-299a-43ca-a119-7b30aad8ee27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:11.881892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b2828-299a-43ca-a119-7b30aad8ee27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:46:11.884255 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b2828-299a-43ca-a119-7b30aad8ee27 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:46:11.894161 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 699/1391] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:46:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:46:14.447215 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d83ba-2f46-43db-8084-e44536789bd1 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:14.447832 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d83ba-2f46-43db-8084-e44536789bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:14.447832 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d83ba-2f46-43db-8084-e44536789bd1 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:14.449337 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 693/1392] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:46:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:46:14.456961 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c4eaa-93f1-4132-9a23-f47cdd18032d None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:14.457624 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c4eaa-93f1-4132-9a23-f47cdd18032d None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:14.457624 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c4eaa-93f1-4132-9a23-f47cdd18032d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:14.477458 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-313c4eaa-93f1-4132-9a23-f47cdd18032d None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:46:14.478763 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-313c4eaa-93f1-4132-9a23-f47cdd18032d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:46:14.487270 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 700/1393] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:46:14.533501 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d83ba-2f46-43db-8084-e44536789bd1 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:46:14.557921 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d83ba-2f46-43db-8084-e44536789bd1 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:46:14.563562 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b31e07-ca87-48bb-8ce9-a1a62992a1a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:46:14.564277 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b31e07-ca87-48bb-8ce9-a1a62992a1a0 service nova] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:14.564544 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b31e07-ca87-48bb-8ce9-a1a62992a1a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:14.564827 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b31e07-ca87-48bb-8ce9-a1a62992a1a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:14.574160 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b31e07-ca87-48bb-8ce9-a1a62992a1a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:46:14.575835 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b31e07-ca87-48bb-8ce9-a1a62992a1a0 service nova] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:46:14.585517 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 694/1394] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:46:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:46:16.665103 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc65e8e-ae18-4945-91d0-ccabd6e9858b None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:16.665618 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc65e8e-ae18-4945-91d0-ccabd6e9858b None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:16.665618 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc65e8e-ae18-4945-91d0-ccabd6e9858b None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:16.667028 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 701/1395] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:46:16.672423 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079d0aa-5f1a-4ee1-bbd4-5ef90bac3458 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:16.672882 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079d0aa-5f1a-4ee1-bbd4-5ef90bac3458 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:16.672985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079d0aa-5f1a-4ee1-bbd4-5ef90bac3458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:16.690896 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-c079d0aa-5f1a-4ee1-bbd4-5ef90bac3458 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:46:16.692108 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-c079d0aa-5f1a-4ee1-bbd4-5ef90bac3458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:46:16.700161 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 695/1396] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:46:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:46:16.743813 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc65e8e-ae18-4945-91d0-ccabd6e9858b None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:46:16.760070 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc65e8e-ae18-4945-91d0-ccabd6e9858b None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:46:16.765817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24515242-d2c1-4f6b-849d-f5288648597e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:46:16.766466 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24515242-d2c1-4f6b-849d-f5288648597e service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:16.766759 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24515242-d2c1-4f6b-849d-f5288648597e service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:16.767040 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24515242-d2c1-4f6b-849d-f5288648597e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:16.775986 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24515242-d2c1-4f6b-849d-f5288648597e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:46:16.777569 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24515242-d2c1-4f6b-849d-f5288648597e service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:46:16.787825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 702/1397] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:46:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:46:17.107969 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67bcab-a072-421f-9c3d-cd3e97ca660c None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:17.108260 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67bcab-a072-421f-9c3d-cd3e97ca660c None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:17.108542 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67bcab-a072-421f-9c3d-cd3e97ca660c None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:17.110024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 696/1398] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:46:17.115644 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9527b2e-88ca-4b1c-af94-5f47fc7fe733 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:17.116074 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9527b2e-88ca-4b1c-af94-5f47fc7fe733 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:17.116428 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9527b2e-88ca-4b1c-af94-5f47fc7fe733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:17.135650 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-a9527b2e-88ca-4b1c-af94-5f47fc7fe733 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:46:17.136864 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a9527b2e-88ca-4b1c-af94-5f47fc7fe733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:46:17.145802 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 703/1399] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:46:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:46:17.201410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eae833-d600-4fde-8549-6cbb9c5e13f0 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:17.201672 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eae833-d600-4fde-8549-6cbb9c5e13f0 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:17.201989 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eae833-d600-4fde-8549-6cbb9c5e13f0 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:17.203409 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 697/1400] 10.222.0.16 () {54 vars in 962 bytes} [Fri Jun 24 10:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:46:17.208473 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84336bf-4494-4b40-853d-1d82e17b42d2 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:17.208770 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84336bf-4494-4b40-853d-1d82e17b42d2 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:17.209051 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84336bf-4494-4b40-853d-1d82e17b42d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:17.259636 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-e84336bf-4494-4b40-853d-1d82e17b42d2 None None] MFA Rules not processed for user `fcba737e66244fe2b5b6ec3dd17dabd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:46:17.260850 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e84336bf-4494-4b40-853d-1d82e17b42d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:46:17.293598 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:46:17.324449 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 704/1401] 10.222.0.16 () {58 vars in 1059 bytes} [Fri Jun 24 10:46:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:46:17.332468 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eae833-d600-4fde-8549-6cbb9c5e13f0 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:46:17.344492 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eae833-d600-4fde-8549-6cbb9c5e13f0 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:46:17.348648 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118cd65-1945-41a2-84c6-aeeefcfeb519 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcba737e66244fe2b5b6ec3dd17dabd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:46:17.349371 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118cd65-1945-41a2-84c6-aeeefcfeb519 service glance] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:17.349719 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118cd65-1945-41a2-84c6-aeeefcfeb519 service glance] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:17.350077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118cd65-1945-41a2-84c6-aeeefcfeb519 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:17.360564 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118cd65-1945-41a2-84c6-aeeefcfeb519 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:46:17.361919 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118cd65-1945-41a2-84c6-aeeefcfeb519 service glance] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:46:17.371707 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 698/1402] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:46:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:46:18.103258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688ac9b-21d6-4f70-a606-a55d759d3755 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:18.103731 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688ac9b-21d6-4f70-a606-a55d759d3755 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:18.103826 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688ac9b-21d6-4f70-a606-a55d759d3755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:18.158735 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-6688ac9b-21d6-4f70-a606-a55d759d3755 None None] MFA Rules not processed for user `4dfddd72dfa84ce39fe62112224b425d`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:46:18.160023 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6688ac9b-21d6-4f70-a606-a55d759d3755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:46:18.228168 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 705/1403] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jun 24 10:46:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:46:18.268984 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317491a-24c3-4f05-81ac-c6bac58ec7fe None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:18.269497 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317491a-24c3-4f05-81ac-c6bac58ec7fe None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:18.269497 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317491a-24c3-4f05-81ac-c6bac58ec7fe None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:18.270933 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 699/1404] 10.222.0.16 () {54 vars in 942 bytes} [Fri Jun 24 10:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:46:18.277517 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4495402-c15f-4bf6-9b1e-f0825f2d7086 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:18.277811 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4495402-c15f-4bf6-9b1e-f0825f2d7086 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:18.278149 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4495402-c15f-4bf6-9b1e-f0825f2d7086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:18.330613 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-d4495402-c15f-4bf6-9b1e-f0825f2d7086 None None] MFA Rules not processed for user `ff592d9ebd4241019625828ddd41aee8`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:46:18.331849 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-d4495402-c15f-4bf6-9b1e-f0825f2d7086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:46:18.404132 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 706/1405] 10.222.0.16 () {58 vars in 1039 bytes} [Fri Jun 24 10:46:18 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:46:18.413751 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317491a-24c3-4f05-81ac-c6bac58ec7fe None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:46:18.428317 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317491a-24c3-4f05-81ac-c6bac58ec7fe None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:46:18.433681 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc175620-f709-4b03-8172-445152925f28 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff592d9ebd4241019625828ddd41aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:46:18.434453 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc175620-f709-4b03-8172-445152925f28 service swift] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:18.434802 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc175620-f709-4b03-8172-445152925f28 service swift] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:18.435175 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc175620-f709-4b03-8172-445152925f28 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:18.443523 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc175620-f709-4b03-8172-445152925f28 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:46:18.445195 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc175620-f709-4b03-8172-445152925f28 service swift] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:46:18.453587 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 700/1406] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jun 24 10:46:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 10:46:18.870210 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafb02b-16f3-4377-bfdf-9e6dd6a505fb None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:18.870504 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafb02b-16f3-4377-bfdf-9e6dd6a505fb None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:18.870808 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafb02b-16f3-4377-bfdf-9e6dd6a505fb None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:18.872501 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 707/1407] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:46:18.877533 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3b541-261c-4611-b04f-02464e53f7e6 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:18.878003 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3b541-261c-4611-b04f-02464e53f7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:18.878384 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3b541-261c-4611-b04f-02464e53f7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:18.885536 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=67 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:46:18.900685 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-44c3b541-261c-4611-b04f-02464e53f7e6 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:46:18.901928 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-44c3b541-261c-4611-b04f-02464e53f7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:46:18.913918 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 701/1408] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:46:18.961374 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafb02b-16f3-4377-bfdf-9e6dd6a505fb None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:46:18.979435 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafb02b-16f3-4377-bfdf-9e6dd6a505fb None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:46:18.985261 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033988a-0c8c-4737-a134-a0919ad5a635 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:46:18.985936 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033988a-0c8c-4737-a134-a0919ad5a635 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:18.986207 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033988a-0c8c-4737-a134-a0919ad5a635 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:18.986487 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033988a-0c8c-4737-a134-a0919ad5a635 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:18.995872 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033988a-0c8c-4737-a134-a0919ad5a635 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:46:18.997481 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033988a-0c8c-4737-a134-a0919ad5a635 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:46:19.006817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:46:19.013584 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 708/1409] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:46:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:46:28.897146 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=2 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:46:40.738954 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69ce63-aee5-4409-9d4c-f9dc2b6beaa1 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:40.739714 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69ce63-aee5-4409-9d4c-f9dc2b6beaa1 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:40.739714 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69ce63-aee5-4409-9d4c-f9dc2b6beaa1 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:40.740933 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 702/1410] 10.222.0.16 () {54 vars in 918 bytes} [Fri Jun 24 10:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:46:40.747863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dac592-9fbb-4cf5-ab63-8274cf637f2a None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:40.748370 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dac592-9fbb-4cf5-ab63-8274cf637f2a None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:40.748487 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dac592-9fbb-4cf5-ab63-8274cf637f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:40.776821 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-74dac592-9fbb-4cf5-ab63-8274cf637f2a None None] MFA Rules not processed for user `b365d9dd635e4518a41181649c323062`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:46:40.778047 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-74dac592-9fbb-4cf5-ab63-8274cf637f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:46:40.787196 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 709/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Fri Jun 24 10:46:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:46:40.801956 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b03244-9474-42d3-a799-b39970ae7520 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:40.802237 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b03244-9474-42d3-a799-b39970ae7520 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:40.802510 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b03244-9474-42d3-a799-b39970ae7520 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:40.804252 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 703/1412] 10.222.0.16 () {54 vars in 918 bytes} [Fri Jun 24 10:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:46:40.809142 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a3627-00f5-4a42-b16a-c3c346681f83 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:40.809432 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a3627-00f5-4a42-b16a-c3c346681f83 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:40.809710 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a3627-00f5-4a42-b16a-c3c346681f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:40.827699 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-120a3627-00f5-4a42-b16a-c3c346681f83 None None] MFA Rules not processed for user `e8034bad51144002a7386c975e412992`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:46:40.828909 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-120a3627-00f5-4a42-b16a-c3c346681f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:46:40.838772 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 710/1413] 10.222.0.16 () {58 vars in 1015 bytes} [Fri Jun 24 10:46:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:46:43.334540 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad134bc8-c170-490d-9f92-1788cc779832 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:43.335093 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad134bc8-c170-490d-9f92-1788cc779832 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:43.335093 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad134bc8-c170-490d-9f92-1788cc779832 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:43.336384 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 10:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:46:43.341925 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dae2a6-3c30-4b0e-90bf-feea7959e6cd None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:43.342370 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dae2a6-3c30-4b0e-90bf-feea7959e6cd None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:43.342481 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dae2a6-3c30-4b0e-90bf-feea7959e6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:43.361868 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-63dae2a6-3c30-4b0e-90bf-feea7959e6cd None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:46:43.363056 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-63dae2a6-3c30-4b0e-90bf-feea7959e6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:46:43.371825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 10:46:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:46:43.419785 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad134bc8-c170-490d-9f92-1788cc779832 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:46:43.437076 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad134bc8-c170-490d-9f92-1788cc779832 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:46:43.444523 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9e61b-8516-4696-bc75-c64cd72924f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:46:43.445523 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9e61b-8516-4696-bc75-c64cd72924f2 service nova] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:43.445978 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9e61b-8516-4696-bc75-c64cd72924f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:43.446379 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9e61b-8516-4696-bc75-c64cd72924f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:43.455934 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf9e61b-8516-4696-bc75-c64cd72924f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:46:43.457531 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf9e61b-8516-4696-bc75-c64cd72924f2 service nova] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:46:43.467684 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 705/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:46:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:46:44.366783 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a1472-ba4c-456e-9bab-7ed2c7eade76 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:44.367431 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a1472-ba4c-456e-9bab-7ed2c7eade76 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:44.367431 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a1472-ba4c-456e-9bab-7ed2c7eade76 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:44.368985 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 10:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:46:44.375069 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597721a-e48f-4d52-be1b-715e9fbc0d39 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:44.375739 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597721a-e48f-4d52-be1b-715e9fbc0d39 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:44.375902 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597721a-e48f-4d52-be1b-715e9fbc0d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:44.398404 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-b597721a-e48f-4d52-be1b-715e9fbc0d39 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:46:44.399809 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-b597721a-e48f-4d52-be1b-715e9fbc0d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:46:44.409046 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 10:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:46:44.560813 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a1472-ba4c-456e-9bab-7ed2c7eade76 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:46:44.577612 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a1472-ba4c-456e-9bab-7ed2c7eade76 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:46:44.583560 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09eb3f-dd30-4f4b-bc07-a2f011dfc397 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:46:44.584199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09eb3f-dd30-4f4b-bc07-a2f011dfc397 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:44.584476 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09eb3f-dd30-4f4b-bc07-a2f011dfc397 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:44.584757 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09eb3f-dd30-4f4b-bc07-a2f011dfc397 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:44.593802 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad09eb3f-dd30-4f4b-bc07-a2f011dfc397 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:46:44.595402 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad09eb3f-dd30-4f4b-bc07-a2f011dfc397 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:46:44.605083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 713/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:46:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:46:45.500714 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300496d-613c-4b90-a4d4-9b5ecca31f2b None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:45.501253 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300496d-613c-4b90-a4d4-9b5ecca31f2b None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:45.501253 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300496d-613c-4b90-a4d4-9b5ecca31f2b None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:45.502575 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 10:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:46:45.508772 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be05a7-7403-4eec-8519-0af4c68fdabd None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:45.509781 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be05a7-7403-4eec-8519-0af4c68fdabd None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:45.509781 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be05a7-7403-4eec-8519-0af4c68fdabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:45.531296 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-31be05a7-7403-4eec-8519-0af4c68fdabd None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:46:45.532513 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-31be05a7-7403-4eec-8519-0af4c68fdabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:46:45.543907 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 10:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:46:45.697241 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300496d-613c-4b90-a4d4-9b5ecca31f2b None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:46:45.713540 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300496d-613c-4b90-a4d4-9b5ecca31f2b None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:46:45.720099 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e75320-6e0c-4f38-b20b-3cf0fdc558b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:46:45.720752 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e75320-6e0c-4f38-b20b-3cf0fdc558b3 service nova] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:45.721035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e75320-6e0c-4f38-b20b-3cf0fdc558b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:45.721308 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e75320-6e0c-4f38-b20b-3cf0fdc558b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:45.730020 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e75320-6e0c-4f38-b20b-3cf0fdc558b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:46:45.731641 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e75320-6e0c-4f38-b20b-3cf0fdc558b3 service nova] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:46:45.741071 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 708/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:46:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:46:46.610599 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67785e20-dec1-4cee-9cb8-45976bfeb14d None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:46.611221 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67785e20-dec1-4cee-9cb8-45976bfeb14d None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:46.611221 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67785e20-dec1-4cee-9cb8-45976bfeb14d None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:46.613216 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 10:46:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:46:46.621535 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfac0b8-5a1a-43f9-85ae-afa3e1a810af None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:46.621933 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfac0b8-5a1a-43f9-85ae-afa3e1a810af None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:46.622118 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfac0b8-5a1a-43f9-85ae-afa3e1a810af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:46.642864 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-ecfac0b8-5a1a-43f9-85ae-afa3e1a810af None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:46:46.644092 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-ecfac0b8-5a1a-43f9-85ae-afa3e1a810af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:46:46.653405 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 10:46:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:46:46.805864 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67785e20-dec1-4cee-9cb8-45976bfeb14d None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:46:46.823287 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67785e20-dec1-4cee-9cb8-45976bfeb14d None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:46:46.829244 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01be44-8293-452e-8c7b-0a1cf0f04740 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:46:46.829892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01be44-8293-452e-8c7b-0a1cf0f04740 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:46.830182 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01be44-8293-452e-8c7b-0a1cf0f04740 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:46.830465 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01be44-8293-452e-8c7b-0a1cf0f04740 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:46.839919 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01be44-8293-452e-8c7b-0a1cf0f04740 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:46:46.841503 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01be44-8293-452e-8c7b-0a1cf0f04740 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:46:46.851385 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 716/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:46:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:46:47.723494 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449ff25-f352-4de4-93c2-2bc2206b56a3 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:47.724035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449ff25-f352-4de4-93c2-2bc2206b56a3 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:47.724035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449ff25-f352-4de4-93c2-2bc2206b56a3 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:47.725446 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 10:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:46:47.730829 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8033bed-15c2-4c85-933a-da08cb5ac132 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:47.731298 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8033bed-15c2-4c85-933a-da08cb5ac132 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:47.731391 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8033bed-15c2-4c85-933a-da08cb5ac132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:47.750919 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-f8033bed-15c2-4c85-933a-da08cb5ac132 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:46:47.752162 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-f8033bed-15c2-4c85-933a-da08cb5ac132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:46:47.760833 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 10:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:46:47.909588 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449ff25-f352-4de4-93c2-2bc2206b56a3 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:46:47.929852 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449ff25-f352-4de4-93c2-2bc2206b56a3 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:46:47.937253 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ea0df-f6b4-4dc6-8f81-d23fc0114c6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:46:47.937889 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ea0df-f6b4-4dc6-8f81-d23fc0114c6a service nova] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:47.938176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ea0df-f6b4-4dc6-8f81-d23fc0114c6a service nova] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:47.938456 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ea0df-f6b4-4dc6-8f81-d23fc0114c6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:47.947356 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ea0df-f6b4-4dc6-8f81-d23fc0114c6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:46:47.948945 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ea0df-f6b4-4dc6-8f81-d23fc0114c6a service nova] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:46:47.959035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 711/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:46:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:46:48.783357 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba36dcd-8dca-4aee-b93c-4d4aab057374 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:48.783942 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba36dcd-8dca-4aee-b93c-4d4aab057374 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:48.783942 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba36dcd-8dca-4aee-b93c-4d4aab057374 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:48.786082 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 10:46:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:46:48.793207 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64c0ab-68b2-426b-9713-cf2c8ed49189 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:48.793680 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64c0ab-68b2-426b-9713-cf2c8ed49189 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:48.793800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64c0ab-68b2-426b-9713-cf2c8ed49189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:48.814088 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-1a64c0ab-68b2-426b-9713-cf2c8ed49189 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:46:48.815332 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-1a64c0ab-68b2-426b-9713-cf2c8ed49189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:46:48.824247 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 10:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:46:48.979597 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba36dcd-8dca-4aee-b93c-4d4aab057374 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:46:49.001429 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba36dcd-8dca-4aee-b93c-4d4aab057374 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:46:49.007746 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883fed2-8fe9-43a4-a8c4-f170858ae365 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:46:49.008423 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883fed2-8fe9-43a4-a8c4-f170858ae365 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:49.008709 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883fed2-8fe9-43a4-a8c4-f170858ae365 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:49.008980 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883fed2-8fe9-43a4-a8c4-f170858ae365 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:49.019691 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d883fed2-8fe9-43a4-a8c4-f170858ae365 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:46:49.021283 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d883fed2-8fe9-43a4-a8c4-f170858ae365 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:46:49.030895 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 719/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:46:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:46:49.833602 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf4760-3d9d-46e8-bf34-d6c286329db2 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:49.834123 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf4760-3d9d-46e8-bf34-d6c286329db2 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:49.834123 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf4760-3d9d-46e8-bf34-d6c286329db2 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:49.836291 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 10:46:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:46:49.842643 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de3c08-c36e-4ddb-93ad-d62b6c276435 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:49.843349 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de3c08-c36e-4ddb-93ad-d62b6c276435 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:49.843529 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de3c08-c36e-4ddb-93ad-d62b6c276435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:49.871087 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-02de3c08-c36e-4ddb-93ad-d62b6c276435 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:46:49.872357 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-02de3c08-c36e-4ddb-93ad-d62b6c276435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:46:49.881261 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 10:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:46:50.033618 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf4760-3d9d-46e8-bf34-d6c286329db2 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:46:50.057932 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf4760-3d9d-46e8-bf34-d6c286329db2 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:46:50.064592 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3702e416-dd44-458c-aa2a-cf7e521fe9c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:46:50.065244 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702e416-dd44-458c-aa2a-cf7e521fe9c6 service nova] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:50.065559 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702e416-dd44-458c-aa2a-cf7e521fe9c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:50.065833 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702e416-dd44-458c-aa2a-cf7e521fe9c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:50.075040 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3702e416-dd44-458c-aa2a-cf7e521fe9c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:46:50.076710 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3702e416-dd44-458c-aa2a-cf7e521fe9c6 service nova] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:46:50.086405 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 714/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:46:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:46:50.917695 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f67f0-d930-4b11-8be2-bcd5bc7c85bc None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:50.918530 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f67f0-d930-4b11-8be2-bcd5bc7c85bc None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:50.918530 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f67f0-d930-4b11-8be2-bcd5bc7c85bc None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:50.920689 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 10:46:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:46:50.929574 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1960e2-b3eb-480c-ab84-e12f32c31a90 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:50.930344 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1960e2-b3eb-480c-ab84-e12f32c31a90 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:50.930516 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1960e2-b3eb-480c-ab84-e12f32c31a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:50.956191 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-fc1960e2-b3eb-480c-ab84-e12f32c31a90 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:46:50.957395 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-fc1960e2-b3eb-480c-ab84-e12f32c31a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:46:50.966934 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 10:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:46:51.119896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f67f0-d930-4b11-8be2-bcd5bc7c85bc None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:46:51.139724 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f67f0-d930-4b11-8be2-bcd5bc7c85bc None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:46:51.146976 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23058155-7c5e-4924-8f2a-b9594d1f8b38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:46:51.147656 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23058155-7c5e-4924-8f2a-b9594d1f8b38 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:51.147935 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23058155-7c5e-4924-8f2a-b9594d1f8b38 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:51.148197 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23058155-7c5e-4924-8f2a-b9594d1f8b38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:51.157576 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23058155-7c5e-4924-8f2a-b9594d1f8b38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:46:51.159175 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23058155-7c5e-4924-8f2a-b9594d1f8b38 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:46:51.169470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 722/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:46:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:46:51.962905 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a643c-b019-4c79-a524-41a278da4f18 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:51.963514 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a643c-b019-4c79-a524-41a278da4f18 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:51.963514 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a643c-b019-4c79-a524-41a278da4f18 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:51.964779 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 10:46:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:46:51.970162 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7c564-c4b9-4be4-98bd-a7a8bcedf562 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:51.970636 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7c564-c4b9-4be4-98bd-a7a8bcedf562 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:51.970742 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7c564-c4b9-4be4-98bd-a7a8bcedf562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:51.990189 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-f5b7c564-c4b9-4be4-98bd-a7a8bcedf562 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:46:51.991453 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-f5b7c564-c4b9-4be4-98bd-a7a8bcedf562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:46:52.001273 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 10:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:46:52.153251 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a643c-b019-4c79-a524-41a278da4f18 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:46:52.172008 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a643c-b019-4c79-a524-41a278da4f18 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:46:52.178394 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d849b9f-90da-4268-b2ab-6d2a5419bcaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:46:52.179063 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d849b9f-90da-4268-b2ab-6d2a5419bcaa service nova] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:52.179395 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d849b9f-90da-4268-b2ab-6d2a5419bcaa service nova] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:52.179675 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d849b9f-90da-4268-b2ab-6d2a5419bcaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:52.188114 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d849b9f-90da-4268-b2ab-6d2a5419bcaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:46:52.189707 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d849b9f-90da-4268-b2ab-6d2a5419bcaa service nova] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:46:52.199362 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 717/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:46:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:46:54.125920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3648ae-bab7-4a9a-9466-63bc986eb928 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:54.126571 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3648ae-bab7-4a9a-9466-63bc986eb928 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:54.126571 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3648ae-bab7-4a9a-9466-63bc986eb928 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:54.128629 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 10:46:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:46:54.136498 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c5af3-4f42-4a61-81b9-388902670e45 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:54.136917 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c5af3-4f42-4a61-81b9-388902670e45 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:54.137051 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c5af3-4f42-4a61-81b9-388902670e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:54.157087 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-ff1c5af3-4f42-4a61-81b9-388902670e45 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:46:54.158282 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-ff1c5af3-4f42-4a61-81b9-388902670e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:46:54.167712 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 10:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:46:54.207762 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3648ae-bab7-4a9a-9466-63bc986eb928 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:46:54.209849 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-de3648ae-bab7-4a9a-9466-63bc986eb928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:46:54.224881 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3648ae-bab7-4a9a-9466-63bc986eb928 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:46:54.229168 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96133341-8854-4879-8299-6750d5ae1b86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:46:54.229811 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96133341-8854-4879-8299-6750d5ae1b86 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:54.230095 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96133341-8854-4879-8299-6750d5ae1b86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:54.230379 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96133341-8854-4879-8299-6750d5ae1b86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:54.240385 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96133341-8854-4879-8299-6750d5ae1b86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:46:54.241811 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96133341-8854-4879-8299-6750d5ae1b86 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:46:54.251555 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 725/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:46:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:46:56.430801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c41827-1a18-427f-b8b7-c9f1094d1958 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:56.432413 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c41827-1a18-427f-b8b7-c9f1094d1958 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:56.432413 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c41827-1a18-427f-b8b7-c9f1094d1958 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:56.434337 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 10:46:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:46:56.443586 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ad54c-c094-45bd-a387-2a0e345e3087 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:56.444324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ad54c-c094-45bd-a387-2a0e345e3087 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:56.444497 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ad54c-c094-45bd-a387-2a0e345e3087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:56.465249 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-6d1ad54c-c094-45bd-a387-2a0e345e3087 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:46:56.466444 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6d1ad54c-c094-45bd-a387-2a0e345e3087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:46:56.475749 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 10:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:46:56.518194 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c41827-1a18-427f-b8b7-c9f1094d1958 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:46:56.533336 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c41827-1a18-427f-b8b7-c9f1094d1958 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:46:56.537479 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296fe7d-06de-47fb-b2d1-f21d7a137b65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:46:56.538135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296fe7d-06de-47fb-b2d1-f21d7a137b65 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:56.538419 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296fe7d-06de-47fb-b2d1-f21d7a137b65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:56.538697 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296fe7d-06de-47fb-b2d1-f21d7a137b65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:56.548188 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296fe7d-06de-47fb-b2d1-f21d7a137b65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:46:56.549614 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296fe7d-06de-47fb-b2d1-f21d7a137b65 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:46:56.559730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 720/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:46:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:46:58.906761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed30ea-6ae3-46ec-89bf-9e96e7eafedf None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:58.907774 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed30ea-6ae3-46ec-89bf-9e96e7eafedf None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:58.907774 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed30ea-6ae3-46ec-89bf-9e96e7eafedf None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:58.909995 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 10:46:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:46:58.915631 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb7ab0-8f36-4abf-a25f-6175a4948745 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:58.916072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb7ab0-8f36-4abf-a25f-6175a4948745 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:58.916177 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb7ab0-8f36-4abf-a25f-6175a4948745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:58.937752 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-13eb7ab0-8f36-4abf-a25f-6175a4948745 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:46:58.938951 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-13eb7ab0-8f36-4abf-a25f-6175a4948745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:46:58.947534 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 10:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:46:58.986094 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed30ea-6ae3-46ec-89bf-9e96e7eafedf None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:46:59.001948 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed30ea-6ae3-46ec-89bf-9e96e7eafedf None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:46:59.006775 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aeabaf-fe2f-48f8-b63d-f75dc2e83fda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:46:59.007454 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aeabaf-fe2f-48f8-b63d-f75dc2e83fda service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:46:59.007739 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aeabaf-fe2f-48f8-b63d-f75dc2e83fda service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:46:59.008015 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aeabaf-fe2f-48f8-b63d-f75dc2e83fda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:46:59.018544 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aeabaf-fe2f-48f8-b63d-f75dc2e83fda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:46:59.020053 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aeabaf-fe2f-48f8-b63d-f75dc2e83fda service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:46:59.029949 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 728/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:46:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:47:01.171166 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa67bb-b7de-45b7-8142-5da451ecbf19 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:01.171607 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa67bb-b7de-45b7-8142-5da451ecbf19 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:01.171725 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa67bb-b7de-45b7-8142-5da451ecbf19 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:01.173110 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 10:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:47:01.179014 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612f9be-2313-4f28-9af7-7c92c0f96290 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:01.179507 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612f9be-2313-4f28-9af7-7c92c0f96290 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:01.179621 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612f9be-2313-4f28-9af7-7c92c0f96290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:01.197887 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-1612f9be-2313-4f28-9af7-7c92c0f96290 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:47:01.199083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1612f9be-2313-4f28-9af7-7c92c0f96290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:47:01.207443 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 10:47:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:47:01.246353 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa67bb-b7de-45b7-8142-5da451ecbf19 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:47:01.258411 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa67bb-b7de-45b7-8142-5da451ecbf19 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:47:01.262245 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e59ac5-1cb5-437e-b3c2-668e96585a7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:47:01.262895 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e59ac5-1cb5-437e-b3c2-668e96585a7a service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:01.263180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e59ac5-1cb5-437e-b3c2-668e96585a7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:01.263487 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e59ac5-1cb5-437e-b3c2-668e96585a7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:01.272830 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e59ac5-1cb5-437e-b3c2-668e96585a7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:47:01.274255 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e59ac5-1cb5-437e-b3c2-668e96585a7a service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:47:01.284064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 723/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:47:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:47:03.452554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7473c4-16cb-4a67-ba6a-9b4e9b2bf0fc None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:03.453085 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7473c4-16cb-4a67-ba6a-9b4e9b2bf0fc None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:03.453085 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7473c4-16cb-4a67-ba6a-9b4e9b2bf0fc None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:03.454404 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 10:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:47:03.460764 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be1158-5ca7-4773-814d-d67018cbebec None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:03.461433 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be1158-5ca7-4773-814d-d67018cbebec None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:03.461696 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be1158-5ca7-4773-814d-d67018cbebec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:03.481203 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-e0be1158-5ca7-4773-814d-d67018cbebec None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:47:03.482419 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-e0be1158-5ca7-4773-814d-d67018cbebec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:47:03.491839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 10:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:47:03.530709 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7473c4-16cb-4a67-ba6a-9b4e9b2bf0fc None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:47:03.548543 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7473c4-16cb-4a67-ba6a-9b4e9b2bf0fc None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:47:03.555606 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8375402-59bc-4460-b4be-8e868a5e0630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:47:03.556901 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8375402-59bc-4460-b4be-8e868a5e0630 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:03.556901 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8375402-59bc-4460-b4be-8e868a5e0630 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:03.557168 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8375402-59bc-4460-b4be-8e868a5e0630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:03.567823 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8375402-59bc-4460-b4be-8e868a5e0630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:47:03.569253 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8375402-59bc-4460-b4be-8e868a5e0630 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:47:03.579643 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 731/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:47:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:47:05.708789 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b4463-e833-4301-9cad-78143b120099 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:05.709364 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b4463-e833-4301-9cad-78143b120099 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:05.709364 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b4463-e833-4301-9cad-78143b120099 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:05.710741 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 10:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:47:05.717484 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a9d4f-7481-49e0-8c2a-fbe29ffa1111 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:05.717930 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a9d4f-7481-49e0-8c2a-fbe29ffa1111 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:05.718049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a9d4f-7481-49e0-8c2a-fbe29ffa1111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:05.746542 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-c84a9d4f-7481-49e0-8c2a-fbe29ffa1111 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:47:05.747768 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c84a9d4f-7481-49e0-8c2a-fbe29ffa1111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:47:05.756687 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 10:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:47:05.798589 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b4463-e833-4301-9cad-78143b120099 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:47:05.814368 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b4463-e833-4301-9cad-78143b120099 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:47:05.818785 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb3b49-2800-4942-b18e-7018bb1c7248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:47:05.819470 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb3b49-2800-4942-b18e-7018bb1c7248 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:05.819761 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb3b49-2800-4942-b18e-7018bb1c7248 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:05.820042 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb3b49-2800-4942-b18e-7018bb1c7248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:05.829449 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb3b49-2800-4942-b18e-7018bb1c7248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:47:05.830883 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb3b49-2800-4942-b18e-7018bb1c7248 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:47:05.840975 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 726/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:47:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:47:07.937644 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f81c4-72ef-4ad7-bd4f-5aecb3bf6f91 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:07.938193 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f81c4-72ef-4ad7-bd4f-5aecb3bf6f91 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:07.938193 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f81c4-72ef-4ad7-bd4f-5aecb3bf6f91 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:07.939518 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 10:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:47:07.944951 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b297743-f557-481b-9cd1-087364ceccd8 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:07.945393 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b297743-f557-481b-9cd1-087364ceccd8 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:07.945497 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b297743-f557-481b-9cd1-087364ceccd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:07.965309 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-0b297743-f557-481b-9cd1-087364ceccd8 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:47:07.966503 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-0b297743-f557-481b-9cd1-087364ceccd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:47:07.975124 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 10:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:47:08.013445 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f81c4-72ef-4ad7-bd4f-5aecb3bf6f91 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:47:08.025978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f81c4-72ef-4ad7-bd4f-5aecb3bf6f91 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:47:08.030072 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74516e-f6c4-415d-94e8-2f60522c8481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:47:08.030703 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74516e-f6c4-415d-94e8-2f60522c8481 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:08.030983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74516e-f6c4-415d-94e8-2f60522c8481 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:08.031275 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74516e-f6c4-415d-94e8-2f60522c8481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:08.040706 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74516e-f6c4-415d-94e8-2f60522c8481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:47:08.042143 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74516e-f6c4-415d-94e8-2f60522c8481 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:47:08.051795 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 734/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:47:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:47:10.175369 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e56c2-3b71-4173-a64a-f77d9ecef4e4 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:10.175941 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e56c2-3b71-4173-a64a-f77d9ecef4e4 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:10.175941 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e56c2-3b71-4173-a64a-f77d9ecef4e4 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:10.177596 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 10:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:47:10.184266 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362b11b-e41c-48c9-8abe-d098adc9cd50 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:10.184719 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362b11b-e41c-48c9-8abe-d098adc9cd50 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:10.184838 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362b11b-e41c-48c9-8abe-d098adc9cd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:10.194645 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=79 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:47:10.212637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-e362b11b-e41c-48c9-8abe-d098adc9cd50 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:47:10.214178 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e362b11b-e41c-48c9-8abe-d098adc9cd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:47:10.224424 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 10:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:47:10.262069 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e56c2-3b71-4173-a64a-f77d9ecef4e4 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:47:10.268385 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=73 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:47:10.276005 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e56c2-3b71-4173-a64a-f77d9ecef4e4 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:47:10.279923 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18b91d-842d-440e-a7ff-cc027e9973bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:47:10.280571 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18b91d-842d-440e-a7ff-cc027e9973bd service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:10.280826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18b91d-842d-440e-a7ff-cc027e9973bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:10.281099 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18b91d-842d-440e-a7ff-cc027e9973bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:10.290541 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18b91d-842d-440e-a7ff-cc027e9973bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:47:10.292012 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18b91d-842d-440e-a7ff-cc027e9973bd service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:47:10.301640 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 729/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:47:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:47:12.329197 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e51ca-261e-4d68-8b5e-bee0a23d42b6 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:12.329808 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e51ca-261e-4d68-8b5e-bee0a23d42b6 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:12.329808 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e51ca-261e-4d68-8b5e-bee0a23d42b6 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:12.331130 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 10:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:47:12.337562 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3eb4fb-153b-4e3e-8cb8-88aaa1f51e8f None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:12.338037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3eb4fb-153b-4e3e-8cb8-88aaa1f51e8f None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:12.338240 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3eb4fb-153b-4e3e-8cb8-88aaa1f51e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:12.358120 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-ef3eb4fb-153b-4e3e-8cb8-88aaa1f51e8f None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:47:12.359362 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-ef3eb4fb-153b-4e3e-8cb8-88aaa1f51e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:47:12.368032 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 10:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:47:12.407026 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e51ca-261e-4d68-8b5e-bee0a23d42b6 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:47:12.422894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e51ca-261e-4d68-8b5e-bee0a23d42b6 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:47:12.429549 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51720a0e-70de-400f-bd32-a69f6799d731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:47:12.430470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51720a0e-70de-400f-bd32-a69f6799d731 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:12.430818 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51720a0e-70de-400f-bd32-a69f6799d731 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:12.431084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51720a0e-70de-400f-bd32-a69f6799d731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:12.441524 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51720a0e-70de-400f-bd32-a69f6799d731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:47:12.443195 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51720a0e-70de-400f-bd32-a69f6799d731 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:47:12.453612 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 737/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:47:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:47:14.491928 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f462ac2-b848-466a-9de6-9ff15b249754 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:14.492787 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f462ac2-b848-466a-9de6-9ff15b249754 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:14.492787 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f462ac2-b848-466a-9de6-9ff15b249754 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:14.494957 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 10:47:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:47:14.500783 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad747390-d385-4006-ad07-8cb1590dd095 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:14.501240 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad747390-d385-4006-ad07-8cb1590dd095 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:14.501346 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad747390-d385-4006-ad07-8cb1590dd095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:14.521608 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-ad747390-d385-4006-ad07-8cb1590dd095 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:47:14.522822 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-ad747390-d385-4006-ad07-8cb1590dd095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:47:14.532153 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 10:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:47:14.568966 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f462ac2-b848-466a-9de6-9ff15b249754 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:47:14.581801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f462ac2-b848-466a-9de6-9ff15b249754 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:47:14.586778 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1180066-60de-4551-a8c5-891b7586d478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:47:14.587546 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1180066-60de-4551-a8c5-891b7586d478 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:14.587841 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1180066-60de-4551-a8c5-891b7586d478 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:14.588158 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1180066-60de-4551-a8c5-891b7586d478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:14.597969 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1180066-60de-4551-a8c5-891b7586d478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:47:14.599431 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1180066-60de-4551-a8c5-891b7586d478 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:47:14.609244 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 732/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:47:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:47:24.515699 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=11 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:47:24.605000 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=14 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:47:34.564312 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99718707-934f-4365-b6ea-52979adfcfe5 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:34.564958 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99718707-934f-4365-b6ea-52979adfcfe5 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:34.564958 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99718707-934f-4365-b6ea-52979adfcfe5 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:34.566266 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 739/1471] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:47:34.573339 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca07bc-a46f-41f6-b059-b834d0b13a92 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:34.573793 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca07bc-a46f-41f6-b059-b834d0b13a92 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:34.573899 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca07bc-a46f-41f6-b059-b834d0b13a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:34.599973 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-37ca07bc-a46f-41f6-b059-b834d0b13a92 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:47:34.601205 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-37ca07bc-a46f-41f6-b059-b834d0b13a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:47:34.611005 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 733/1472] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:47:34.658859 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b2e52-2588-4c52-ac78-0a043a105726 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:34.659191 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b2e52-2588-4c52-ac78-0a043a105726 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:34.659550 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b2e52-2588-4c52-ac78-0a043a105726 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:34.661717 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 740/1473] 10.222.0.16 () {54 vars in 962 bytes} [Fri Jun 24 10:47:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:47:34.670151 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3cd3bd-5d4a-4e90-8373-199194e986e3 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:34.670488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3cd3bd-5d4a-4e90-8373-199194e986e3 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:34.670873 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3cd3bd-5d4a-4e90-8373-199194e986e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:34.699024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-de3cd3bd-5d4a-4e90-8373-199194e986e3 None None] MFA Rules not processed for user `fcba737e66244fe2b5b6ec3dd17dabd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:47:34.700247 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-de3cd3bd-5d4a-4e90-8373-199194e986e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:47:34.708169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 734/1474] 10.222.0.16 () {58 vars in 1059 bytes} [Fri Jun 24 10:47:34 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:47:34.715650 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b2e52-2588-4c52-ac78-0a043a105726 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:47:34.726968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b2e52-2588-4c52-ac78-0a043a105726 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:47:34.730900 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc4a93-ac9e-41ce-8784-53f1042c59d8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcba737e66244fe2b5b6ec3dd17dabd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:47:34.731565 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc4a93-ac9e-41ce-8784-53f1042c59d8 service glance] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:34.731892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc4a93-ac9e-41ce-8784-53f1042c59d8 service glance] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:34.732178 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc4a93-ac9e-41ce-8784-53f1042c59d8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:34.741690 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc4a93-ac9e-41ce-8784-53f1042c59d8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:47:34.743141 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc4a93-ac9e-41ce-8784-53f1042c59d8 service glance] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:47:34.757247 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 741/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:47:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:47:36.900995 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee845c8-a434-4fe7-8f94-65b8025a2bab None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:36.901999 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee845c8-a434-4fe7-8f94-65b8025a2bab None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:36.901999 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee845c8-a434-4fe7-8f94-65b8025a2bab None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:36.904307 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 735/1476] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:47:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:47:36.913452 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d246ed-98a4-4c24-89ba-1108f6c291a1 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:36.914150 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d246ed-98a4-4c24-89ba-1108f6c291a1 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:36.914335 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d246ed-98a4-4c24-89ba-1108f6c291a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:36.935855 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-24d246ed-98a4-4c24-89ba-1108f6c291a1 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:47:36.937078 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-24d246ed-98a4-4c24-89ba-1108f6c291a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:47:36.946704 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 742/1477] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:47:36.971774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee845c8-a434-4fe7-8f94-65b8025a2bab None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:47:36.994692 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee845c8-a434-4fe7-8f94-65b8025a2bab None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:47:37.000658 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9bea03-b2ea-4ebc-8ac1-309e99a5b46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:47:37.001331 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bea03-b2ea-4ebc-8ac1-309e99a5b46c admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:37.001609 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bea03-b2ea-4ebc-8ac1-309e99a5b46c admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:37.001893 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bea03-b2ea-4ebc-8ac1-309e99a5b46c admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:37.002632 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9bea03-b2ea-4ebc-8ac1-309e99a5b46c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:47:37.004464 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: WARNING py.warnings [None req-7e9bea03-b2ea-4ebc-8ac1-309e99a5b46c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:47:37.004464 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: warnings.warn(msg) Jun 24 10:47:37.004464 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: Jun 24 10:47:37.005612 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9bea03-b2ea-4ebc-8ac1-309e99a5b46c admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:47:37.024957 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 736/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 10:47:36 2022] GET /identity/v3/projects => generated 2553 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:47:39.065708 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6999447-e88d-4732-a47e-841d4e5fc5c9 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:39.066504 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6999447-e88d-4732-a47e-841d4e5fc5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:39.066504 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6999447-e88d-4732-a47e-841d4e5fc5c9 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:39.068791 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 743/1479] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:47:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:47:39.077598 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215ac42-6c0d-4bda-97dd-63de8e2cec0e None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:39.078066 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215ac42-6c0d-4bda-97dd-63de8e2cec0e None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:39.078161 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215ac42-6c0d-4bda-97dd-63de8e2cec0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:39.106775 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-2215ac42-6c0d-4bda-97dd-63de8e2cec0e None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:47:39.108025 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-2215ac42-6c0d-4bda-97dd-63de8e2cec0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:47:39.116961 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 737/1480] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:47:39.164442 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6999447-e88d-4732-a47e-841d4e5fc5c9 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:47:39.181449 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6999447-e88d-4732-a47e-841d4e5fc5c9 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:47:39.188279 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2de7c-bab8-4f33-8d51-b77f2a094f11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:47:39.188916 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2de7c-bab8-4f33-8d51-b77f2a094f11 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:39.189196 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2de7c-bab8-4f33-8d51-b77f2a094f11 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:39.189472 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2de7c-bab8-4f33-8d51-b77f2a094f11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:39.198599 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2de7c-bab8-4f33-8d51-b77f2a094f11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:47:39.200210 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2de7c-bab8-4f33-8d51-b77f2a094f11 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:47:39.210038 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 744/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:47:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:47:41.459777 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d000081-24bc-4a47-9e94-c28779cd0ef5 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:41.460318 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d000081-24bc-4a47-9e94-c28779cd0ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:41.460318 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d000081-24bc-4a47-9e94-c28779cd0ef5 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:41.461627 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 738/1482] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:47:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:47:41.467301 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18addf-96cf-4782-8b45-718e88bdea74 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:41.467751 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18addf-96cf-4782-8b45-718e88bdea74 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:41.467860 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18addf-96cf-4782-8b45-718e88bdea74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:41.486561 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-0b18addf-96cf-4782-8b45-718e88bdea74 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:47:41.487796 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-0b18addf-96cf-4782-8b45-718e88bdea74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:47:41.496350 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 745/1483] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:47:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:47:41.535876 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d000081-24bc-4a47-9e94-c28779cd0ef5 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:47:41.555339 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d000081-24bc-4a47-9e94-c28779cd0ef5 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:47:41.560984 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db17604-acdf-42e6-8740-6ff2bc97555d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:47:41.561641 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db17604-acdf-42e6-8740-6ff2bc97555d service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:41.561927 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db17604-acdf-42e6-8740-6ff2bc97555d service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:41.562204 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db17604-acdf-42e6-8740-6ff2bc97555d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:41.572255 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db17604-acdf-42e6-8740-6ff2bc97555d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:47:41.573868 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db17604-acdf-42e6-8740-6ff2bc97555d service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:47:41.584075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 739/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:47:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:47:43.660857 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3f292-3fa8-40fc-9b42-e1b7a4cc9b4c None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:43.661336 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3f292-3fa8-40fc-9b42-e1b7a4cc9b4c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:43.661445 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3f292-3fa8-40fc-9b42-e1b7a4cc9b4c None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:43.663555 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 746/1485] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:47:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:47:43.670765 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7facac-7362-488d-bbf0-9b57e0dae5bf None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:43.671212 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7facac-7362-488d-bbf0-9b57e0dae5bf None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:43.671377 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7facac-7362-488d-bbf0-9b57e0dae5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:43.691740 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-5b7facac-7362-488d-bbf0-9b57e0dae5bf None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:47:43.692947 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-5b7facac-7362-488d-bbf0-9b57e0dae5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:47:43.701418 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 740/1486] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:47:43.742244 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3f292-3fa8-40fc-9b42-e1b7a4cc9b4c None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:47:43.761432 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3f292-3fa8-40fc-9b42-e1b7a4cc9b4c None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:47:43.767447 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0727a9-d678-48fb-ab29-62f6f4774c54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:47:43.768371 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0727a9-d678-48fb-ab29-62f6f4774c54 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:43.768748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0727a9-d678-48fb-ab29-62f6f4774c54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:43.769085 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0727a9-d678-48fb-ab29-62f6f4774c54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:43.781430 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0727a9-d678-48fb-ab29-62f6f4774c54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:47:43.782865 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0727a9-d678-48fb-ab29-62f6f4774c54 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:47:43.792397 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 747/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:47:45.915320 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaf5bb-b419-4b3c-a247-dd5d1b3ee0a5 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:45.915855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaf5bb-b419-4b3c-a247-dd5d1b3ee0a5 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:45.915855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaf5bb-b419-4b3c-a247-dd5d1b3ee0a5 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:45.917546 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 741/1488] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:47:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:47:45.923250 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f318f-712d-475e-a9d7-56c306fd10d1 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:45.923675 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f318f-712d-475e-a9d7-56c306fd10d1 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:45.923808 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f318f-712d-475e-a9d7-56c306fd10d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:45.948347 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-387f318f-712d-475e-a9d7-56c306fd10d1 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:47:45.949573 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-387f318f-712d-475e-a9d7-56c306fd10d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:47:45.958027 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 748/1489] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:47:45.998116 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aaf5bb-b419-4b3c-a247-dd5d1b3ee0a5 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:47:46.010346 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aaf5bb-b419-4b3c-a247-dd5d1b3ee0a5 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:47:46.015332 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263175f9-bbda-4e22-b750-b384a52ccd21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:47:46.015989 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263175f9-bbda-4e22-b750-b384a52ccd21 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:46.016274 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263175f9-bbda-4e22-b750-b384a52ccd21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:46.016546 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263175f9-bbda-4e22-b750-b384a52ccd21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:46.027042 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263175f9-bbda-4e22-b750-b384a52ccd21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:47:46.028550 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263175f9-bbda-4e22-b750-b384a52ccd21 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:47:46.038081 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 742/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:47:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:47:48.301750 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252313ef-9f3d-4214-8fb2-43170eaca5c4 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:48.302350 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252313ef-9f3d-4214-8fb2-43170eaca5c4 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:48.302350 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252313ef-9f3d-4214-8fb2-43170eaca5c4 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:48.303750 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 749/1491] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 10:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:47:48.309704 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee2df5-9266-4d6f-bdbe-5d3077137297 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:48.310153 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee2df5-9266-4d6f-bdbe-5d3077137297 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:48.310269 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee2df5-9266-4d6f-bdbe-5d3077137297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:48.330765 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-6cee2df5-9266-4d6f-bdbe-5d3077137297 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:47:48.332021 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-6cee2df5-9266-4d6f-bdbe-5d3077137297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:47:48.341495 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 743/1492] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 10:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:47:48.380740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252313ef-9f3d-4214-8fb2-43170eaca5c4 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:47:48.401385 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252313ef-9f3d-4214-8fb2-43170eaca5c4 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:47:48.405373 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a27dac-1c04-473b-b075-10945ecf6d07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:47:48.406134 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a27dac-1c04-473b-b075-10945ecf6d07 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:47:48.406419 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a27dac-1c04-473b-b075-10945ecf6d07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:47:48.406696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a27dac-1c04-473b-b075-10945ecf6d07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:47:48.416355 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a27dac-1c04-473b-b075-10945ecf6d07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:47:48.417788 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a27dac-1c04-473b-b075-10945ecf6d07 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:47:48.427541 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 750/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:47:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:47:58.324642 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=33 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:47:58.423223 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=33 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:49:38.148066 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe5dd9-db23-4c14-beae-ef9bf8dfb7a4 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:49:38.148676 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe5dd9-db23-4c14-beae-ef9bf8dfb7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:49:38.148676 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe5dd9-db23-4c14-beae-ef9bf8dfb7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:49:38.177192 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-3fbe5dd9-db23-4c14-beae-ef9bf8dfb7a4 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:49:38.178405 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-3fbe5dd9-db23-4c14-beae-ef9bf8dfb7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:49:38.188249 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 744/1494] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:49:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:49:38.197585 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117b3d5-65bb-422d-9de7-26df048c9d6e None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:49:38.198117 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117b3d5-65bb-422d-9de7-26df048c9d6e None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:49:38.198117 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117b3d5-65bb-422d-9de7-26df048c9d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:49:38.217937 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-b117b3d5-65bb-422d-9de7-26df048c9d6e None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:49:38.219142 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b117b3d5-65bb-422d-9de7-26df048c9d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:49:38.228662 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 751/1495] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:49:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:49:38.233373 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe5dd9-db23-4c14-beae-ef9bf8dfb7a4 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:49:38.243938 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe5dd9-db23-4c14-beae-ef9bf8dfb7a4 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:49:38.250178 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5c064-967e-4e35-a85d-dd030422b15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:49:38.250842 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5c064-967e-4e35-a85d-dd030422b15d admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:49:38.251125 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5c064-967e-4e35-a85d-dd030422b15d admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:49:38.251430 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5c064-967e-4e35-a85d-dd030422b15d admin admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:49:38.252160 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5c064-967e-4e35-a85d-dd030422b15d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:49:38.252464 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5c064-967e-4e35-a85d-dd030422b15d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:49:38.253492 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: WARNING py.warnings [None req-78c5c064-967e-4e35-a85d-dd030422b15d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:49:38.253492 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: warnings.warn(msg) Jun 24 10:49:38.253492 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: Jun 24 10:49:38.254361 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5c064-967e-4e35-a85d-dd030422b15d admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:49:38.266600 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 745/1496] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:49:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:49:38.275044 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117b3d5-65bb-422d-9de7-26df048c9d6e None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:49:38.290020 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117b3d5-65bb-422d-9de7-26df048c9d6e None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:49:38.298470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49075b45-c24e-4744-8033-c644e2c96663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:49:38.299481 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49075b45-c24e-4744-8033-c644e2c96663 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:49:38.299891 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49075b45-c24e-4744-8033-c644e2c96663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:49:38.300244 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49075b45-c24e-4744-8033-c644e2c96663 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:49:38.301325 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49075b45-c24e-4744-8033-c644e2c96663 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:49:38.303798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: WARNING py.warnings [None req-49075b45-c24e-4744-8033-c644e2c96663 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:49:38.303798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: warnings.warn(msg) Jun 24 10:49:38.303798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: Jun 24 10:49:38.305012 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49075b45-c24e-4744-8033-c644e2c96663 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:49:38.352242 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 752/1497] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:49:38 2022] POST /identity/v3/projects => generated 379 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:49:38.358655 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5c064-967e-4e35-a85d-dd030422b15d admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:49:38.374764 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5c064-967e-4e35-a85d-dd030422b15d admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:49:38.439977 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8682d4-56b4-48a7-878f-7274b764cd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:49:38.440571 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8682d4-56b4-48a7-878f-7274b764cd4e admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:49:38.440852 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8682d4-56b4-48a7-878f-7274b764cd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:49:38.441131 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8682d4-56b4-48a7-878f-7274b764cd4e admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:49:38.441826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8682d4-56b4-48a7-878f-7274b764cd4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:49:38.443238 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: WARNING py.warnings [None req-eb8682d4-56b4-48a7-878f-7274b764cd4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:49:38.443238 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: warnings.warn(msg) Jun 24 10:49:38.443238 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: Jun 24 10:49:38.444441 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8682d4-56b4-48a7-878f-7274b764cd4e admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:49:38.466337 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 746/1498] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:49:38 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:49:38.470740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49075b45-c24e-4744-8033-c644e2c96663 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:49:38.481189 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49075b45-c24e-4744-8033-c644e2c96663 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:49:38.485851 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52762bb6-96d5-4f9b-8196-c0a4ad0a361a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:49:38.486514 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52762bb6-96d5-4f9b-8196-c0a4ad0a361a admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:49:38.486801 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52762bb6-96d5-4f9b-8196-c0a4ad0a361a admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:49:38.487081 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52762bb6-96d5-4f9b-8196-c0a4ad0a361a admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:49:38.487849 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52762bb6-96d5-4f9b-8196-c0a4ad0a361a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:49:38.488879 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: WARNING py.warnings [None req-52762bb6-96d5-4f9b-8196-c0a4ad0a361a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:49:38.488879 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: warnings.warn(msg) Jun 24 10:49:38.488879 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: Jun 24 10:49:38.489769 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52762bb6-96d5-4f9b-8196-c0a4ad0a361a admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:49:38.502685 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 753/1499] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:49:38.507409 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8682d4-56b4-48a7-878f-7274b764cd4e admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:49:38.517744 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8682d4-56b4-48a7-878f-7274b764cd4e admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:49:38.522823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e9199-49ba-4c5f-95fa-4c9090a413a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:49:38.523518 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e9199-49ba-4c5f-95fa-4c9090a413a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:49:38.523809 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e9199-49ba-4c5f-95fa-4c9090a413a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:49:38.524094 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e9199-49ba-4c5f-95fa-4c9090a413a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:49:38.524822 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8e9199-49ba-4c5f-95fa-4c9090a413a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:49:38.525844 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: WARNING py.warnings [None req-1c8e9199-49ba-4c5f-95fa-4c9090a413a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:49:38.525844 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: warnings.warn(msg) Jun 24 10:49:38.525844 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: Jun 24 10:49:38.526727 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8e9199-49ba-4c5f-95fa-4c9090a413a8 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:49:38.540545 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 747/1500] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:49:38.545054 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52762bb6-96d5-4f9b-8196-c0a4ad0a361a admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:49:38.555699 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52762bb6-96d5-4f9b-8196-c0a4ad0a361a admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:49:38.561324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50dcf22-4b65-4c63-a851-4bffbd615495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:49:38.562211 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dcf22-4b65-4c63-a851-4bffbd615495 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:49:38.562495 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dcf22-4b65-4c63-a851-4bffbd615495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:49:38.562774 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dcf22-4b65-4c63-a851-4bffbd615495 admin admin] PATH_INFO: `/v3/projects/a849e313a9ba4a2abc4eda7f59add82f/users/0cc4d1f3226944498ce98a39cc996f28/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:49:38.578807 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50dcf22-4b65-4c63-a851-4bffbd615495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a849e313a9ba4a2abc4eda7f59add82f, user_id=0cc4d1f3226944498ce98a39cc996f28, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:49:38.579967 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: WARNING py.warnings [None req-b50dcf22-4b65-4c63-a851-4bffbd615495 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:49:38.579967 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: warnings.warn(msg) Jun 24 10:49:38.579967 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: Jun 24 10:49:38.581987 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50dcf22-4b65-4c63-a851-4bffbd615495 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:49:38.598941 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 754/1501] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:49:38 2022] PUT /identity/v3/projects/a849e313a9ba4a2abc4eda7f59add82f/users/0cc4d1f3226944498ce98a39cc996f28/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:49:38.612121 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97deccef-caee-4a00-baa6-2f6644e8817f None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:49:38.612415 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97deccef-caee-4a00-baa6-2f6644e8817f None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:49:38.612692 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97deccef-caee-4a00-baa6-2f6644e8817f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:49:38.647956 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-97deccef-caee-4a00-baa6-2f6644e8817f None None] MFA Rules not processed for user `0cc4d1f3226944498ce98a39cc996f28`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:49:38.649168 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-97deccef-caee-4a00-baa6-2f6644e8817f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:49:38.726901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 748/1502] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:49:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:49:38.740986 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be6eed-69a6-498f-883a-90d88e68e640 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:49:38.741274 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be6eed-69a6-498f-883a-90d88e68e640 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:49:38.741551 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be6eed-69a6-498f-883a-90d88e68e640 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:49:38.742970 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 755/1503] 10.222.0.16 () {54 vars in 963 bytes} [Fri Jun 24 10:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:49:38.747965 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d027fd-dcbd-4137-ba8c-55ef6855f73e None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:49:38.748259 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d027fd-dcbd-4137-ba8c-55ef6855f73e None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:49:38.748539 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d027fd-dcbd-4137-ba8c-55ef6855f73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:49:38.768104 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-18d027fd-dcbd-4137-ba8c-55ef6855f73e None None] MFA Rules not processed for user `b2f6668cb6244bba9e547ff95b2e6f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:49:38.769309 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-18d027fd-dcbd-4137-ba8c-55ef6855f73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:49:38.815797 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:49:38.828061 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 749/1504] 10.222.0.16 () {58 vars in 1060 bytes} [Fri Jun 24 10:49:38 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:49:38.836021 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be6eed-69a6-498f-883a-90d88e68e640 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:49:38.848445 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be6eed-69a6-498f-883a-90d88e68e640 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:49:38.852507 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe286f-9860-4327-9349-6bc3d26e9b18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:49:38.853137 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe286f-9860-4327-9349-6bc3d26e9b18 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:49:38.853420 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe286f-9860-4327-9349-6bc3d26e9b18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:49:38.853695 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe286f-9860-4327-9349-6bc3d26e9b18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:49:38.862273 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe286f-9860-4327-9349-6bc3d26e9b18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:49:38.863760 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe286f-9860-4327-9349-6bc3d26e9b18 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:49:38.873424 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 756/1505] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:49:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:49:38.921703 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ef13d-61c6-4828-ae19-29897007ba99 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:49:38.921998 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ef13d-61c6-4828-ae19-29897007ba99 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:49:38.922289 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ef13d-61c6-4828-ae19-29897007ba99 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:49:38.923654 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 750/1506] 10.222.0.16 () {52 vars in 829 bytes} [Fri Jun 24 10:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:49:38.927703 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe286f-9860-4327-9349-6bc3d26e9b18 service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:49:38.996003 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe286f-9860-4327-9349-6bc3d26e9b18 service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:49:39.001495 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de8fac-f159-40d8-9095-07dd4150a2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:49:39.002383 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de8fac-f159-40d8-9095-07dd4150a2f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:49:39.002659 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de8fac-f159-40d8-9095-07dd4150a2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:49:39.002932 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de8fac-f159-40d8-9095-07dd4150a2f8 admin admin] PATH_INFO: `/v3/users/0cc4d1f3226944498ce98a39cc996f28` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:49:39.004294 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de8fac-f159-40d8-9095-07dd4150a2f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cc4d1f3226944498ce98a39cc996f28)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:49:39.005837 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: WARNING py.warnings [None req-18de8fac-f159-40d8-9095-07dd4150a2f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:49:39.005837 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: warnings.warn(msg) Jun 24 10:49:39.005837 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: Jun 24 10:49:39.007054 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de8fac-f159-40d8-9095-07dd4150a2f8 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:49:39.080598 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-18de8fac-f159-40d8-9095-07dd4150a2f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cc4d1f3226944498ce98a39cc996f28'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:49:39.093292 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-18de8fac-f159-40d8-9095-07dd4150a2f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cc4d1f3226944498ce98a39cc996f28'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:49:39.106237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-18de8fac-f159-40d8-9095-07dd4150a2f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cc4d1f3226944498ce98a39cc996f28'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:49:39.106995 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-18de8fac-f159-40d8-9095-07dd4150a2f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cc4d1f3226944498ce98a39cc996f28'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:49:39.124099 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:49:39.126862 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-18de8fac-f159-40d8-9095-07dd4150a2f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cc4d1f3226944498ce98a39cc996f28'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:49:39.135118 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 757/1507] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:49:38 2022] DELETE /identity/v3/users/0cc4d1f3226944498ce98a39cc996f28 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:49:39.139677 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232de7e-1f8a-4d75-9564-b9ae6c7f4a73 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:49:39.139968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232de7e-1f8a-4d75-9564-b9ae6c7f4a73 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:49:39.140248 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232de7e-1f8a-4d75-9564-b9ae6c7f4a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:49:39.158090 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-7232de7e-1f8a-4d75-9564-b9ae6c7f4a73 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:49:39.159322 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-7232de7e-1f8a-4d75-9564-b9ae6c7f4a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:49:39.227791 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 751/1508] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:49:39.238372 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de8fac-f159-40d8-9095-07dd4150a2f8 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:49:39.240361 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-18de8fac-f159-40d8-9095-07dd4150a2f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:49:39.309876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de8fac-f159-40d8-9095-07dd4150a2f8 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:49:39.313872 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115e61e-274e-4b33-880d-05529793598c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:49:39.314523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115e61e-274e-4b33-880d-05529793598c service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:49:39.314805 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115e61e-274e-4b33-880d-05529793598c service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:49:39.315079 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115e61e-274e-4b33-880d-05529793598c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:49:39.324803 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115e61e-274e-4b33-880d-05529793598c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:49:39.326227 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115e61e-274e-4b33-880d-05529793598c service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:49:39.335821 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 758/1509] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:49:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:49:39.686390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232de7e-1f8a-4d75-9564-b9ae6c7f4a73 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:49:39.687927 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-7232de7e-1f8a-4d75-9564-b9ae6c7f4a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:49:39.700064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232de7e-1f8a-4d75-9564-b9ae6c7f4a73 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:49:39.704998 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d144b9-4cdc-4fd2-ae79-e2fdb74f0ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:49:39.705909 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d144b9-4cdc-4fd2-ae79-e2fdb74f0ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:49:39.706165 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d144b9-4cdc-4fd2-ae79-e2fdb74f0ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:49:39.706700 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d144b9-4cdc-4fd2-ae79-e2fdb74f0ed5 admin admin] PATH_INFO: `/v3/projects/a849e313a9ba4a2abc4eda7f59add82f` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:49:39.707816 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d144b9-4cdc-4fd2-ae79-e2fdb74f0ed5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a849e313a9ba4a2abc4eda7f59add82f)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:49:39.709444 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: WARNING py.warnings [None req-26d144b9-4cdc-4fd2-ae79-e2fdb74f0ed5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:49:39.709444 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: warnings.warn(msg) Jun 24 10:49:39.709444 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: Jun 24 10:49:39.710772 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d144b9-4cdc-4fd2-ae79-e2fdb74f0ed5 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:49:39.772999 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-26d144b9-4cdc-4fd2-ae79-e2fdb74f0ed5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a849e313a9ba4a2abc4eda7f59add82f', 'request_id': 'req-26d144b9-4cdc-4fd2-ae79-e2fdb74f0ed5'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:49:39.783492 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-26d144b9-4cdc-4fd2-ae79-e2fdb74f0ed5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a849e313a9ba4a2abc4eda7f59add82f', 'request_id': 'req-26d144b9-4cdc-4fd2-ae79-e2fdb74f0ed5'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:49:39.789848 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-26d144b9-4cdc-4fd2-ae79-e2fdb74f0ed5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a849e313a9ba4a2abc4eda7f59add82f', 'request_id': 'req-26d144b9-4cdc-4fd2-ae79-e2fdb74f0ed5'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:49:39.808595 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-26d144b9-4cdc-4fd2-ae79-e2fdb74f0ed5 admin admin] The token cache is being invalidate because project a849e313a9ba4a2abc4eda7f59add82f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:49:39.808902 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-26d144b9-4cdc-4fd2-ae79-e2fdb74f0ed5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:49:39.809629 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-26d144b9-4cdc-4fd2-ae79-e2fdb74f0ed5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:49:39.811223 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 752/1510] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:49:39 2022] DELETE /identity/v3/projects/a849e313a9ba4a2abc4eda7f59add82f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:49:49.331533 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:49:49.805189 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:51:15.169646 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d60e4-79d2-4e3a-bf37-254f661666b2 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:51:15.170605 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d60e4-79d2-4e3a-bf37-254f661666b2 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:51:15.170605 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d60e4-79d2-4e3a-bf37-254f661666b2 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:51:15.172813 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 10:51:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:51:15.179135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4875b4-4b60-45af-b6f9-89bff7a65b50 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:51:15.179616 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4875b4-4b60-45af-b6f9-89bff7a65b50 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:51:15.179719 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4875b4-4b60-45af-b6f9-89bff7a65b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:51:15.200761 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-df4875b4-4b60-45af-b6f9-89bff7a65b50 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:51:15.201982 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-df4875b4-4b60-45af-b6f9-89bff7a65b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:51:15.268687 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 10:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:51:15.422734 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d60e4-79d2-4e3a-bf37-254f661666b2 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:51:15.425836 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-df0d60e4-79d2-4e3a-bf37-254f661666b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:51:15.511724 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d60e4-79d2-4e3a-bf37-254f661666b2 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:51:15.521606 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6c86a-9f19-45f0-bea2-0139b44ff845 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:51:15.522601 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6c86a-9f19-45f0-bea2-0139b44ff845 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:51:15.523023 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6c86a-9f19-45f0-bea2-0139b44ff845 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:51:15.523498 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6c86a-9f19-45f0-bea2-0139b44ff845 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:51:15.536861 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6c86a-9f19-45f0-bea2-0139b44ff845 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:51:15.538484 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6c86a-9f19-45f0-bea2-0139b44ff845 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:51:15.548205 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 760/1513] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:51:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:51:16.382198 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d608ee-1d45-4296-ab70-32e9409e6447 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:51:16.382802 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d608ee-1d45-4296-ab70-32e9409e6447 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:51:16.382802 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d608ee-1d45-4296-ab70-32e9409e6447 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:51:16.384792 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 10:51:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:51:16.390051 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e6fc5-02e9-4e2d-9db9-c378190867bb None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:51:16.390525 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e6fc5-02e9-4e2d-9db9-c378190867bb None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:51:16.390630 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e6fc5-02e9-4e2d-9db9-c378190867bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:51:16.414580 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-0f3e6fc5-02e9-4e2d-9db9-c378190867bb None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:51:16.415836 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-0f3e6fc5-02e9-4e2d-9db9-c378190867bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:51:16.424912 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 10:51:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:51:16.580753 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d608ee-1d45-4296-ab70-32e9409e6447 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:51:16.597001 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d608ee-1d45-4296-ab70-32e9409e6447 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:51:16.603682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e309a-cfe6-42e4-a68c-85731f710f44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:51:16.604287 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e309a-cfe6-42e4-a68c-85731f710f44 service nova] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:51:16.604568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e309a-cfe6-42e4-a68c-85731f710f44 service nova] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:51:16.604842 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e309a-cfe6-42e4-a68c-85731f710f44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:51:16.614578 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e309a-cfe6-42e4-a68c-85731f710f44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:51:16.616225 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e309a-cfe6-42e4-a68c-85731f710f44 service nova] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:51:16.626154 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 755/1516] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:51:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:51:18.333656 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165566c8-5f77-4ed7-ac60-c2205166fe2e None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:51:18.334353 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165566c8-5f77-4ed7-ac60-c2205166fe2e None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:51:18.334353 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165566c8-5f77-4ed7-ac60-c2205166fe2e None None] PATH_INFO: `/v3` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:51:18.335774 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 762/1517] 10.222.0.33 () {54 vars in 925 bytes} [Fri Jun 24 10:51:18 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:51:18.343341 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94767eb1-05b2-4116-be33-7326d5cf6663 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:51:18.343761 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94767eb1-05b2-4116-be33-7326d5cf6663 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:51:18.343873 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94767eb1-05b2-4116-be33-7326d5cf6663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:51:18.366590 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-94767eb1-05b2-4116-be33-7326d5cf6663 None None] MFA Rules not processed for user `b365d9dd635e4518a41181649c323062`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:51:18.367849 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-94767eb1-05b2-4116-be33-7326d5cf6663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:51:18.448694 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 756/1518] 10.222.0.33 () {58 vars in 1015 bytes} [Fri Jun 24 10:51:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:51:22.365153 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb08b4b-b5d1-41d8-a78d-0f8ebb9918ce None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:51:22.365725 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb08b4b-b5d1-41d8-a78d-0f8ebb9918ce None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:51:22.365725 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb08b4b-b5d1-41d8-a78d-0f8ebb9918ce None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:51:22.366983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 763/1519] 10.222.0.16 () {54 vars in 960 bytes} [Fri Jun 24 10:51:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:51:22.372358 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ded8f-1fa0-409b-869e-f5f8288d778e None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:51:22.372799 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ded8f-1fa0-409b-869e-f5f8288d778e None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:51:22.372911 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ded8f-1fa0-409b-869e-f5f8288d778e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:51:22.393246 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-ed8ded8f-1fa0-409b-869e-f5f8288d778e None None] MFA Rules not processed for user `b365d9dd635e4518a41181649c323062`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:51:22.394431 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-ed8ded8f-1fa0-409b-869e-f5f8288d778e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:51:22.405854 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 757/1520] 10.222.0.16 () {58 vars in 1057 bytes} [Fri Jun 24 10:51:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:51:22.414056 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb08b4b-b5d1-41d8-a78d-0f8ebb9918ce None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:51:22.429035 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb08b4b-b5d1-41d8-a78d-0f8ebb9918ce None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:51:22.434999 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fdabf-3567-4f5c-a9f8-d44a27100b0d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b365d9dd635e4518a41181649c323062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:51:22.435659 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fdabf-3567-4f5c-a9f8-d44a27100b0d service placement] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:51:22.435927 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fdabf-3567-4f5c-a9f8-d44a27100b0d service placement] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:51:22.436203 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fdabf-3567-4f5c-a9f8-d44a27100b0d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:51:22.445399 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618fdabf-3567-4f5c-a9f8-d44a27100b0d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:51:22.447006 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618fdabf-3567-4f5c-a9f8-d44a27100b0d service placement] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:51:22.457703 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 764/1521] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:51:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:51:27.894065 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b261fc4-01af-4e52-9db2-1baf565102b9 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:51:27.894675 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b261fc4-01af-4e52-9db2-1baf565102b9 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:51:27.894675 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b261fc4-01af-4e52-9db2-1baf565102b9 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:51:27.896088 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 10:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:51:27.901701 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c003e9b-ab85-4b2d-8411-2e28a063d0e6 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:51:27.902168 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c003e9b-ab85-4b2d-8411-2e28a063d0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:51:27.902277 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c003e9b-ab85-4b2d-8411-2e28a063d0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:51:27.923034 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-6c003e9b-ab85-4b2d-8411-2e28a063d0e6 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:51:27.924188 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6c003e9b-ab85-4b2d-8411-2e28a063d0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:51:27.934637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 10:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:51:28.091326 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b261fc4-01af-4e52-9db2-1baf565102b9 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:51:28.115745 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b261fc4-01af-4e52-9db2-1baf565102b9 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:51:28.121996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0192217-08e2-48b6-80a3-2ea6b9aefdda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:51:28.122648 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0192217-08e2-48b6-80a3-2ea6b9aefdda service nova] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:51:28.122927 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0192217-08e2-48b6-80a3-2ea6b9aefdda service nova] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:51:28.123234 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0192217-08e2-48b6-80a3-2ea6b9aefdda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:51:28.132508 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0192217-08e2-48b6-80a3-2ea6b9aefdda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:51:28.134115 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0192217-08e2-48b6-80a3-2ea6b9aefdda service nova] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:51:28.144062 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 759/1524] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:51:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:51:28.967642 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298f069-16d9-4796-8f5d-c91d5b6b7e6b None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:51:28.968569 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298f069-16d9-4796-8f5d-c91d5b6b7e6b None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:51:28.968569 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298f069-16d9-4796-8f5d-c91d5b6b7e6b None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:51:28.970650 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 10:51:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:51:28.976602 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bfa943-0d12-4ed7-8ca2-8893a0de1640 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:51:28.977072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bfa943-0d12-4ed7-8ca2-8893a0de1640 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:51:28.977176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bfa943-0d12-4ed7-8ca2-8893a0de1640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:51:29.006377 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-75bfa943-0d12-4ed7-8ca2-8893a0de1640 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:51:29.007628 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-75bfa943-0d12-4ed7-8ca2-8893a0de1640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:51:29.017296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 10:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:51:29.166871 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298f069-16d9-4796-8f5d-c91d5b6b7e6b None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:51:29.186426 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298f069-16d9-4796-8f5d-c91d5b6b7e6b None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:51:29.193030 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e2cdd-cea7-4f15-801e-1689e06310b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:51:29.193731 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e2cdd-cea7-4f15-801e-1689e06310b1 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:51:29.194013 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e2cdd-cea7-4f15-801e-1689e06310b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:51:29.194294 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e2cdd-cea7-4f15-801e-1689e06310b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:51:29.202613 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e2cdd-cea7-4f15-801e-1689e06310b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:51:29.204219 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e2cdd-cea7-4f15-801e-1689e06310b1 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:51:29.213737 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 767/1527] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:51:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:51:33.259927 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2b637-fe42-4ba0-878a-e3ff87340541 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:51:33.260560 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2b637-fe42-4ba0-878a-e3ff87340541 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:51:33.260560 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2b637-fe42-4ba0-878a-e3ff87340541 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:51:33.261939 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 10:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:51:33.268393 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698fbec-bb33-49d2-bcb8-ebc202e0a464 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:51:33.269298 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698fbec-bb33-49d2-bcb8-ebc202e0a464 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:51:33.269684 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698fbec-bb33-49d2-bcb8-ebc202e0a464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:51:33.289086 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-a698fbec-bb33-49d2-bcb8-ebc202e0a464 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:51:33.290296 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a698fbec-bb33-49d2-bcb8-ebc202e0a464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:51:33.298937 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 10:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:51:33.336062 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2b637-fe42-4ba0-878a-e3ff87340541 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:51:33.342025 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-82d2b637-fe42-4ba0-878a-e3ff87340541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:51:33.404370 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2b637-fe42-4ba0-878a-e3ff87340541 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:51:33.409010 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f0d44-083e-4de9-a980-e2e588e94803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:51:33.409664 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f0d44-083e-4de9-a980-e2e588e94803 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:51:33.409941 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f0d44-083e-4de9-a980-e2e588e94803 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:51:33.410217 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f0d44-083e-4de9-a980-e2e588e94803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:51:33.420571 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f0d44-083e-4de9-a980-e2e588e94803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:51:33.422008 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f0d44-083e-4de9-a980-e2e588e94803 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:51:33.426992 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:51:33.433178 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 762/1530] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:51:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:51:35.450755 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a818e-a7c8-45a8-a184-fbda646fc438 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:51:35.451534 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a818e-a7c8-45a8-a184-fbda646fc438 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:51:35.451534 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a818e-a7c8-45a8-a184-fbda646fc438 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:51:35.453587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 10:51:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:51:35.461567 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69344d-1848-496e-a260-42e4f2631fbc None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:51:35.462004 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69344d-1848-496e-a260-42e4f2631fbc None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:51:35.462121 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69344d-1848-496e-a260-42e4f2631fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:51:35.482330 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-3f69344d-1848-496e-a260-42e4f2631fbc None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:51:35.483607 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-3f69344d-1848-496e-a260-42e4f2631fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:51:35.493578 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 10:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:51:35.534673 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a818e-a7c8-45a8-a184-fbda646fc438 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:51:35.537844 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5b1a818e-a7c8-45a8-a184-fbda646fc438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:51:35.558408 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a818e-a7c8-45a8-a184-fbda646fc438 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:51:35.562803 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92081b07-f66c-4242-bc28-e922fd7b17ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:51:35.563488 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92081b07-f66c-4242-bc28-e922fd7b17ea service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:51:35.563775 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92081b07-f66c-4242-bc28-e922fd7b17ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:51:35.564052 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92081b07-f66c-4242-bc28-e922fd7b17ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:51:35.573400 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92081b07-f66c-4242-bc28-e922fd7b17ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:51:35.574865 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92081b07-f66c-4242-bc28-e922fd7b17ea service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:51:35.584697 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 770/1533] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:51:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:51:39.124175 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e10f19-223a-4ef2-9e9c-2c834f01c2c4 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:51:39.125212 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e10f19-223a-4ef2-9e9c-2c834f01c2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:51:39.125212 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e10f19-223a-4ef2-9e9c-2c834f01c2c4 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:51:39.127343 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 10:51:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:51:39.136211 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c358e7-6568-4c29-9e65-f28d7b8159fb None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:51:39.136652 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c358e7-6568-4c29-9e65-f28d7b8159fb None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:51:39.136774 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c358e7-6568-4c29-9e65-f28d7b8159fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:51:39.159645 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-39c358e7-6568-4c29-9e65-f28d7b8159fb None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:51:39.160906 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-39c358e7-6568-4c29-9e65-f28d7b8159fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:51:39.170109 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 10:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:51:39.468352 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e10f19-223a-4ef2-9e9c-2c834f01c2c4 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:51:39.470439 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-73e10f19-223a-4ef2-9e9c-2c834f01c2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:51:39.533662 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e10f19-223a-4ef2-9e9c-2c834f01c2c4 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:51:39.538337 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b37db-198c-48d6-a5c7-87823d3b9a12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:51:39.538990 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b37db-198c-48d6-a5c7-87823d3b9a12 service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:51:39.539311 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b37db-198c-48d6-a5c7-87823d3b9a12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:51:39.539591 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b37db-198c-48d6-a5c7-87823d3b9a12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:51:39.549126 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b37db-198c-48d6-a5c7-87823d3b9a12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:51:39.550552 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b37db-198c-48d6-a5c7-87823d3b9a12 service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:51:39.560834 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 765/1536] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:51:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:51:41.598112 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314cda6-8641-4359-bd13-2c651a2148df None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:51:41.598683 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314cda6-8641-4359-bd13-2c651a2148df None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:51:41.598683 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314cda6-8641-4359-bd13-2c651a2148df None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:51:41.600162 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 10:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:51:41.606815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd439cd-7b0b-4fb5-b03f-1bf27e65485f None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:51:41.607609 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd439cd-7b0b-4fb5-b03f-1bf27e65485f None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:51:41.607782 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd439cd-7b0b-4fb5-b03f-1bf27e65485f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:51:41.630651 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-5fd439cd-7b0b-4fb5-b03f-1bf27e65485f None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:51:41.631865 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-5fd439cd-7b0b-4fb5-b03f-1bf27e65485f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:51:41.640830 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 10:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:51:41.943270 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314cda6-8641-4359-bd13-2c651a2148df None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:51:41.945674 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9314cda6-8641-4359-bd13-2c651a2148df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:51:41.955163 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=65 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:51:41.961994 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314cda6-8641-4359-bd13-2c651a2148df None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:51:41.966240 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9aadb-4540-47c1-9517-7e1a9dc3d3ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:51:41.966888 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9aadb-4540-47c1-9517-7e1a9dc3d3ba service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:51:41.967198 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9aadb-4540-47c1-9517-7e1a9dc3d3ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:51:41.967483 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9aadb-4540-47c1-9517-7e1a9dc3d3ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:51:41.977628 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9aadb-4540-47c1-9517-7e1a9dc3d3ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:51:41.979052 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9aadb-4540-47c1-9517-7e1a9dc3d3ba service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:51:41.988664 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 773/1539] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:51:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:51:51.624667 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=32 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:51:51.984824 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=5 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:08.921165 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885d40d-5b96-4c4a-a8d7-aad0a028e07c None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:08.921798 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885d40d-5b96-4c4a-a8d7-aad0a028e07c None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:08.921798 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885d40d-5b96-4c4a-a8d7-aad0a028e07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:08.945835 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-0885d40d-5b96-4c4a-a8d7-aad0a028e07c None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:08.947039 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-0885d40d-5b96-4c4a-a8d7-aad0a028e07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:08.960634 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 767/1540] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:08.971575 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed1df7-e3dd-4d8d-8d66-8d54870437ba None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:08.972182 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed1df7-e3dd-4d8d-8d66-8d54870437ba None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:08.972182 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed1df7-e3dd-4d8d-8d66-8d54870437ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:08.977148 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4333cf-27d2-42f5-ba94-1f298a87ec0b None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:08.977441 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4333cf-27d2-42f5-ba94-1f298a87ec0b None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:08.977722 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4333cf-27d2-42f5-ba94-1f298a87ec0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:09.001031 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-8bed1df7-e3dd-4d8d-8d66-8d54870437ba None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:09.003163 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-8bed1df7-e3dd-4d8d-8d66-8d54870437ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:09.006716 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-fd4333cf-27d2-42f5-ba94-1f298a87ec0b None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:09.007961 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-fd4333cf-27d2-42f5-ba94-1f298a87ec0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:09.024581 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 774/1541] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:09.026165 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 768/1542] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:53:09.030499 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed1df7-e3dd-4d8d-8d66-8d54870437ba None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:09.037526 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c55cc-2e9b-49a7-9fc0-854cf430fb46 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:09.037860 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c55cc-2e9b-49a7-9fc0-854cf430fb46 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:09.038099 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c55cc-2e9b-49a7-9fc0-854cf430fb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:09.047088 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed1df7-e3dd-4d8d-8d66-8d54870437ba None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:09.058792 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d8bbd-c478-485b-901d-a20c3469d207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:09.059867 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d8bbd-c478-485b-901d-a20c3469d207 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:09.060383 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d8bbd-c478-485b-901d-a20c3469d207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:09.060867 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d8bbd-c478-485b-901d-a20c3469d207 admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:09.061823 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d8bbd-c478-485b-901d-a20c3469d207 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:53:09.062344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d8bbd-c478-485b-901d-a20c3469d207 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:09.063680 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: WARNING py.warnings [None req-598d8bbd-c478-485b-901d-a20c3469d207 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:53:09.063680 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: warnings.warn(msg) Jun 24 10:53:09.063680 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: Jun 24 10:53:09.065040 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d8bbd-c478-485b-901d-a20c3469d207 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:09.080530 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-b85c55cc-2e9b-49a7-9fc0-854cf430fb46 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:09.081774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-b85c55cc-2e9b-49a7-9fc0-854cf430fb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:09.086717 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 775/1543] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:53:09.095939 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d8bbd-c478-485b-901d-a20c3469d207 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:09.096460 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 769/1544] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:53:09.101125 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c55cc-2e9b-49a7-9fc0-854cf430fb46 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:09.110238 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d8bbd-c478-485b-901d-a20c3469d207 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:09.122484 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c55cc-2e9b-49a7-9fc0-854cf430fb46 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:09.128609 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec13e13-bc0f-4e42-8975-67bcda218841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:09.129737 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec13e13-bc0f-4e42-8975-67bcda218841 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:09.130277 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec13e13-bc0f-4e42-8975-67bcda218841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:09.130814 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec13e13-bc0f-4e42-8975-67bcda218841 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:09.131849 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec13e13-bc0f-4e42-8975-67bcda218841 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:09.133634 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3620b-5168-49e7-b4b9-1c2dae547caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:09.134343 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3620b-5168-49e7-b4b9-1c2dae547caa admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:09.134922 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3620b-5168-49e7-b4b9-1c2dae547caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:09.135173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec13e13-bc0f-4e42-8975-67bcda218841 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:09.135305 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3620b-5168-49e7-b4b9-1c2dae547caa admin admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:09.135998 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3620b-5168-49e7-b4b9-1c2dae547caa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:53:09.136306 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3620b-5168-49e7-b4b9-1c2dae547caa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:09.138137 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3620b-5168-49e7-b4b9-1c2dae547caa admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:09.167022 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 770/1545] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:53:09.183777 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3620b-5168-49e7-b4b9-1c2dae547caa admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:09.191110 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 776/1546] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:53:09 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:53:09.195684 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec13e13-bc0f-4e42-8975-67bcda218841 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:09.203677 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3620b-5168-49e7-b4b9-1c2dae547caa admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:09.282138 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec13e13-bc0f-4e42-8975-67bcda218841 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:09.299178 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc4d5f-ac18-4c47-88ee-b90daf901584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:09.299178 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc4d5f-ac18-4c47-88ee-b90daf901584 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:09.299178 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc4d5f-ac18-4c47-88ee-b90daf901584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:09.299178 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc4d5f-ac18-4c47-88ee-b90daf901584 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:09.299657 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc4d5f-ac18-4c47-88ee-b90daf901584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:09.300482 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: WARNING py.warnings [None req-14dc4d5f-ac18-4c47-88ee-b90daf901584 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:53:09.300482 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: warnings.warn(msg) Jun 24 10:53:09.300482 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: Jun 24 10:53:09.301962 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc4d5f-ac18-4c47-88ee-b90daf901584 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:09.326212 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3784803-17ad-4d4e-bdc4-dc7bb0befd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:09.327416 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3784803-17ad-4d4e-bdc4-dc7bb0befd17 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:09.327990 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3784803-17ad-4d4e-bdc4-dc7bb0befd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:09.328512 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3784803-17ad-4d4e-bdc4-dc7bb0befd17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:09.333553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3784803-17ad-4d4e-bdc4-dc7bb0befd17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:09.335008 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: WARNING py.warnings [None req-e3784803-17ad-4d4e-bdc4-dc7bb0befd17 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:53:09.335008 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: warnings.warn(msg) Jun 24 10:53:09.335008 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: Jun 24 10:53:09.336687 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3784803-17ad-4d4e-bdc4-dc7bb0befd17 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:09.348572 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 777/1547] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:53:09 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:53:09.354340 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc4d5f-ac18-4c47-88ee-b90daf901584 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:09.375386 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc4d5f-ac18-4c47-88ee-b90daf901584 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:09.386889 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee2c6f-5997-4ec3-9b4e-585cc414b20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:09.388200 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee2c6f-5997-4ec3-9b4e-585cc414b20b admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:09.388352 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee2c6f-5997-4ec3-9b4e-585cc414b20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:09.388552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee2c6f-5997-4ec3-9b4e-585cc414b20b admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:09.389304 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee2c6f-5997-4ec3-9b4e-585cc414b20b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:09.395181 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee2c6f-5997-4ec3-9b4e-585cc414b20b admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:09.406046 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 771/1548] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:53:09 2022] POST /identity/v3/projects => generated 377 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:53:09.412881 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405a052-955e-46d7-811f-94a45b1d15e6 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:09.413523 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405a052-955e-46d7-811f-94a45b1d15e6 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:09.417437 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405a052-955e-46d7-811f-94a45b1d15e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:09.419627 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 778/1549] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:53:09.421627 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a58dd-8214-43f1-a796-e0bf20559b34 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:09.422484 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a58dd-8214-43f1-a796-e0bf20559b34 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:09.423876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a58dd-8214-43f1-a796-e0bf20559b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:09.450456 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-2405a052-955e-46d7-811f-94a45b1d15e6 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:09.451740 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-2405a052-955e-46d7-811f-94a45b1d15e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:09.456723 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-1b8a58dd-8214-43f1-a796-e0bf20559b34 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:09.457936 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1b8a58dd-8214-43f1-a796-e0bf20559b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:09.523196 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 772/1550] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:09.523196 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405a052-955e-46d7-811f-94a45b1d15e6 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:09.525101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 779/1551] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:09.526652 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d125cc-56b3-48f2-8ab1-ab3135beb811 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:09.527044 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d125cc-56b3-48f2-8ab1-ab3135beb811 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:09.527450 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d125cc-56b3-48f2-8ab1-ab3135beb811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:09.539126 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405a052-955e-46d7-811f-94a45b1d15e6 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:09.543775 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e8189-bfd5-4a75-a32c-bd458674bce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:09.544605 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e8189-bfd5-4a75-a32c-bd458674bce8 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:09.544892 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e8189-bfd5-4a75-a32c-bd458674bce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:09.545169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e8189-bfd5-4a75-a32c-bd458674bce8 admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:09.545869 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e8189-bfd5-4a75-a32c-bd458674bce8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:09.547123 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-18d125cc-56b3-48f2-8ab1-ab3135beb811 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:09.548026 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e8189-bfd5-4a75-a32c-bd458674bce8 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:09.549026 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-18d125cc-56b3-48f2-8ab1-ab3135beb811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:09.557531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 780/1552] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:09.558340 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d125cc-56b3-48f2-8ab1-ab3135beb811 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:09.568336 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d125cc-56b3-48f2-8ab1-ab3135beb811 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:09.573482 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4a3f6-2823-48f2-b176-fcee95400fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:09.574413 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4a3f6-2823-48f2-b176-fcee95400fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:09.574714 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4a3f6-2823-48f2-b176-fcee95400fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:09.574990 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4a3f6-2823-48f2-b176-fcee95400fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:09.575747 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4a3f6-2823-48f2-b176-fcee95400fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:09.580010 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 773/1553] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:53:09 2022] POST /identity/v3/users => generated 289 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:53:09.580173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4a3f6-2823-48f2-b176-fcee95400fa8 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:09.580291 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d969e-6859-4136-b86f-03b107a25009 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:09.580291 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d969e-6859-4136-b86f-03b107a25009 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:09.580291 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d969e-6859-4136-b86f-03b107a25009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:09.588145 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 781/1554] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:09.589268 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d596f1-1037-44b5-bb57-5eb0f1c730f8 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:09.589556 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d596f1-1037-44b5-bb57-5eb0f1c730f8 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:09.589833 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d596f1-1037-44b5-bb57-5eb0f1c730f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:09.598386 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-912d969e-6859-4136-b86f-03b107a25009 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:09.599654 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-912d969e-6859-4136-b86f-03b107a25009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:09.607763 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 774/1555] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:09.607974 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-99d596f1-1037-44b5-bb57-5eb0f1c730f8 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:09.609155 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-99d596f1-1037-44b5-bb57-5eb0f1c730f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:09.609268 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8dd2b-f01e-4727-a972-5e1c9746099f None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:09.609627 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8dd2b-f01e-4727-a972-5e1c9746099f None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:09.610147 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8dd2b-f01e-4727-a972-5e1c9746099f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:09.618554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 782/1556] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:09.624086 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc1919-2fda-43b3-b447-5bbfda68a275 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:09.626853 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc1919-2fda-43b3-b447-5bbfda68a275 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:09.627443 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc1919-2fda-43b3-b447-5bbfda68a275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:09.631031 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-5ed8dd2b-f01e-4727-a972-5e1c9746099f None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:09.632288 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-5ed8dd2b-f01e-4727-a972-5e1c9746099f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:09.644330 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 775/1557] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:09.645553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24ce73-2c78-465b-9efa-2f2bca6ee530 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:09.645851 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24ce73-2c78-465b-9efa-2f2bca6ee530 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:09.646126 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24ce73-2c78-465b-9efa-2f2bca6ee530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:09.646815 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-b5bc1919-2fda-43b3-b447-5bbfda68a275 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:09.648163 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b5bc1919-2fda-43b3-b447-5bbfda68a275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:09.658892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 783/1558] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:09.660245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72021334-b2e2-4760-8268-399672cef9dd None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:09.660528 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72021334-b2e2-4760-8268-399672cef9dd None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:09.660803 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72021334-b2e2-4760-8268-399672cef9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:09.666152 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-2f24ce73-2c78-465b-9efa-2f2bca6ee530 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:09.667372 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-2f24ce73-2c78-465b-9efa-2f2bca6ee530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:09.675088 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:09.679690 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 776/1559] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:09.679690 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24ce73-2c78-465b-9efa-2f2bca6ee530 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:09.682110 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-72021334-b2e2-4760-8268-399672cef9dd None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:09.683834 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-72021334-b2e2-4760-8268-399672cef9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:09.687797 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24ce73-2c78-465b-9efa-2f2bca6ee530 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:09.691740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 784/1560] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:09.692553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72021334-b2e2-4760-8268-399672cef9dd None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:09.696683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2976c72-66aa-4585-b512-7356f1286682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:09.697361 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2976c72-66aa-4585-b512-7356f1286682 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:09.697643 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2976c72-66aa-4585-b512-7356f1286682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:09.697918 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2976c72-66aa-4585-b512-7356f1286682 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:09.698687 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2976c72-66aa-4585-b512-7356f1286682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:09.700361 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2976c72-66aa-4585-b512-7356f1286682 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:09.701823 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72021334-b2e2-4760-8268-399672cef9dd None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:09.706778 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c3ab5-4dfb-4ed1-9711-397cab84b078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:09.707691 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c3ab5-4dfb-4ed1-9711-397cab84b078 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:09.707968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c3ab5-4dfb-4ed1-9711-397cab84b078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:09.708238 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c3ab5-4dfb-4ed1-9711-397cab84b078 admin admin] PATH_INFO: `/v3/projects/7adcac785b54407a90a963881c27b491/users/c554436dc7284656b1ffd0a086a480fd/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:09.711200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 777/1561] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:09.712520 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6fa81-921c-425b-a700-0b6356d64906 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:09.712816 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6fa81-921c-425b-a700-0b6356d64906 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:09.713096 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6fa81-921c-425b-a700-0b6356d64906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:09.720204 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:09.727445 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c3ab5-4dfb-4ed1-9711-397cab84b078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7adcac785b54407a90a963881c27b491, user_id=c554436dc7284656b1ffd0a086a480fd, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:09.730203 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c3ab5-4dfb-4ed1-9711-397cab84b078 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:09.733367 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-5db6fa81-921c-425b-a700-0b6356d64906 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:09.734667 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-5db6fa81-921c-425b-a700-0b6356d64906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:09.743233 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 785/1562] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:53:09 2022] PUT /identity/v3/projects/7adcac785b54407a90a963881c27b491/users/c554436dc7284656b1ffd0a086a480fd/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:09.744756 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc046503-9564-49ca-bdb3-daaf60d14241 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:09.745123 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc046503-9564-49ca-bdb3-daaf60d14241 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:09.745494 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc046503-9564-49ca-bdb3-daaf60d14241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:09.762692 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-dc046503-9564-49ca-bdb3-daaf60d14241 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:09.763935 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-dc046503-9564-49ca-bdb3-daaf60d14241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:09.805559 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 778/1563] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:09.806827 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6fa81-921c-425b-a700-0b6356d64906 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:09.816597 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6fa81-921c-425b-a700-0b6356d64906 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:09.821229 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aabb488-62c7-40b9-94ce-72d01fd94ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:09.821878 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabb488-62c7-40b9-94ce-72d01fd94ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:09.822154 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabb488-62c7-40b9-94ce-72d01fd94ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:09.822439 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabb488-62c7-40b9-94ce-72d01fd94ee3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:09.823175 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aabb488-62c7-40b9-94ce-72d01fd94ee3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:53:09.823494 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aabb488-62c7-40b9-94ce-72d01fd94ee3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:09.825114 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aabb488-62c7-40b9-94ce-72d01fd94ee3 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:09.827206 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 786/1564] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:09.828513 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bcf86-9a49-497a-97ce-f2d6a5d2b91c None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:09.829183 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bcf86-9a49-497a-97ce-f2d6a5d2b91c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:09.829183 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bcf86-9a49-497a-97ce-f2d6a5d2b91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:09.845146 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 779/1565] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:53:09.845146 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aabb488-62c7-40b9-94ce-72d01fd94ee3 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:09.850896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-096bcf86-9a49-497a-97ce-f2d6a5d2b91c None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:09.852143 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-096bcf86-9a49-497a-97ce-f2d6a5d2b91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:09.853572 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aabb488-62c7-40b9-94ce-72d01fd94ee3 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:09.858561 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a232db-837a-46f3-b653-be6558ebb90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:09.859285 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a232db-837a-46f3-b653-be6558ebb90d admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:09.859571 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a232db-837a-46f3-b653-be6558ebb90d admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:09.859844 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a232db-837a-46f3-b653-be6558ebb90d admin admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:09.863542 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 787/1566] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:09.863676 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a232db-837a-46f3-b653-be6558ebb90d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:53:09.863676 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a232db-837a-46f3-b653-be6558ebb90d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:09.863886 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bcf86-9a49-497a-97ce-f2d6a5d2b91c None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:09.863980 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a232db-837a-46f3-b653-be6558ebb90d admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:09.870106 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bcf86-9a49-497a-97ce-f2d6a5d2b91c None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:09.875050 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc9ac06-143a-4011-b9a1-d8ee23a177c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:09.875987 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 780/1567] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:53:09.876118 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9ac06-143a-4011-b9a1-d8ee23a177c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:09.876226 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9ac06-143a-4011-b9a1-d8ee23a177c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:09.876471 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9ac06-143a-4011-b9a1-d8ee23a177c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:09.876601 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a232db-837a-46f3-b653-be6558ebb90d admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:09.877196 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc9ac06-143a-4011-b9a1-d8ee23a177c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:53:09.877505 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc9ac06-143a-4011-b9a1-d8ee23a177c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:09.879100 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc9ac06-143a-4011-b9a1-d8ee23a177c2 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:09.887427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a232db-837a-46f3-b653-be6558ebb90d admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:09.892376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed7b40-491b-4a96-a75a-2c0361546a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:09.892794 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 788/1568] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:53:09.893094 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed7b40-491b-4a96-a75a-2c0361546a75 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:09.893415 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed7b40-491b-4a96-a75a-2c0361546a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:09.893640 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed7b40-491b-4a96-a75a-2c0361546a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:09.894950 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed7b40-491b-4a96-a75a-2c0361546a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:09.896566 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6571c55-c3dc-4a3f-8718-da8a278a8bc1 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:09.896710 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed7b40-491b-4a96-a75a-2c0361546a75 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:09.896853 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6571c55-c3dc-4a3f-8718-da8a278a8bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:09.897135 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6571c55-c3dc-4a3f-8718-da8a278a8bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:09.907588 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 781/1569] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:09.909491 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed7b40-491b-4a96-a75a-2c0361546a75 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:09.919408 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed7b40-491b-4a96-a75a-2c0361546a75 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:09.924039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-c6571c55-c3dc-4a3f-8718-da8a278a8bc1 None None] MFA Rules not processed for user `c554436dc7284656b1ffd0a086a480fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:09.925009 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b08df-6c58-4ce4-8ea2-33c96283a0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:09.925542 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c6571c55-c3dc-4a3f-8718-da8a278a8bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:09.925648 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b08df-6c58-4ce4-8ea2-33c96283a0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:09.925949 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b08df-6c58-4ce4-8ea2-33c96283a0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:09.926218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b08df-6c58-4ce4-8ea2-33c96283a0b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:09.926943 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b08df-6c58-4ce4-8ea2-33c96283a0b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:53:09.927276 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b08df-6c58-4ce4-8ea2-33c96283a0b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:09.928905 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b08df-6c58-4ce4-8ea2-33c96283a0b2 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:09.942365 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 782/1570] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:53:09.943176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b08df-6c58-4ce4-8ea2-33c96283a0b2 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:09.959713 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b08df-6c58-4ce4-8ea2-33c96283a0b2 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:09.964552 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce214a98-a193-44c1-a0f6-6a98f3785d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:09.965209 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce214a98-a193-44c1-a0f6-6a98f3785d21 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:09.965493 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce214a98-a193-44c1-a0f6-6a98f3785d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:09.965770 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce214a98-a193-44c1-a0f6-6a98f3785d21 admin admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:09.966495 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce214a98-a193-44c1-a0f6-6a98f3785d21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:53:09.966804 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce214a98-a193-44c1-a0f6-6a98f3785d21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:09.968471 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce214a98-a193-44c1-a0f6-6a98f3785d21 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:09.980618 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 783/1571] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:53:09.981387 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce214a98-a193-44c1-a0f6-6a98f3785d21 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:09.991611 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce214a98-a193-44c1-a0f6-6a98f3785d21 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:09.992757 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 789/1572] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:09.993615 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6571c55-c3dc-4a3f-8718-da8a278a8bc1 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:09.999578 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc9926-5301-414c-a2c3-4ba14540fc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:10.000239 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc9926-5301-414c-a2c3-4ba14540fc21 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:10.000521 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc9926-5301-414c-a2c3-4ba14540fc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:10.000843 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc9926-5301-414c-a2c3-4ba14540fc21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:10.001667 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc9926-5301-414c-a2c3-4ba14540fc21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:10.003627 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc9926-5301-414c-a2c3-4ba14540fc21 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:10.005709 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6571c55-c3dc-4a3f-8718-da8a278a8bc1 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:10.010288 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b4ad5-801d-4a85-a2ae-65ab886cec77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:10.010937 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b4ad5-801d-4a85-a2ae-65ab886cec77 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:10.011258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b4ad5-801d-4a85-a2ae-65ab886cec77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:10.011535 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b4ad5-801d-4a85-a2ae-65ab886cec77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:10.012284 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b4ad5-801d-4a85-a2ae-65ab886cec77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:53:10.012591 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b4ad5-801d-4a85-a2ae-65ab886cec77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:10.014224 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b4ad5-801d-4a85-a2ae-65ab886cec77 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:10.027807 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 790/1573] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:53:10.028612 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b4ad5-801d-4a85-a2ae-65ab886cec77 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:10.036534 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 784/1574] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:53:09 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:53:10.036534 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc9926-5301-414c-a2c3-4ba14540fc21 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:10.038785 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b4ad5-801d-4a85-a2ae-65ab886cec77 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:10.068930 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:10.096219 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc9926-5301-414c-a2c3-4ba14540fc21 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:10.097753 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a914cd-5388-4fe0-af4f-e476f70d3cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:10.098421 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a914cd-5388-4fe0-af4f-e476f70d3cbc admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:10.098703 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a914cd-5388-4fe0-af4f-e476f70d3cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:10.098976 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a914cd-5388-4fe0-af4f-e476f70d3cbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:10.099719 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a914cd-5388-4fe0-af4f-e476f70d3cbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:10.101301 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311343d4-01c8-4e72-8753-b25ebac31886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:10.101610 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a914cd-5388-4fe0-af4f-e476f70d3cbc admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:10.102101 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311343d4-01c8-4e72-8753-b25ebac31886 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:10.102452 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311343d4-01c8-4e72-8753-b25ebac31886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:10.102795 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311343d4-01c8-4e72-8753-b25ebac31886 admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:10.103598 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311343d4-01c8-4e72-8753-b25ebac31886 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:10.106220 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311343d4-01c8-4e72-8753-b25ebac31886 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:10.129720 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 791/1575] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:53:10 2022] POST /identity/v3/projects => generated 393 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:53:10.130734 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a914cd-5388-4fe0-af4f-e476f70d3cbc admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:10.141392 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 785/1576] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:53:10 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:53:10.141392 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311343d4-01c8-4e72-8753-b25ebac31886 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:10.145110 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:10.198829 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a914cd-5388-4fe0-af4f-e476f70d3cbc admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:10.203511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887d682-9bf9-4dc0-baea-f6aa8c2834ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:10.204531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887d682-9bf9-4dc0-baea-f6aa8c2834ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:10.204812 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887d682-9bf9-4dc0-baea-f6aa8c2834ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:10.205088 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887d682-9bf9-4dc0-baea-f6aa8c2834ef admin admin] PATH_INFO: `/v3/projects/add514f35d2c48a894cdf3a2b7401e82/users/94d5d8610e67494dbebf53c4ed560504/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:10.207421 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311343d4-01c8-4e72-8753-b25ebac31886 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:10.212355 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7df5a-c724-4990-b594-488f53a71c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:10.213099 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7df5a-c724-4990-b594-488f53a71c85 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:10.213444 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7df5a-c724-4990-b594-488f53a71c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:10.213734 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7df5a-c724-4990-b594-488f53a71c85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:10.214450 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7df5a-c724-4990-b594-488f53a71c85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:10.216385 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7df5a-c724-4990-b594-488f53a71c85 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:10.219712 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887d682-9bf9-4dc0-baea-f6aa8c2834ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=add514f35d2c48a894cdf3a2b7401e82, user_id=94d5d8610e67494dbebf53c4ed560504, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:10.222360 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887d682-9bf9-4dc0-baea-f6aa8c2834ef admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:10.236593 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 792/1577] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:53:10 2022] PUT /identity/v3/projects/add514f35d2c48a894cdf3a2b7401e82/users/94d5d8610e67494dbebf53c4ed560504/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:10.237511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887d682-9bf9-4dc0-baea-f6aa8c2834ef admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:10.247421 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 786/1578] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:53:10 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:53:10.248101 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7df5a-c724-4990-b594-488f53a71c85 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:10.300790 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887d682-9bf9-4dc0-baea-f6aa8c2834ef admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:10.312341 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7df5a-c724-4990-b594-488f53a71c85 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:10.317457 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e2731-3a89-43e8-8449-d0d4671df505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:10.318182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e2731-3a89-43e8-8449-d0d4671df505 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:10.318469 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e2731-3a89-43e8-8449-d0d4671df505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:10.318884 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e2731-3a89-43e8-8449-d0d4671df505 admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:10.319586 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e2731-3a89-43e8-8449-d0d4671df505 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:10.321514 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e2731-3a89-43e8-8449-d0d4671df505 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:10.345319 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:10.347490 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 787/1579] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:53:10 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:53:10.348778 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e2731-3a89-43e8-8449-d0d4671df505 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:10.361349 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01e9df-d6db-4273-adfe-0323c6c391ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:10.362279 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01e9df-d6db-4273-adfe-0323c6c391ed admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:10.362604 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01e9df-d6db-4273-adfe-0323c6c391ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:10.362849 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01e9df-d6db-4273-adfe-0323c6c391ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:10.363589 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01e9df-d6db-4273-adfe-0323c6c391ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:10.365552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01e9df-d6db-4273-adfe-0323c6c391ed admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:10.394723 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 793/1580] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:53:10 2022] POST /identity/v3/projects => generated 381 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:53:10.394723 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01e9df-d6db-4273-adfe-0323c6c391ed admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:10.417156 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e2731-3a89-43e8-8449-d0d4671df505 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:10.435376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:10.455081 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01e9df-d6db-4273-adfe-0323c6c391ed admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:10.459680 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf721a8-8bbf-417d-ae4f-4343f2a67c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:10.460366 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf721a8-8bbf-417d-ae4f-4343f2a67c1b admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:10.460654 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf721a8-8bbf-417d-ae4f-4343f2a67c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:10.460934 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf721a8-8bbf-417d-ae4f-4343f2a67c1b admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:10.461635 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf721a8-8bbf-417d-ae4f-4343f2a67c1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:10.463674 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf721a8-8bbf-417d-ae4f-4343f2a67c1b admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:10.488661 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 794/1581] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:53:10 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:53:10.488661 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf721a8-8bbf-417d-ae4f-4343f2a67c1b admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:10.498151 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf721a8-8bbf-417d-ae4f-4343f2a67c1b admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:10.499752 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f245c2d0-0668-4dfc-b5f6-61d4784c164f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:10.500450 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245c2d0-0668-4dfc-b5f6-61d4784c164f admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:10.500877 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245c2d0-0668-4dfc-b5f6-61d4784c164f admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:10.501292 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245c2d0-0668-4dfc-b5f6-61d4784c164f admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:10.502000 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f245c2d0-0668-4dfc-b5f6-61d4784c164f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:10.503118 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17f243-53f8-47df-b7d0-4f58d0ccc82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:10.503827 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17f243-53f8-47df-b7d0-4f58d0ccc82f admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:10.503999 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f245c2d0-0668-4dfc-b5f6-61d4784c164f admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:10.504107 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17f243-53f8-47df-b7d0-4f58d0ccc82f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:10.504371 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17f243-53f8-47df-b7d0-4f58d0ccc82f admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:10.505088 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17f243-53f8-47df-b7d0-4f58d0ccc82f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:10.506983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17f243-53f8-47df-b7d0-4f58d0ccc82f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:10.529651 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 795/1582] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:53:10 2022] POST /identity/v3/users => generated 297 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:53:10.530556 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17f243-53f8-47df-b7d0-4f58d0ccc82f admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:10.533962 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 788/1583] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:53:10 2022] POST /identity/v3/projects => generated 373 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:53:10.535515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e86fa-962f-47bb-9a5e-d78441287364 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:10.535811 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e86fa-962f-47bb-9a5e-d78441287364 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:10.536098 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e86fa-962f-47bb-9a5e-d78441287364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:10.542356 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17f243-53f8-47df-b7d0-4f58d0ccc82f admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:10.553629 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-407e86fa-962f-47bb-9a5e-d78441287364 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:10.554859 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-407e86fa-962f-47bb-9a5e-d78441287364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:10.602313 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aee605-e010-4661-9817-2d354430d943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:10.603002 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aee605-e010-4661-9817-2d354430d943 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:10.603309 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aee605-e010-4661-9817-2d354430d943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:10.603587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aee605-e010-4661-9817-2d354430d943 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:10.604275 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aee605-e010-4661-9817-2d354430d943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:10.606336 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aee605-e010-4661-9817-2d354430d943 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:10.616037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 789/1584] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:10.618689 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e86fa-962f-47bb-9a5e-d78441287364 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:10.629280 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e86fa-962f-47bb-9a5e-d78441287364 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:10.636981 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320b3b3-7ed6-4744-8a7f-9becfdcabb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:10.637154 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 796/1585] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:53:10 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:53:10.637272 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320b3b3-7ed6-4744-8a7f-9becfdcabb36 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:10.637272 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320b3b3-7ed6-4744-8a7f-9becfdcabb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:10.637461 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aee605-e010-4661-9817-2d354430d943 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:10.637561 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320b3b3-7ed6-4744-8a7f-9becfdcabb36 admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:10.637561 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320b3b3-7ed6-4744-8a7f-9becfdcabb36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:10.638724 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320b3b3-7ed6-4744-8a7f-9becfdcabb36 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:10.645538 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aee605-e010-4661-9817-2d354430d943 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:10.650843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25596e58-a727-4451-b5d3-9ee89dbba351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:10.651548 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25596e58-a727-4451-b5d3-9ee89dbba351 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:10.651839 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25596e58-a727-4451-b5d3-9ee89dbba351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:10.652115 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25596e58-a727-4451-b5d3-9ee89dbba351 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:10.652814 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25596e58-a727-4451-b5d3-9ee89dbba351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:10.654773 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25596e58-a727-4451-b5d3-9ee89dbba351 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:10.661297 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 790/1586] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:53:10 2022] POST /identity/v3/users => generated 289 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:53:10.662112 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320b3b3-7ed6-4744-8a7f-9becfdcabb36 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:10.672267 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320b3b3-7ed6-4744-8a7f-9becfdcabb36 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:10.677379 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a36f4-0a1a-43f5-9894-ce88bf78aaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:10.678048 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a36f4-0a1a-43f5-9894-ce88bf78aaa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:10.678335 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a36f4-0a1a-43f5-9894-ce88bf78aaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:10.678614 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a36f4-0a1a-43f5-9894-ce88bf78aaa1 admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:10.678983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 797/1587] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:53:10 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:53:10.682370 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a36f4-0a1a-43f5-9894-ce88bf78aaa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:10.682468 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25596e58-a727-4451-b5d3-9ee89dbba351 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:10.682572 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a36f4-0a1a-43f5-9894-ce88bf78aaa1 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:10.690607 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25596e58-a727-4451-b5d3-9ee89dbba351 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:10.695559 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a441ac3-b900-4a04-98bf-094e75e259bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:10.696222 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a441ac3-b900-4a04-98bf-094e75e259bf admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:10.696520 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a441ac3-b900-4a04-98bf-094e75e259bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:10.696799 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a441ac3-b900-4a04-98bf-094e75e259bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:10.697526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a441ac3-b900-4a04-98bf-094e75e259bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:10.699113 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a441ac3-b900-4a04-98bf-094e75e259bf admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:10.705457 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 791/1588] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:53:10 2022] POST /identity/v3/users => generated 291 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:53:10.705457 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a36f4-0a1a-43f5-9894-ce88bf78aaa1 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:10.710238 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 798/1589] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:10.711232 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a441ac3-b900-4a04-98bf-094e75e259bf admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:10.712850 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a36f4-0a1a-43f5-9894-ce88bf78aaa1 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:10.717413 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e7420-372b-4ce3-a4a7-22001287bbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:10.718020 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e7420-372b-4ce3-a4a7-22001287bbf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:10.718306 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e7420-372b-4ce3-a4a7-22001287bbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:10.718592 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e7420-372b-4ce3-a4a7-22001287bbf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:10.719363 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e7420-372b-4ce3-a4a7-22001287bbf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:10.721008 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e7420-372b-4ce3-a4a7-22001287bbf2 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:10.722463 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a441ac3-b900-4a04-98bf-094e75e259bf admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:10.726983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e0ba6-cb28-4d89-ba49-646d51fe4f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:10.727661 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e0ba6-cb28-4d89-ba49-646d51fe4f05 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:10.727946 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e0ba6-cb28-4d89-ba49-646d51fe4f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:10.728221 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e0ba6-cb28-4d89-ba49-646d51fe4f05 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:10.728903 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e0ba6-cb28-4d89-ba49-646d51fe4f05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:10.730782 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e0ba6-cb28-4d89-ba49-646d51fe4f05 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:10.731745 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 792/1590] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:10.732523 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e7420-372b-4ce3-a4a7-22001287bbf2 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:10.738249 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:10.755583 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 799/1591] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:53:10 2022] POST /identity/v3/users => generated 287 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:53:10.755583 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e0ba6-cb28-4d89-ba49-646d51fe4f05 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:10.762516 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e0ba6-cb28-4d89-ba49-646d51fe4f05 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:10.767986 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1a43c-3ba9-4208-a37d-02125c262191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:10.768637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1a43c-3ba9-4208-a37d-02125c262191 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:10.768919 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1a43c-3ba9-4208-a37d-02125c262191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:10.769194 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1a43c-3ba9-4208-a37d-02125c262191 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:10.769908 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f1a43c-3ba9-4208-a37d-02125c262191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:10.771531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f1a43c-3ba9-4208-a37d-02125c262191 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:10.781505 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 800/1592] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:10.782288 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1a43c-3ba9-4208-a37d-02125c262191 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:10.791760 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1a43c-3ba9-4208-a37d-02125c262191 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:10.794139 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e7420-372b-4ce3-a4a7-22001287bbf2 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:10.796461 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2fb42-8690-46f8-acf9-49d5c5e05090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:10.797223 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2fb42-8690-46f8-acf9-49d5c5e05090 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:10.797634 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2fb42-8690-46f8-acf9-49d5c5e05090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:10.797788 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e862d-e4c7-407e-a679-161abce3c18c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:10.797919 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2fb42-8690-46f8-acf9-49d5c5e05090 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:10.798450 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e862d-e4c7-407e-a679-161abce3c18c service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:10.798641 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a2fb42-8690-46f8-acf9-49d5c5e05090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:10.798772 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e862d-e4c7-407e-a679-161abce3c18c service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:10.798999 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e862d-e4c7-407e-a679-161abce3c18c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:10.800253 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a2fb42-8690-46f8-acf9-49d5c5e05090 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:10.808699 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e862d-e4c7-407e-a679-161abce3c18c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:10.810126 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e862d-e4c7-407e-a679-161abce3c18c service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:10.811493 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 801/1593] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:10.812302 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2fb42-8690-46f8-acf9-49d5c5e05090 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:10.819911 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 793/1594] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:53:10.820721 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e862d-e4c7-407e-a679-161abce3c18c service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:10.826203 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:10.830253 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e862d-e4c7-407e-a679-161abce3c18c service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:10.830541 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2fb42-8690-46f8-acf9-49d5c5e05090 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:10.835910 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113ee16-72c9-450f-9357-73f72022b975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:10.836596 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113ee16-72c9-450f-9357-73f72022b975 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:10.837133 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113ee16-72c9-450f-9357-73f72022b975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:10.837280 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e97ac-0974-4077-a357-2b1ae44493f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:10.837486 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113ee16-72c9-450f-9357-73f72022b975 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:10.838368 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e97ac-0974-4077-a357-2b1ae44493f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:10.838482 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113ee16-72c9-450f-9357-73f72022b975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:10.838562 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e97ac-0974-4077-a357-2b1ae44493f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:10.838663 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e97ac-0974-4077-a357-2b1ae44493f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:10.839640 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e97ac-0974-4077-a357-2b1ae44493f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:10.839860 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113ee16-72c9-450f-9357-73f72022b975 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:10.841037 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e97ac-0974-4077-a357-2b1ae44493f9 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:10.851195 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 794/1595] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:10.857413 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 802/1596] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:10.857574 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113ee16-72c9-450f-9357-73f72022b975 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:10.857662 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e97ac-0974-4077-a357-2b1ae44493f9 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:10.867352 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e97ac-0974-4077-a357-2b1ae44493f9 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:10.867509 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113ee16-72c9-450f-9357-73f72022b975 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:10.872052 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a641528-851a-48b1-9339-97e3c906dacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:10.872499 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c7136-4d36-4716-b491-39dbdf2b4811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:10.872728 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a641528-851a-48b1-9339-97e3c906dacc admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:10.873016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a641528-851a-48b1-9339-97e3c906dacc admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:10.873188 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c7136-4d36-4716-b491-39dbdf2b4811 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:10.873285 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a641528-851a-48b1-9339-97e3c906dacc admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:10.873458 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c7136-4d36-4716-b491-39dbdf2b4811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:10.873732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c7136-4d36-4716-b491-39dbdf2b4811 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:10.874021 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a641528-851a-48b1-9339-97e3c906dacc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:10.874884 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c7136-4d36-4716-b491-39dbdf2b4811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:10.876215 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a641528-851a-48b1-9339-97e3c906dacc admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:10.876963 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c7136-4d36-4716-b491-39dbdf2b4811 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:10.889109 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 795/1597] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:10.889306 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 803/1598] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:10.890020 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c7136-4d36-4716-b491-39dbdf2b4811 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:10.891548 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a641528-851a-48b1-9339-97e3c906dacc admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:10.900207 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c7136-4d36-4716-b491-39dbdf2b4811 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:10.903962 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a641528-851a-48b1-9339-97e3c906dacc admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:10.905627 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b26a32-5d74-428b-abd7-9cae8fcc7d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:10.906224 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b26a32-5d74-428b-abd7-9cae8fcc7d91 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:10.906650 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b26a32-5d74-428b-abd7-9cae8fcc7d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:10.906890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b26a32-5d74-428b-abd7-9cae8fcc7d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:10.908207 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b26a32-5d74-428b-abd7-9cae8fcc7d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:10.909518 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a585c-1874-4ae1-a767-4b9781d3f2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:10.910203 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a585c-1874-4ae1-a767-4b9781d3f2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:10.910374 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b26a32-5d74-428b-abd7-9cae8fcc7d91 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:10.910510 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a585c-1874-4ae1-a767-4b9781d3f2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:10.910756 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a585c-1874-4ae1-a767-4b9781d3f2b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:10.911520 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a585c-1874-4ae1-a767-4b9781d3f2b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:10.913136 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a585c-1874-4ae1-a767-4b9781d3f2b3 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:10.922153 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 804/1599] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:10.922938 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b26a32-5d74-428b-abd7-9cae8fcc7d91 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:10.933509 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 796/1600] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:10.933509 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a585c-1874-4ae1-a767-4b9781d3f2b3 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:10.934144 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b26a32-5d74-428b-abd7-9cae8fcc7d91 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:10.938802 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd45f2-e046-4a40-8dcf-0ef24991d311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:10.939535 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd45f2-e046-4a40-8dcf-0ef24991d311 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:10.939968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd45f2-e046-4a40-8dcf-0ef24991d311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:10.940256 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd45f2-e046-4a40-8dcf-0ef24991d311 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:10.940999 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd45f2-e046-4a40-8dcf-0ef24991d311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:10.942619 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd45f2-e046-4a40-8dcf-0ef24991d311 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:10.944376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a585c-1874-4ae1-a767-4b9781d3f2b3 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:10.949950 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff877e9-7a7a-46ef-9ab3-5afe947ae458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:10.950760 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff877e9-7a7a-46ef-9ab3-5afe947ae458 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:10.951097 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff877e9-7a7a-46ef-9ab3-5afe947ae458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:10.951356 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff877e9-7a7a-46ef-9ab3-5afe947ae458 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:10.952099 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff877e9-7a7a-46ef-9ab3-5afe947ae458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:10.957323 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 805/1601] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:10.957502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff877e9-7a7a-46ef-9ab3-5afe947ae458 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:10.957615 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd45f2-e046-4a40-8dcf-0ef24991d311 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:10.966243 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd45f2-e046-4a40-8dcf-0ef24991d311 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:10.966411 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 797/1602] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:10.967361 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff877e9-7a7a-46ef-9ab3-5afe947ae458 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:10.971972 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76981e-04f3-4b91-91c3-d9f6c2dde202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:10.972819 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76981e-04f3-4b91-91c3-d9f6c2dde202 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:10.973111 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76981e-04f3-4b91-91c3-d9f6c2dde202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:10.973392 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76981e-04f3-4b91-91c3-d9f6c2dde202 admin admin] PATH_INFO: `/v3/projects/4f7e52b655194c1d961c97bd365653ab/users/76954589b9374ab1baee4027af8aca75/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:10.978151 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff877e9-7a7a-46ef-9ab3-5afe947ae458 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:10.983844 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9e8a1-ec2d-42a5-bd8f-b1283bbcbc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:10.984649 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9e8a1-ec2d-42a5-bd8f-b1283bbcbc57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:10.985022 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9e8a1-ec2d-42a5-bd8f-b1283bbcbc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:10.985487 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9e8a1-ec2d-42a5-bd8f-b1283bbcbc57 admin admin] PATH_INFO: `/v3/projects/5fe136a765474178ab4ad9634b9faf5e/users/5d124d6e1c53494bb5d80d60f840a65a/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:10.990788 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76981e-04f3-4b91-91c3-d9f6c2dde202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7e52b655194c1d961c97bd365653ab, user_id=76954589b9374ab1baee4027af8aca75, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:10.993935 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76981e-04f3-4b91-91c3-d9f6c2dde202 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:11.002982 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9e8a1-ec2d-42a5-bd8f-b1283bbcbc57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fe136a765474178ab4ad9634b9faf5e, user_id=5d124d6e1c53494bb5d80d60f840a65a, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:11.003608 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: WARNING py.warnings [None req-62c9e8a1-ec2d-42a5-bd8f-b1283bbcbc57 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:53:11.003608 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: warnings.warn(msg) Jun 24 10:53:11.003608 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: Jun 24 10:53:11.005529 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9e8a1-ec2d-42a5-bd8f-b1283bbcbc57 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:11.011661 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 806/1603] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:53:10 2022] PUT /identity/v3/projects/4f7e52b655194c1d961c97bd365653ab/users/76954589b9374ab1baee4027af8aca75/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:11.012692 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76981e-04f3-4b91-91c3-d9f6c2dde202 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:11.022999 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 798/1604] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:53:10 2022] PUT /identity/v3/projects/5fe136a765474178ab4ad9634b9faf5e/users/5d124d6e1c53494bb5d80d60f840a65a/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:11.024230 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9e8a1-ec2d-42a5-bd8f-b1283bbcbc57 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:11.093632 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76981e-04f3-4b91-91c3-d9f6c2dde202 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:11.098578 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184119a-20e3-4d22-b8d7-47b2274b3243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:11.099683 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184119a-20e3-4d22-b8d7-47b2274b3243 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:11.100132 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184119a-20e3-4d22-b8d7-47b2274b3243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:11.100487 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184119a-20e3-4d22-b8d7-47b2274b3243 admin admin] PATH_INFO: `/v3/projects/f397f419e5064e888cba221d1c356266/users/09d927f9878e487b9794113927ab336a/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:11.101881 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9e8a1-ec2d-42a5-bd8f-b1283bbcbc57 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:11.107662 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18724c1b-0d56-459e-9f89-fb65464fe4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:11.108687 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18724c1b-0d56-459e-9f89-fb65464fe4cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:11.109206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18724c1b-0d56-459e-9f89-fb65464fe4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:11.109585 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18724c1b-0d56-459e-9f89-fb65464fe4cc admin admin] PATH_INFO: `/v3/projects/74e4808575f64e5b9c5d8e68784dc504/users/25281e85b31b47d9889838ba5a65c328/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:11.118083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184119a-20e3-4d22-b8d7-47b2274b3243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f397f419e5064e888cba221d1c356266, user_id=09d927f9878e487b9794113927ab336a, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:11.120889 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184119a-20e3-4d22-b8d7-47b2274b3243 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:11.128525 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18724c1b-0d56-459e-9f89-fb65464fe4cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=74e4808575f64e5b9c5d8e68784dc504, user_id=25281e85b31b47d9889838ba5a65c328, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:11.131891 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18724c1b-0d56-459e-9f89-fb65464fe4cc admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:11.139985 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 807/1605] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:53:11 2022] PUT /identity/v3/projects/f397f419e5064e888cba221d1c356266/users/09d927f9878e487b9794113927ab336a/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:11.140954 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184119a-20e3-4d22-b8d7-47b2274b3243 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:11.153554 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 799/1606] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:53:11 2022] PUT /identity/v3/projects/74e4808575f64e5b9c5d8e68784dc504/users/25281e85b31b47d9889838ba5a65c328/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:11.156157 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18724c1b-0d56-459e-9f89-fb65464fe4cc admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:11.213211 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:11.233310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18724c1b-0d56-459e-9f89-fb65464fe4cc admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:11.238352 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07ea5f-1ce6-44b9-94ea-8961c6cd5c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:11.239437 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07ea5f-1ce6-44b9-94ea-8961c6cd5c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:11.239839 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184119a-20e3-4d22-b8d7-47b2274b3243 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:11.239954 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07ea5f-1ce6-44b9-94ea-8961c6cd5c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:11.240202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07ea5f-1ce6-44b9-94ea-8961c6cd5c87 admin admin] PATH_INFO: `/v3/projects/dea77fbf8e2b486f91de4b88695098a2/users/924040e7b5cf435fa78ed20e1c3e0b02/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:11.250619 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562db3f-2ca3-4aff-9f82-6965e2f4d957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:11.251917 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562db3f-2ca3-4aff-9f82-6965e2f4d957 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:11.252380 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562db3f-2ca3-4aff-9f82-6965e2f4d957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:11.252833 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562db3f-2ca3-4aff-9f82-6965e2f4d957 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:11.255259 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562db3f-2ca3-4aff-9f82-6965e2f4d957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:11.257543 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562db3f-2ca3-4aff-9f82-6965e2f4d957 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:11.264334 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07ea5f-1ce6-44b9-94ea-8961c6cd5c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dea77fbf8e2b486f91de4b88695098a2, user_id=924040e7b5cf435fa78ed20e1c3e0b02, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:11.267659 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07ea5f-1ce6-44b9-94ea-8961c6cd5c87 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:11.272866 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 808/1607] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:11.274226 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562db3f-2ca3-4aff-9f82-6965e2f4d957 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:11.290636 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 800/1608] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:53:11 2022] PUT /identity/v3/projects/dea77fbf8e2b486f91de4b88695098a2/users/924040e7b5cf435fa78ed20e1c3e0b02/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:11.290636 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07ea5f-1ce6-44b9-94ea-8961c6cd5c87 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:11.290900 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562db3f-2ca3-4aff-9f82-6965e2f4d957 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:11.296179 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:11.358906 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56434878-b0e5-461b-9157-7bd41162b8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:11.359957 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56434878-b0e5-461b-9157-7bd41162b8a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:11.360404 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56434878-b0e5-461b-9157-7bd41162b8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:11.360624 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56434878-b0e5-461b-9157-7bd41162b8a6 admin admin] PATH_INFO: `/v3/projects/5168276d9d244a759bb6386b3b577d33/users/85215e27efcd450f8c5932ae8bc9af70/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:11.366334 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07ea5f-1ce6-44b9-94ea-8961c6cd5c87 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:11.371025 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b39ec-a39c-4b6e-a0cf-e7f87f6cb0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:11.371769 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b39ec-a39c-4b6e-a0cf-e7f87f6cb0cc admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:11.372060 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b39ec-a39c-4b6e-a0cf-e7f87f6cb0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:11.372481 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b39ec-a39c-4b6e-a0cf-e7f87f6cb0cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:11.373082 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b39ec-a39c-4b6e-a0cf-e7f87f6cb0cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:11.374901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b39ec-a39c-4b6e-a0cf-e7f87f6cb0cc admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:11.378741 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56434878-b0e5-461b-9157-7bd41162b8a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5168276d9d244a759bb6386b3b577d33, user_id=85215e27efcd450f8c5932ae8bc9af70, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:11.382242 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56434878-b0e5-461b-9157-7bd41162b8a6 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:11.388970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 801/1609] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:11.388970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b7090-5bc9-4b0e-9b73-af0dc558b218 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:11.388970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b7090-5bc9-4b0e-9b73-af0dc558b218 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:11.388970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b7090-5bc9-4b0e-9b73-af0dc558b218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:11.412277 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 809/1610] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:53:11 2022] PUT /identity/v3/projects/5168276d9d244a759bb6386b3b577d33/users/85215e27efcd450f8c5932ae8bc9af70/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:11.412277 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b483b-2f5e-47ca-9ee4-02ff0f182171 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:11.412277 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b483b-2f5e-47ca-9ee4-02ff0f182171 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:11.412277 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b483b-2f5e-47ca-9ee4-02ff0f182171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:11.421889 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-533b483b-2f5e-47ca-9ee4-02ff0f182171 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:11.423369 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-533b483b-2f5e-47ca-9ee4-02ff0f182171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:11.430346 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-817b7090-5bc9-4b0e-9b73-af0dc558b218 None None] MFA Rules not processed for user `5d124d6e1c53494bb5d80d60f840a65a`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:11.432072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-817b7090-5bc9-4b0e-9b73-af0dc558b218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:11.488451 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 810/1611] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:11.489786 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f43679-b100-419c-b86c-87de16218dbd None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:11.490075 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f43679-b100-419c-b86c-87de16218dbd None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:11.490334 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f43679-b100-419c-b86c-87de16218dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:11.512070 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-e9f43679-b100-419c-b86c-87de16218dbd None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:11.513421 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e9f43679-b100-419c-b86c-87de16218dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:11.523664 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 811/1612] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:11.525014 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f43679-b100-419c-b86c-87de16218dbd None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:11.531753 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 802/1613] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:11.533883 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47222ed0-778a-4690-8305-e7bdcdabaa1c None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:11.534177 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47222ed0-778a-4690-8305-e7bdcdabaa1c None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:11.534459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47222ed0-778a-4690-8305-e7bdcdabaa1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:11.557400 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f43679-b100-419c-b86c-87de16218dbd None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:11.558846 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-47222ed0-778a-4690-8305-e7bdcdabaa1c None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:11.560093 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-47222ed0-778a-4690-8305-e7bdcdabaa1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:11.568161 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c32889-7947-4e08-957f-29379774aff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:11.569253 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c32889-7947-4e08-957f-29379774aff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:11.569607 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c32889-7947-4e08-957f-29379774aff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:11.569957 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c32889-7947-4e08-957f-29379774aff3 admin admin] PATH_INFO: `/v3/projects/09f57d24b154434ba7a8a7a86fb1e79e/users/3c48ff0e2dc24af5a33a09abbe46bdbf/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:11.575059 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 803/1614] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:11.579487 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47222ed0-778a-4690-8305-e7bdcdabaa1c None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:11.589712 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47222ed0-778a-4690-8305-e7bdcdabaa1c None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:11.596275 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c32889-7947-4e08-957f-29379774aff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09f57d24b154434ba7a8a7a86fb1e79e, user_id=3c48ff0e2dc24af5a33a09abbe46bdbf, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:11.596460 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3396a6-c5cf-4cf4-b9e4-52600bf43e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:11.597489 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3396a6-c5cf-4cf4-b9e4-52600bf43e26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:11.597793 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3396a6-c5cf-4cf4-b9e4-52600bf43e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:11.598083 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3396a6-c5cf-4cf4-b9e4-52600bf43e26 admin admin] PATH_INFO: `/v3/projects/4f7e52b655194c1d961c97bd365653ab/users/76954589b9374ab1baee4027af8aca75/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:11.600774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3396a6-c5cf-4cf4-b9e4-52600bf43e26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7e52b655194c1d961c97bd365653ab, user_id=76954589b9374ab1baee4027af8aca75, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:11.602152 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c32889-7947-4e08-957f-29379774aff3 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:11.603204 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3396a6-c5cf-4cf4-b9e4-52600bf43e26 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:11.619176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 804/1615] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:53:11 2022] PUT /identity/v3/projects/4f7e52b655194c1d961c97bd365653ab/users/76954589b9374ab1baee4027af8aca75/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:11.620787 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7054f9b-cb8b-401b-b5d4-f31564d242f8 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:11.621176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7054f9b-cb8b-401b-b5d4-f31564d242f8 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:11.621569 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7054f9b-cb8b-401b-b5d4-f31564d242f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:11.640075 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 812/1616] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:53:11 2022] PUT /identity/v3/projects/09f57d24b154434ba7a8a7a86fb1e79e/users/3c48ff0e2dc24af5a33a09abbe46bdbf/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:11.650796 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c32889-7947-4e08-957f-29379774aff3 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:11.651824 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-e7054f9b-cb8b-401b-b5d4-f31564d242f8 None None] MFA Rules not processed for user `85215e27efcd450f8c5932ae8bc9af70`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:11.653444 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-e7054f9b-cb8b-401b-b5d4-f31564d242f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:11.700028 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:11.727923 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c32889-7947-4e08-957f-29379774aff3 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:11.732717 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22286a-db63-430d-81b6-0f11579a4648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:11.734583 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22286a-db63-430d-81b6-0f11579a4648 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:11.734729 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:11.734844 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22286a-db63-430d-81b6-0f11579a4648 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:11.735354 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22286a-db63-430d-81b6-0f11579a4648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:11.743211 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 805/1617] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:11.744403 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7054f9b-cb8b-401b-b5d4-f31564d242f8 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:11.758047 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7054f9b-cb8b-401b-b5d4-f31564d242f8 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:11.766074 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4b3b4-5ada-4002-8e73-4c9abde65af7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:11.768052 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4b3b4-5ada-4002-8e73-4c9abde65af7 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:11.768510 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4b3b4-5ada-4002-8e73-4c9abde65af7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:11.768943 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4b3b4-5ada-4002-8e73-4c9abde65af7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:11.826060 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22286a-db63-430d-81b6-0f11579a4648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:11.828261 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22286a-db63-430d-81b6-0f11579a4648 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:11.847806 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 813/1618] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:53:11.848712 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22286a-db63-430d-81b6-0f11579a4648 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:11.860484 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22286a-db63-430d-81b6-0f11579a4648 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:11.861767 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4b3b4-5ada-4002-8e73-4c9abde65af7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:11.863530 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4b3b4-5ada-4002-8e73-4c9abde65af7 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:11.867110 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb22df-abe0-4ef5-a9c8-45d4d71c18cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:11.867835 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb22df-abe0-4ef5-a9c8-45d4d71c18cc admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:11.868114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb22df-abe0-4ef5-a9c8-45d4d71c18cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:11.868395 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb22df-abe0-4ef5-a9c8-45d4d71c18cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:11.869104 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb22df-abe0-4ef5-a9c8-45d4d71c18cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:11.871280 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb22df-abe0-4ef5-a9c8-45d4d71c18cc admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:11.875476 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 806/1619] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:53:11.877479 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4b3b4-5ada-4002-8e73-4c9abde65af7 service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:11.887468 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4b3b4-5ada-4002-8e73-4c9abde65af7 service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:11.893435 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d041982-9092-4f7d-8571-9a94ca1495d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:11.893749 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d041982-9092-4f7d-8571-9a94ca1495d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:11.894049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d041982-9092-4f7d-8571-9a94ca1495d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:11.894429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d041982-9092-4f7d-8571-9a94ca1495d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:11.905996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d041982-9092-4f7d-8571-9a94ca1495d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:11.908376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d041982-9092-4f7d-8571-9a94ca1495d2 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:11.913779 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 814/1620] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:53:11 2022] POST /identity/v3/projects => generated 379 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:53:11.919529 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ca46f-b570-4380-b442-b8beb3c2b115 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:11.919529 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ca46f-b570-4380-b442-b8beb3c2b115 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:11.919830 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ca46f-b570-4380-b442-b8beb3c2b115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:11.925656 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 807/1621] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:53:11.927061 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6ec6c-4722-480b-bea7-ae22d5dd256b None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:11.927375 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6ec6c-4722-480b-bea7-ae22d5dd256b None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:11.927660 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6ec6c-4722-480b-bea7-ae22d5dd256b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:11.956072 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-fa8ca46f-b570-4380-b442-b8beb3c2b115 None None] MFA Rules not processed for user `76954589b9374ab1baee4027af8aca75`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:11.957300 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-fa8ca46f-b570-4380-b442-b8beb3c2b115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:11.990492 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-5de6ec6c-4722-480b-bea7-ae22d5dd256b None None] MFA Rules not processed for user `3c48ff0e2dc24af5a33a09abbe46bdbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:11.991758 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-5de6ec6c-4722-480b-bea7-ae22d5dd256b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:12.048545 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 815/1622] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:12.050193 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fe4e9-de1d-4880-a9ca-4546b359a051 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:12.050745 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fe4e9-de1d-4880-a9ca-4546b359a051 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:12.051352 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fe4e9-de1d-4880-a9ca-4546b359a051 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:12.052898 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 816/1623] 10.222.0.16 () {54 vars in 961 bytes} [Fri Jun 24 10:53:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:53:12.053828 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8fe4e9-de1d-4880-a9ca-4546b359a051 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:12.139934 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:12.148414 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 808/1624] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:12.150798 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb70de-8ff9-41d6-9105-7ec8e8511a9a None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:12.151428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb70de-8ff9-41d6-9105-7ec8e8511a9a None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:12.151879 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb70de-8ff9-41d6-9105-7ec8e8511a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:12.184416 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8fe4e9-de1d-4880-a9ca-4546b359a051 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:12.197684 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81837a9f-eca7-455c-9278-aeb23e517d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:12.199327 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81837a9f-eca7-455c-9278-aeb23e517d16 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:12.200598 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81837a9f-eca7-455c-9278-aeb23e517d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:12.200890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81837a9f-eca7-455c-9278-aeb23e517d16 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:12.202138 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-91bb70de-8ff9-41d6-9105-7ec8e8511a9a None None] MFA Rules not processed for user `e8034bad51144002a7386c975e412992`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:12.202740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81837a9f-eca7-455c-9278-aeb23e517d16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:12.204846 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-91bb70de-8ff9-41d6-9105-7ec8e8511a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:12.208292 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81837a9f-eca7-455c-9278-aeb23e517d16 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:12.264101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 817/1625] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:53:12 2022] POST /identity/v3/users => generated 296 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:53:12.264968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81837a9f-eca7-455c-9278-aeb23e517d16 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:12.333927 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:12.361055 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 809/1626] 10.222.0.16 () {58 vars in 1058 bytes} [Fri Jun 24 10:53:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:12.362589 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054364b6-745d-4992-b5a0-8ef092dbf051 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:12.363250 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054364b6-745d-4992-b5a0-8ef092dbf051 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:12.363618 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054364b6-745d-4992-b5a0-8ef092dbf051 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:12.365706 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 810/1627] 10.222.0.16 () {54 vars in 961 bytes} [Fri Jun 24 10:53:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:53:12.366515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054364b6-745d-4992-b5a0-8ef092dbf051 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:12.385777 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054364b6-745d-4992-b5a0-8ef092dbf051 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:12.391677 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81837a9f-eca7-455c-9278-aeb23e517d16 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:12.393160 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea399d69-fb68-40e6-8ab6-5fcc75abc510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:12.394183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea399d69-fb68-40e6-8ab6-5fcc75abc510 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:12.395567 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea399d69-fb68-40e6-8ab6-5fcc75abc510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:12.396732 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea399d69-fb68-40e6-8ab6-5fcc75abc510 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:12.397787 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea399d69-fb68-40e6-8ab6-5fcc75abc510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:12.400420 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea399d69-fb68-40e6-8ab6-5fcc75abc510 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:12.403535 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb317b9-ed6b-4bcc-9e9c-3efdc7dfcdfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:12.407217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb317b9-ed6b-4bcc-9e9c-3efdc7dfcdfa service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:12.410222 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb317b9-ed6b-4bcc-9e9c-3efdc7dfcdfa service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:12.412962 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb317b9-ed6b-4bcc-9e9c-3efdc7dfcdfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:12.434467 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 811/1628] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:12.434467 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea399d69-fb68-40e6-8ab6-5fcc75abc510 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:12.444086 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb317b9-ed6b-4bcc-9e9c-3efdc7dfcdfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:12.445578 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb317b9-ed6b-4bcc-9e9c-3efdc7dfcdfa service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:12.476493 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 818/1629] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:12 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:53:12.481915 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcaf5cf-f53e-47ed-b1ee-86a644614ca7 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:12.482205 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcaf5cf-f53e-47ed-b1ee-86a644614ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:12.482488 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcaf5cf-f53e-47ed-b1ee-86a644614ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:12.484563 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea399d69-fb68-40e6-8ab6-5fcc75abc510 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:12.500193 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a236e31-65b8-4022-bfd1-e4874ac7b3c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:12.501857 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a236e31-65b8-4022-bfd1-e4874ac7b3c0 service nova] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:12.502254 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a236e31-65b8-4022-bfd1-e4874ac7b3c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:12.502611 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a236e31-65b8-4022-bfd1-e4874ac7b3c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:12.524798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-7fcaf5cf-f53e-47ed-b1ee-86a644614ca7 None None] MFA Rules not processed for user `e8034bad51144002a7386c975e412992`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:12.526163 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-7fcaf5cf-f53e-47ed-b1ee-86a644614ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:12.557910 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 819/1630] 10.222.0.16 () {58 vars in 1058 bytes} [Fri Jun 24 10:53:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:12.566646 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcaf5cf-f53e-47ed-b1ee-86a644614ca7 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:12.590704 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcaf5cf-f53e-47ed-b1ee-86a644614ca7 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:12.605451 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b848d-e6bb-4378-bbc8-8aa4c0868c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:12.605451 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b848d-e6bb-4378-bbc8-8aa4c0868c7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:12.605451 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b848d-e6bb-4378-bbc8-8aa4c0868c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:12.605451 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b848d-e6bb-4378-bbc8-8aa4c0868c7b admin admin] PATH_INFO: `/v3/projects/45b8ab1a9f7e474084df1ca9ba8de009/users/074b9b5e7e0848dcb9b743649fe44291/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:12.607010 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a236e31-65b8-4022-bfd1-e4874ac7b3c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:12.608837 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a236e31-65b8-4022-bfd1-e4874ac7b3c0 service nova] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:12.636763 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 812/1631] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:53:12.637956 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a236e31-65b8-4022-bfd1-e4874ac7b3c0 service nova] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:12.651035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a236e31-65b8-4022-bfd1-e4874ac7b3c0 service nova] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:12.662791 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b79d9-5b00-4909-a840-65860de227d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:12.664049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b79d9-5b00-4909-a840-65860de227d2 service nova] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:12.664406 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b79d9-5b00-4909-a840-65860de227d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:12.665013 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b79d9-5b00-4909-a840-65860de227d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:12.668845 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b848d-e6bb-4378-bbc8-8aa4c0868c7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=45b8ab1a9f7e474084df1ca9ba8de009, user_id=074b9b5e7e0848dcb9b743649fe44291, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:12.675794 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b79d9-5b00-4909-a840-65860de227d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:12.676320 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b848d-e6bb-4378-bbc8-8aa4c0868c7b admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:12.677484 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b79d9-5b00-4909-a840-65860de227d2 service nova] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:12.703110 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 813/1632] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:53:12.707059 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b79d9-5b00-4909-a840-65860de227d2 service nova] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:12.710954 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 820/1633] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:53:12 2022] PUT /identity/v3/projects/45b8ab1a9f7e474084df1ca9ba8de009/users/074b9b5e7e0848dcb9b743649fe44291/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:12.718292 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b848d-e6bb-4378-bbc8-8aa4c0868c7b admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:12.730307 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b79d9-5b00-4909-a840-65860de227d2 service nova] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:12.881185 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b848d-e6bb-4378-bbc8-8aa4c0868c7b admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:12.894069 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b24b8-e9ea-41f9-9fae-54338ad20f96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:12.895179 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b24b8-e9ea-41f9-9fae-54338ad20f96 service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:12.967393 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b24b8-e9ea-41f9-9fae-54338ad20f96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:12.967393 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b24b8-e9ea-41f9-9fae-54338ad20f96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:12.968928 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf355c4-f573-4f1d-b1b7-11bf48686a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:12.968928 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf355c4-f573-4f1d-b1b7-11bf48686a02 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:12.968928 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf355c4-f573-4f1d-b1b7-11bf48686a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:12.968928 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf355c4-f573-4f1d-b1b7-11bf48686a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:12.979540 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf355c4-f573-4f1d-b1b7-11bf48686a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:12.979540 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf355c4-f573-4f1d-b1b7-11bf48686a02 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:12.979540 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 821/1634] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:12.979540 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf355c4-f573-4f1d-b1b7-11bf48686a02 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:12.979540 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf355c4-f573-4f1d-b1b7-11bf48686a02 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:12.997072 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f8d4d-a2aa-4685-8a56-afdb0067ce7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:13.007758 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f8d4d-a2aa-4685-8a56-afdb0067ce7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:13.015381 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f8d4d-a2aa-4685-8a56-afdb0067ce7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:13.021968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f8d4d-a2aa-4685-8a56-afdb0067ce7f admin admin] PATH_INFO: `/v3/projects/45b8ab1a9f7e474084df1ca9ba8de009/users/074b9b5e7e0848dcb9b743649fe44291/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:13.033193 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f8d4d-a2aa-4685-8a56-afdb0067ce7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=45b8ab1a9f7e474084df1ca9ba8de009, user_id=074b9b5e7e0848dcb9b743649fe44291, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:13.039480 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f8d4d-a2aa-4685-8a56-afdb0067ce7f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:13.049633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b24b8-e9ea-41f9-9fae-54338ad20f96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:13.054949 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b24b8-e9ea-41f9-9fae-54338ad20f96 service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:13.082387 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 822/1635] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:53:12 2022] PUT /identity/v3/projects/45b8ab1a9f7e474084df1ca9ba8de009/users/074b9b5e7e0848dcb9b743649fe44291/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:13.086053 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e51229-1466-4626-b860-20aa3beaf4b9 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:13.086718 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e51229-1466-4626-b860-20aa3beaf4b9 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:13.087418 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e51229-1466-4626-b860-20aa3beaf4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:13.089677 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 814/1636] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:53:13.122042 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-a9e51229-1466-4626-b860-20aa3beaf4b9 None None] MFA Rules not processed for user `074b9b5e7e0848dcb9b743649fe44291`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:13.123574 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a9e51229-1466-4626-b860-20aa3beaf4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:13.150941 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:13.222001 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4773b-7296-4b01-85af-04cca6219705 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:13.222292 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4773b-7296-4b01-85af-04cca6219705 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:13.222588 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4773b-7296-4b01-85af-04cca6219705 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:13.224306 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 815/1637] 10.222.0.16 () {54 vars in 912 bytes} [Fri Jun 24 10:53:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:53:13.233753 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c6056-e1fa-4513-8218-268dd452c73e None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:13.234085 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c6056-e1fa-4513-8218-268dd452c73e None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:13.234316 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c6056-e1fa-4513-8218-268dd452c73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:13.283194 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 823/1638] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:13.293450 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-321c6056-e1fa-4513-8218-268dd452c73e None None] MFA Rules not processed for user `e8034bad51144002a7386c975e412992`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:13.294827 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-321c6056-e1fa-4513-8218-268dd452c73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:13.294973 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e51229-1466-4626-b860-20aa3beaf4b9 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:13.359218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:13.429114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e51229-1466-4626-b860-20aa3beaf4b9 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:13.448955 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc46ab-940c-4938-ba79-f2a4c0e5473d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:13.450293 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc46ab-940c-4938-ba79-f2a4c0e5473d service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:13.451215 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc46ab-940c-4938-ba79-f2a4c0e5473d service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:13.452169 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc46ab-940c-4938-ba79-f2a4c0e5473d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:13.468895 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 816/1639] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jun 24 10:53:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 24 10:53:13.470893 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509a5cd-809f-44b2-a516-d2c8290f666a None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:13.472421 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509a5cd-809f-44b2-a516-d2c8290f666a None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:13.472946 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509a5cd-809f-44b2-a516-d2c8290f666a None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:13.475210 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 817/1640] 10.222.0.16 () {54 vars in 912 bytes} [Fri Jun 24 10:53:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:53:13.475382 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc46ab-940c-4938-ba79-f2a4c0e5473d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:13.476913 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc46ab-940c-4938-ba79-f2a4c0e5473d service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:13.485127 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad157c-fd00-4a54-959a-b02503f1ab46 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:13.485861 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad157c-fd00-4a54-959a-b02503f1ab46 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:13.487182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad157c-fd00-4a54-959a-b02503f1ab46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:13.504006 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 824/1641] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:13 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:53:13.518623 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-76ad157c-fd00-4a54-959a-b02503f1ab46 None None] MFA Rules not processed for user `e8034bad51144002a7386c975e412992`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:13.520651 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-76ad157c-fd00-4a54-959a-b02503f1ab46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:13.535939 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 818/1642] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jun 24 10:53:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:13.562379 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc46ab-940c-4938-ba79-f2a4c0e5473d service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:13.576911 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc46ab-940c-4938-ba79-f2a4c0e5473d service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:13.591489 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ae60e-ef02-4323-bc41-ddfeedf44796 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:13.592270 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ae60e-ef02-4323-bc41-ddfeedf44796 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:13.592722 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ae60e-ef02-4323-bc41-ddfeedf44796 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:13.593034 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ae60e-ef02-4323-bc41-ddfeedf44796 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:13.618060 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad157c-fd00-4a54-959a-b02503f1ab46 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:13.632642 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ae60e-ef02-4323-bc41-ddfeedf44796 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:13.632980 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad157c-fd00-4a54-959a-b02503f1ab46 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:13.635674 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ae60e-ef02-4323-bc41-ddfeedf44796 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:13.647601 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14645581-bd82-46b7-8903-8fab6d929a0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:13.648454 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14645581-bd82-46b7-8903-8fab6d929a0a service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:13.648600 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14645581-bd82-46b7-8903-8fab6d929a0a service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:13.648832 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14645581-bd82-46b7-8903-8fab6d929a0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:13.655316 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 825/1643] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:53:13.691695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14645581-bd82-46b7-8903-8fab6d929a0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:13.696331 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14645581-bd82-46b7-8903-8fab6d929a0a service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:13.726720 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 819/1644] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:53:14.661055 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ae60e-ef02-4323-bc41-ddfeedf44796 service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:14.677451 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ae60e-ef02-4323-bc41-ddfeedf44796 service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:14.681702 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99032104-591e-42b5-a29c-3fdc1dc66140 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:14.689576 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99032104-591e-42b5-a29c-3fdc1dc66140 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:14.690041 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99032104-591e-42b5-a29c-3fdc1dc66140 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:14.690370 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99032104-591e-42b5-a29c-3fdc1dc66140 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:14.815479 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99032104-591e-42b5-a29c-3fdc1dc66140 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:14.817030 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99032104-591e-42b5-a29c-3fdc1dc66140 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:14.836004 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 826/1645] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:53:22.692055 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942dbc0e-c12c-4648-b6fd-9590495aed6a None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:22.692548 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942dbc0e-c12c-4648-b6fd-9590495aed6a None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:22.692625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942dbc0e-c12c-4648-b6fd-9590495aed6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:22.752316 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-942dbc0e-c12c-4648-b6fd-9590495aed6a None None] MFA Rules not processed for user `94d5d8610e67494dbebf53c4ed560504`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:22.753589 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-942dbc0e-c12c-4648-b6fd-9590495aed6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:22.881584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 820/1646] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:22.897823 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99032104-591e-42b5-a29c-3fdc1dc66140 service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:22.919625 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99032104-591e-42b5-a29c-3fdc1dc66140 service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:22.937324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609d87d-ec0b-431e-b652-d4f0af0f6857 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:22.938191 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609d87d-ec0b-431e-b652-d4f0af0f6857 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:22.938564 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609d87d-ec0b-431e-b652-d4f0af0f6857 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:22.938935 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609d87d-ec0b-431e-b652-d4f0af0f6857 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:22.965729 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609d87d-ec0b-431e-b652-d4f0af0f6857 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:22.967365 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609d87d-ec0b-431e-b652-d4f0af0f6857 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:23.006918 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 827/1647] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:53:23.246480 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b872e33-0f84-42ef-8e56-f9f9b00d4145 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:23.246598 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b872e33-0f84-42ef-8e56-f9f9b00d4145 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:23.246871 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b872e33-0f84-42ef-8e56-f9f9b00d4145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:23.331499 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-7b872e33-0f84-42ef-8e56-f9f9b00d4145 None None] MFA Rules not processed for user `25281e85b31b47d9889838ba5a65c328`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:23.334850 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-7b872e33-0f84-42ef-8e56-f9f9b00d4145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:23.570428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 821/1648] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:23.607429 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609d87d-ec0b-431e-b652-d4f0af0f6857 service nova] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:23.615417 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267bc76-1ccc-4417-8cda-8291cba6c201 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:23.616333 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267bc76-1ccc-4417-8cda-8291cba6c201 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:23.616333 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267bc76-1ccc-4417-8cda-8291cba6c201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:23.639080 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609d87d-ec0b-431e-b652-d4f0af0f6857 service nova] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:23.660348 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6dcce-00a5-4428-923a-3dd2646ee9ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:23.670195 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6dcce-00a5-4428-923a-3dd2646ee9ca service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:23.673693 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6dcce-00a5-4428-923a-3dd2646ee9ca service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:23.675489 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6dcce-00a5-4428-923a-3dd2646ee9ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:23.715132 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6dcce-00a5-4428-923a-3dd2646ee9ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:23.720085 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-b267bc76-1ccc-4417-8cda-8291cba6c201 None None] MFA Rules not processed for user `924040e7b5cf435fa78ed20e1c3e0b02`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:23.721674 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-b267bc76-1ccc-4417-8cda-8291cba6c201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:23.722344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6dcce-00a5-4428-923a-3dd2646ee9ca service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:23.742691 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:23.749712 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 828/1649] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:53:23.950047 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 822/1650] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:53:23.965387 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92f749-ba99-4a8b-a2e4-e316dea0ed7e None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:23.966331 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92f749-ba99-4a8b-a2e4-e316dea0ed7e None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:23.966913 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92f749-ba99-4a8b-a2e4-e316dea0ed7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:24.019782 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-bf92f749-ba99-4a8b-a2e4-e316dea0ed7e None None] MFA Rules not processed for user `924040e7b5cf435fa78ed20e1c3e0b02`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:24.024507 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-bf92f749-ba99-4a8b-a2e4-e316dea0ed7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:24.042931 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 829/1651] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:24.054203 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267bc76-1ccc-4417-8cda-8291cba6c201 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:24.079921 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267bc76-1ccc-4417-8cda-8291cba6c201 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:24.109004 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ee324-0145-47f1-8fc5-ad6744bbeb9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:24.110716 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ee324-0145-47f1-8fc5-ad6744bbeb9d service nova] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:24.110880 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ee324-0145-47f1-8fc5-ad6744bbeb9d service nova] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:24.111424 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ee324-0145-47f1-8fc5-ad6744bbeb9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:24.124450 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ee324-0145-47f1-8fc5-ad6744bbeb9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:24.129375 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ee324-0145-47f1-8fc5-ad6744bbeb9d service nova] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:24.140160 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 823/1652] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:53:25.120217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc2c78-7703-419b-954a-d125f8295d2a None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:25.121131 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc2c78-7703-419b-954a-d125f8295d2a None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:25.121614 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc2c78-7703-419b-954a-d125f8295d2a None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:25.124630 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 830/1653] 10.222.0.16 () {54 vars in 912 bytes} [Fri Jun 24 10:53:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:53:25.130993 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d20347-b13c-4faf-97a3-cb37c2afc528 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:25.133844 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d20347-b13c-4faf-97a3-cb37c2afc528 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:25.134138 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d20347-b13c-4faf-97a3-cb37c2afc528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:25.233898 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-03d20347-b13c-4faf-97a3-cb37c2afc528 None None] MFA Rules not processed for user `9c20321abda7406c843b4ee691da2106`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:25.235292 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-03d20347-b13c-4faf-97a3-cb37c2afc528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:25.383505 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 824/1654] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jun 24 10:53:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:53:25.420964 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc2c78-7703-419b-954a-d125f8295d2a None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:25.440600 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc2c78-7703-419b-954a-d125f8295d2a None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:25.446899 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a1cb0-106a-405d-913f-41e76ceadc49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:25.447635 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a1cb0-106a-405d-913f-41e76ceadc49 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:25.447925 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a1cb0-106a-405d-913f-41e76ceadc49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:25.448209 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a1cb0-106a-405d-913f-41e76ceadc49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:25.465406 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:25.480348 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9a1cb0-106a-405d-913f-41e76ceadc49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:25.481843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9a1cb0-106a-405d-913f-41e76ceadc49 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:25.497638 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 831/1655] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:53:25.909197 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278471b8-07c2-4d9a-a5f2-089a6e4edae6 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:25.910258 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278471b8-07c2-4d9a-a5f2-089a6e4edae6 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:25.910258 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278471b8-07c2-4d9a-a5f2-089a6e4edae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:25.996940 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-278471b8-07c2-4d9a-a5f2-089a6e4edae6 None None] MFA Rules not processed for user `09d927f9878e487b9794113927ab336a`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:25.998656 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-278471b8-07c2-4d9a-a5f2-089a6e4edae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:26.176338 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb9263-64c0-4fd0-9cec-e3425f1616c6 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:26.177217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb9263-64c0-4fd0-9cec-e3425f1616c6 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:26.177528 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb9263-64c0-4fd0-9cec-e3425f1616c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:26.179692 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 825/1656] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:26.220110 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-9adb9263-64c0-4fd0-9cec-e3425f1616c6 None None] MFA Rules not processed for user `09d927f9878e487b9794113927ab336a`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:26.222130 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9adb9263-64c0-4fd0-9cec-e3425f1616c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:26.251868 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 832/1657] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:26.285175 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278471b8-07c2-4d9a-a5f2-089a6e4edae6 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:26.349579 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278471b8-07c2-4d9a-a5f2-089a6e4edae6 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:26.364784 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fc70a-c376-473c-80fd-8a2d2eafdf88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:26.365739 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fc70a-c376-473c-80fd-8a2d2eafdf88 service nova] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:26.366157 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fc70a-c376-473c-80fd-8a2d2eafdf88 service nova] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:26.366574 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fc70a-c376-473c-80fd-8a2d2eafdf88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:26.391236 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0fc70a-c376-473c-80fd-8a2d2eafdf88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:26.394629 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0fc70a-c376-473c-80fd-8a2d2eafdf88 service nova] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:26.434709 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 826/1658] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:53:26.497460 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb5f40-9d70-47b1-8c8b-b39b61b78ca8 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:26.497742 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb5f40-9d70-47b1-8c8b-b39b61b78ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:26.498026 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb5f40-9d70-47b1-8c8b-b39b61b78ca8 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:26.501139 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 833/1659] 10.222.0.16 () {54 vars in 960 bytes} [Fri Jun 24 10:53:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:53:26.510693 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a59c44-b5ee-433a-9b29-79efc5f3347d None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:26.511305 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a59c44-b5ee-433a-9b29-79efc5f3347d None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:26.511726 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a59c44-b5ee-433a-9b29-79efc5f3347d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:26.549088 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-63a59c44-b5ee-433a-9b29-79efc5f3347d None None] MFA Rules not processed for user `b365d9dd635e4518a41181649c323062`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:26.550709 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-63a59c44-b5ee-433a-9b29-79efc5f3347d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:26.565436 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:26.741276 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 827/1660] 10.222.0.16 () {58 vars in 1057 bytes} [Fri Jun 24 10:53:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:26.748112 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb5f40-9d70-47b1-8c8b-b39b61b78ca8 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:26.775653 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb5f40-9d70-47b1-8c8b-b39b61b78ca8 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:26.797068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85048738-97a0-400f-bb6f-121df36fc1e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b365d9dd635e4518a41181649c323062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:26.797904 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85048738-97a0-400f-bb6f-121df36fc1e5 service placement] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:26.798208 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85048738-97a0-400f-bb6f-121df36fc1e5 service placement] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:26.798471 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85048738-97a0-400f-bb6f-121df36fc1e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:26.800390 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-85048738-97a0-400f-bb6f-121df36fc1e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:26.834912 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85048738-97a0-400f-bb6f-121df36fc1e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:26.837425 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85048738-97a0-400f-bb6f-121df36fc1e5 service placement] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:26.871184 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 834/1661] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:53:27.137178 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141971d4-efa3-4469-9ce5-8c5bed2f2f61 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:27.137473 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141971d4-efa3-4469-9ce5-8c5bed2f2f61 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:27.137760 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141971d4-efa3-4469-9ce5-8c5bed2f2f61 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:27.142708 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 828/1662] 10.222.0.16 () {54 vars in 912 bytes} [Fri Jun 24 10:53:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:53:27.152746 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924a7c1-cf51-4ec6-9e9e-d95caa17adcf None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:27.153426 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924a7c1-cf51-4ec6-9e9e-d95caa17adcf None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:27.153922 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924a7c1-cf51-4ec6-9e9e-d95caa17adcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:27.179571 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-0924a7c1-cf51-4ec6-9e9e-d95caa17adcf None None] MFA Rules not processed for user `9c20321abda7406c843b4ee691da2106`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:27.181297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-0924a7c1-cf51-4ec6-9e9e-d95caa17adcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:27.189262 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 835/1663] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jun 24 10:53:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:27.202171 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141971d4-efa3-4469-9ce5-8c5bed2f2f61 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:27.221493 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141971d4-efa3-4469-9ce5-8c5bed2f2f61 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:27.238750 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1208f-fdd6-46db-a524-5098be0838a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:27.240272 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1208f-fdd6-46db-a524-5098be0838a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:27.241075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1208f-fdd6-46db-a524-5098be0838a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:27.241655 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1208f-fdd6-46db-a524-5098be0838a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:27.258337 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1208f-fdd6-46db-a524-5098be0838a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:27.260298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1208f-fdd6-46db-a524-5098be0838a4 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:27.283202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 829/1664] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:53:28.133590 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c375707-896e-476e-b7f6-f9f092232830 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:28.133792 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c375707-896e-476e-b7f6-f9f092232830 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:28.134237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c375707-896e-476e-b7f6-f9f092232830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:28.191557 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-6c375707-896e-476e-b7f6-f9f092232830 None None] MFA Rules not processed for user `94d5d8610e67494dbebf53c4ed560504`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:28.192875 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6c375707-896e-476e-b7f6-f9f092232830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:28.208876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 836/1665] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:28.290478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64753538-1284-4d6f-8e34-c52439384424 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:28.291439 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64753538-1284-4d6f-8e34-c52439384424 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:28.291860 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64753538-1284-4d6f-8e34-c52439384424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:28.331937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-64753538-1284-4d6f-8e34-c52439384424 None None] MFA Rules not processed for user `09d927f9878e487b9794113927ab336a`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:28.333326 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-64753538-1284-4d6f-8e34-c52439384424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:28.371772 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 830/1666] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:28.669633 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1c547-368e-4fcb-8810-59aa0e10d9d3 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:28.670034 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1c547-368e-4fcb-8810-59aa0e10d9d3 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:28.670329 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1c547-368e-4fcb-8810-59aa0e10d9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:28.707560 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-08b1c547-368e-4fcb-8810-59aa0e10d9d3 None None] MFA Rules not processed for user `25281e85b31b47d9889838ba5a65c328`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:28.708837 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-08b1c547-368e-4fcb-8810-59aa0e10d9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:28.723186 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 837/1667] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:33.802358 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b6ed1-52fc-4919-9816-a650a844092d None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:33.802890 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b6ed1-52fc-4919-9816-a650a844092d None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:33.802983 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b6ed1-52fc-4919-9816-a650a844092d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:33.878017 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-314b6ed1-52fc-4919-9816-a650a844092d None None] MFA Rules not processed for user `4dfddd72dfa84ce39fe62112224b425d`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:33.888562 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-314b6ed1-52fc-4919-9816-a650a844092d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:34.032750 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1c547-368e-4fcb-8810-59aa0e10d9d3 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:34.153992 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 831/1668] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jun 24 10:53:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:34.330116 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1c547-368e-4fcb-8810-59aa0e10d9d3 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:34.341277 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f4ae5-5bb8-4c01-9ff4-9641e2d81042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:34.345688 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f4ae5-5bb8-4c01-9ff4-9641e2d81042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:34.347074 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f4ae5-5bb8-4c01-9ff4-9641e2d81042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:34.347557 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f4ae5-5bb8-4c01-9ff4-9641e2d81042 admin admin] PATH_INFO: `/v3/users/3c48ff0e2dc24af5a33a09abbe46bdbf` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:34.350316 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f4ae5-5bb8-4c01-9ff4-9641e2d81042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c48ff0e2dc24af5a33a09abbe46bdbf)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:34.354105 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f4ae5-5bb8-4c01-9ff4-9641e2d81042 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:34.451983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-759f4ae5-5bb8-4c01-9ff4-9641e2d81042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c48ff0e2dc24af5a33a09abbe46bdbf'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:34.465427 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-759f4ae5-5bb8-4c01-9ff4-9641e2d81042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c48ff0e2dc24af5a33a09abbe46bdbf'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:34.483742 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-759f4ae5-5bb8-4c01-9ff4-9641e2d81042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c48ff0e2dc24af5a33a09abbe46bdbf'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:34.484887 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-759f4ae5-5bb8-4c01-9ff4-9641e2d81042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c48ff0e2dc24af5a33a09abbe46bdbf'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:34.552167 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-759f4ae5-5bb8-4c01-9ff4-9641e2d81042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c48ff0e2dc24af5a33a09abbe46bdbf'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:34.574769 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b6ed1-52fc-4919-9816-a650a844092d None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:34.576511 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-314b6ed1-52fc-4919-9816-a650a844092d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:34.591914 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 838/1669] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:53:34 2022] DELETE /identity/v3/users/3c48ff0e2dc24af5a33a09abbe46bdbf => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:34.601080 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3aff26-3aa0-4ad3-af94-df08316644aa None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:34.601376 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3aff26-3aa0-4ad3-af94-df08316644aa None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:34.601662 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3aff26-3aa0-4ad3-af94-df08316644aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:34.694275 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-6a3aff26-3aa0-4ad3-af94-df08316644aa None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:34.695558 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6a3aff26-3aa0-4ad3-af94-df08316644aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:34.883192 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:34.987004 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b6ed1-52fc-4919-9816-a650a844092d None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:35.040423 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 839/1670] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:35.131838 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:35.231271 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f770e-d3ac-47f1-9699-8516883917d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff592d9ebd4241019625828ddd41aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:35.232347 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f770e-d3ac-47f1-9699-8516883917d4 service swift] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:35.233002 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f770e-d3ac-47f1-9699-8516883917d4 service swift] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:35.233476 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f770e-d3ac-47f1-9699-8516883917d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:35.236390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-a82f770e-d3ac-47f1-9699-8516883917d4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:35.301939 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3aff26-3aa0-4ad3-af94-df08316644aa None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:35.303560 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6a3aff26-3aa0-4ad3-af94-df08316644aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:35.411178 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f770e-d3ac-47f1-9699-8516883917d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:35.414029 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f770e-d3ac-47f1-9699-8516883917d4 service swift] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:35.419217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3aff26-3aa0-4ad3-af94-df08316644aa None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:35.426082 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613eb49-37b7-4754-82d1-c0440dac00b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:35.428727 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613eb49-37b7-4754-82d1-c0440dac00b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:35.429200 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613eb49-37b7-4754-82d1-c0440dac00b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:35.429638 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613eb49-37b7-4754-82d1-c0440dac00b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:35.443567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613eb49-37b7-4754-82d1-c0440dac00b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:35.445452 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613eb49-37b7-4754-82d1-c0440dac00b2 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:35.458358 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 832/1671] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jun 24 10:53:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 884 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 10:53:35.459994 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 840/1672] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:53:35.858983 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f770e-d3ac-47f1-9699-8516883917d4 service swift] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:35.860576 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-a82f770e-d3ac-47f1-9699-8516883917d4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:35.912370 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f770e-d3ac-47f1-9699-8516883917d4 service swift] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:35.935331 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42947a96-f38b-492b-9313-6eb5ee887944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:35.954870 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42947a96-f38b-492b-9313-6eb5ee887944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:35.956219 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42947a96-f38b-492b-9313-6eb5ee887944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:35.958306 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42947a96-f38b-492b-9313-6eb5ee887944 admin admin] PATH_INFO: `/v3/users/85215e27efcd450f8c5932ae8bc9af70` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:35.965659 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42947a96-f38b-492b-9313-6eb5ee887944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85215e27efcd450f8c5932ae8bc9af70)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:35.972306 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: WARNING py.warnings [None req-42947a96-f38b-492b-9313-6eb5ee887944 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:53:35.972306 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: warnings.warn(msg) Jun 24 10:53:35.972306 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: Jun 24 10:53:35.974769 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42947a96-f38b-492b-9313-6eb5ee887944 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:35.986802 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2e992-8a11-40ba-8220-94453c48af27 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:35.987536 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2e992-8a11-40ba-8220-94453c48af27 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:35.987832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2e992-8a11-40ba-8220-94453c48af27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:36.043445 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-28e2e992-8a11-40ba-8220-94453c48af27 None None] MFA Rules not processed for user `9c20321abda7406c843b4ee691da2106`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:36.061199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-28e2e992-8a11-40ba-8220-94453c48af27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:36.098879 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 841/1673] 10.222.0.33 () {58 vars in 1015 bytes} [Fri Jun 24 10:53:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:36.181932 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2e992-8a11-40ba-8220-94453c48af27 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:36.195684 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2e992-8a11-40ba-8220-94453c48af27 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:36.212120 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-42947a96-f38b-492b-9313-6eb5ee887944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85215e27efcd450f8c5932ae8bc9af70'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:36.217693 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1920ec5-2b4d-4fdd-b4fb-17cb0ae58f80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:36.220873 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1920ec5-2b4d-4fdd-b4fb-17cb0ae58f80 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:36.227218 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1920ec5-2b4d-4fdd-b4fb-17cb0ae58f80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:36.227795 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1920ec5-2b4d-4fdd-b4fb-17cb0ae58f80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:36.259362 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-42947a96-f38b-492b-9313-6eb5ee887944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85215e27efcd450f8c5932ae8bc9af70'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:36.281300 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1920ec5-2b4d-4fdd-b4fb-17cb0ae58f80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:36.286014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-42947a96-f38b-492b-9313-6eb5ee887944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85215e27efcd450f8c5932ae8bc9af70'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:36.286887 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-42947a96-f38b-492b-9313-6eb5ee887944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85215e27efcd450f8c5932ae8bc9af70'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:36.289971 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1920ec5-2b4d-4fdd-b4fb-17cb0ae58f80 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:36.345278 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 842/1674] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:53:36.351191 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-42947a96-f38b-492b-9313-6eb5ee887944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85215e27efcd450f8c5932ae8bc9af70'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:36.389472 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 833/1675] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:53:35 2022] DELETE /identity/v3/users/85215e27efcd450f8c5932ae8bc9af70 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:36.398786 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a5789-666c-4400-9a8e-e07b3b899ab4 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:36.399319 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a5789-666c-4400-9a8e-e07b3b899ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:36.399861 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a5789-666c-4400-9a8e-e07b3b899ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:36.439141 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-a17a5789-666c-4400-9a8e-e07b3b899ab4 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:36.440805 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a17a5789-666c-4400-9a8e-e07b3b899ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:36.619105 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 843/1676] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:36.711307 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42947a96-f38b-492b-9313-6eb5ee887944 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:36.713126 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-42947a96-f38b-492b-9313-6eb5ee887944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:36.879498 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:36.904191 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42947a96-f38b-492b-9313-6eb5ee887944 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:36.911800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f20319-e093-4b91-a646-48895cea83be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:36.913262 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f20319-e093-4b91-a646-48895cea83be service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:36.913809 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f20319-e093-4b91-a646-48895cea83be service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:36.914312 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f20319-e093-4b91-a646-48895cea83be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:36.929564 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f20319-e093-4b91-a646-48895cea83be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:36.934216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f20319-e093-4b91-a646-48895cea83be service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:36.954125 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 834/1677] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:53:37.055335 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a5789-666c-4400-9a8e-e07b3b899ab4 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:37.060057 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a17a5789-666c-4400-9a8e-e07b3b899ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:37.084005 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a5789-666c-4400-9a8e-e07b3b899ab4 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:37.117354 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f2daf-de15-4e70-9426-342daec4630b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:37.118225 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f2daf-de15-4e70-9426-342daec4630b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:37.118507 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f2daf-de15-4e70-9426-342daec4630b admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:37.118781 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f2daf-de15-4e70-9426-342daec4630b admin admin] PATH_INFO: `/v3/users/5d124d6e1c53494bb5d80d60f840a65a` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:37.120897 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f2daf-de15-4e70-9426-342daec4630b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d124d6e1c53494bb5d80d60f840a65a)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:37.122623 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f2daf-de15-4e70-9426-342daec4630b admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:37.213364 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a68f2daf-de15-4e70-9426-342daec4630b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d124d6e1c53494bb5d80d60f840a65a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:37.226915 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:37.233856 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a68f2daf-de15-4e70-9426-342daec4630b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d124d6e1c53494bb5d80d60f840a65a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:37.249046 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a68f2daf-de15-4e70-9426-342daec4630b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d124d6e1c53494bb5d80d60f840a65a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:37.249696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a68f2daf-de15-4e70-9426-342daec4630b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d124d6e1c53494bb5d80d60f840a65a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:37.274350 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a68f2daf-de15-4e70-9426-342daec4630b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d124d6e1c53494bb5d80d60f840a65a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:37.289710 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 844/1678] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:53:37 2022] DELETE /identity/v3/users/5d124d6e1c53494bb5d80d60f840a65a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:37.295432 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7f8a1-fc31-4576-af1d-c931fbc4a033 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:37.295967 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7f8a1-fc31-4576-af1d-c931fbc4a033 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:37.296048 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7f8a1-fc31-4576-af1d-c931fbc4a033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:37.340235 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-4fc7f8a1-fc31-4576-af1d-c931fbc4a033 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:37.346286 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-4fc7f8a1-fc31-4576-af1d-c931fbc4a033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:37.574423 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 835/1679] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:37.661052 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f2daf-de15-4e70-9426-342daec4630b admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:37.663549 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a68f2daf-de15-4e70-9426-342daec4630b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:37.797384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f2daf-de15-4e70-9426-342daec4630b admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:37.806433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4caebb-bc0a-4671-bef7-4b140be31497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:37.807125 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4caebb-bc0a-4671-bef7-4b140be31497 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:37.807434 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4caebb-bc0a-4671-bef7-4b140be31497 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:37.807716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4caebb-bc0a-4671-bef7-4b140be31497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:37.832446 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4caebb-bc0a-4671-bef7-4b140be31497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:37.834355 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4caebb-bc0a-4671-bef7-4b140be31497 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:37.866015 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 845/1680] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:53:37.886165 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7f8a1-fc31-4576-af1d-c931fbc4a033 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:37.888092 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-4fc7f8a1-fc31-4576-af1d-c931fbc4a033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:37.915782 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7f8a1-fc31-4576-af1d-c931fbc4a033 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:37.930962 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082d32b-62a3-430b-ae97-27af68c02c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:37.932976 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082d32b-62a3-430b-ae97-27af68c02c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:37.934113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082d32b-62a3-430b-ae97-27af68c02c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:37.935733 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082d32b-62a3-430b-ae97-27af68c02c6f admin admin] PATH_INFO: `/v3/projects/09f57d24b154434ba7a8a7a86fb1e79e` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:37.940116 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082d32b-62a3-430b-ae97-27af68c02c6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=09f57d24b154434ba7a8a7a86fb1e79e)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:37.946782 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082d32b-62a3-430b-ae97-27af68c02c6f admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:38.087555 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a082d32b-62a3-430b-ae97-27af68c02c6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09f57d24b154434ba7a8a7a86fb1e79e', 'request_id': 'req-a082d32b-62a3-430b-ae97-27af68c02c6f'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:38.104578 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a082d32b-62a3-430b-ae97-27af68c02c6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09f57d24b154434ba7a8a7a86fb1e79e', 'request_id': 'req-a082d32b-62a3-430b-ae97-27af68c02c6f'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:38.119321 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a082d32b-62a3-430b-ae97-27af68c02c6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09f57d24b154434ba7a8a7a86fb1e79e', 'request_id': 'req-a082d32b-62a3-430b-ae97-27af68c02c6f'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:38.163944 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a082d32b-62a3-430b-ae97-27af68c02c6f admin admin] The token cache is being invalidate because project 09f57d24b154434ba7a8a7a86fb1e79e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:53:38.164182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a082d32b-62a3-430b-ae97-27af68c02c6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:38.168008 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a082d32b-62a3-430b-ae97-27af68c02c6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:38.184525 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 836/1681] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:53:37 2022] DELETE /identity/v3/projects/09f57d24b154434ba7a8a7a86fb1e79e => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:38.186389 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efe613-9504-4529-a55b-f34a49ba9203 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:38.186927 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efe613-9504-4529-a55b-f34a49ba9203 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:38.186927 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efe613-9504-4529-a55b-f34a49ba9203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:38.228420 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-d3efe613-9504-4529-a55b-f34a49ba9203 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:38.233363 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-d3efe613-9504-4529-a55b-f34a49ba9203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:38.423612 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 846/1682] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:38.432726 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2786c51-f0c3-4ac4-b9f5-bb8c2677d2bc None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:38.433303 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2786c51-f0c3-4ac4-b9f5-bb8c2677d2bc None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:38.433568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2786c51-f0c3-4ac4-b9f5-bb8c2677d2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:38.491954 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-d2786c51-f0c3-4ac4-b9f5-bb8c2677d2bc None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:38.502900 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-d2786c51-f0c3-4ac4-b9f5-bb8c2677d2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:38.517900 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 837/1683] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:38.522479 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3efe613-9504-4529-a55b-f34a49ba9203 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:38.533260 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3efe613-9504-4529-a55b-f34a49ba9203 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:38.545363 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295da62-56c3-41b6-9c74-88d8d36848be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:38.547100 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295da62-56c3-41b6-9c74-88d8d36848be admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:38.547701 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295da62-56c3-41b6-9c74-88d8d36848be admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:38.548565 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295da62-56c3-41b6-9c74-88d8d36848be admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:38.551879 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295da62-56c3-41b6-9c74-88d8d36848be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:53:38.552332 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295da62-56c3-41b6-9c74-88d8d36848be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:38.557293 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295da62-56c3-41b6-9c74-88d8d36848be admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:38.581842 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 847/1684] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:53:38.585753 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2786c51-f0c3-4ac4-b9f5-bb8c2677d2bc None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:38.600678 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2786c51-f0c3-4ac4-b9f5-bb8c2677d2bc None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:38.628411 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560cce6-4c24-459d-8d4b-445889fd7e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:38.629115 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560cce6-4c24-459d-8d4b-445889fd7e14 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:38.629393 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560cce6-4c24-459d-8d4b-445889fd7e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:38.629672 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560cce6-4c24-459d-8d4b-445889fd7e14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:38.630427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1560cce6-4c24-459d-8d4b-445889fd7e14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:38.632446 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1560cce6-4c24-459d-8d4b-445889fd7e14 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:38.721194 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 838/1685] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:53:38 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:53:38.728548 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295da62-56c3-41b6-9c74-88d8d36848be admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:38.746875 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295da62-56c3-41b6-9c74-88d8d36848be admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:38.956618 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be364ad-94e1-41a4-8a9f-65d807c12aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:38.957587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be364ad-94e1-41a4-8a9f-65d807c12aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:38.958007 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be364ad-94e1-41a4-8a9f-65d807c12aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:38.958439 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be364ad-94e1-41a4-8a9f-65d807c12aa6 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:38.965386 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be364ad-94e1-41a4-8a9f-65d807c12aa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:38.971723 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be364ad-94e1-41a4-8a9f-65d807c12aa6 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:39.020571 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:39.050524 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 848/1686] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:53:38 2022] POST /identity/v3/users => generated 289 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:53:39.055142 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560cce6-4c24-459d-8d4b-445889fd7e14 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:39.084144 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560cce6-4c24-459d-8d4b-445889fd7e14 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:39.105224 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef766ba-277e-4d32-902e-c931311ea50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:39.108091 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef766ba-277e-4d32-902e-c931311ea50a admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:39.108424 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef766ba-277e-4d32-902e-c931311ea50a admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:39.108745 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef766ba-277e-4d32-902e-c931311ea50a admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:39.113675 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef766ba-277e-4d32-902e-c931311ea50a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:39.128357 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef766ba-277e-4d32-902e-c931311ea50a admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:39.165222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 839/1687] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:39.167584 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be364ad-94e1-41a4-8a9f-65d807c12aa6 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:39.194933 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be364ad-94e1-41a4-8a9f-65d807c12aa6 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:39.214956 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77670ac4-3a65-4c5e-abed-271d44b4f847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:39.216159 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77670ac4-3a65-4c5e-abed-271d44b4f847 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:39.216616 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77670ac4-3a65-4c5e-abed-271d44b4f847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:39.217046 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77670ac4-3a65-4c5e-abed-271d44b4f847 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:39.217944 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77670ac4-3a65-4c5e-abed-271d44b4f847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:39.220101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77670ac4-3a65-4c5e-abed-271d44b4f847 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:39.283038 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 849/1688] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:39.288365 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef766ba-277e-4d32-902e-c931311ea50a admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:39.304572 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef766ba-277e-4d32-902e-c931311ea50a admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:39.320446 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3129135-68f5-4e77-abf5-3a2b7e331257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:39.326870 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3129135-68f5-4e77-abf5-3a2b7e331257 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:39.327206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3129135-68f5-4e77-abf5-3a2b7e331257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:39.327478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3129135-68f5-4e77-abf5-3a2b7e331257 admin admin] PATH_INFO: `/v3/projects/78b6b7d905f1408fb72f27c1794103eb/users/42b8dbe338754ef49c831635abad8d1c/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:39.388462 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3129135-68f5-4e77-abf5-3a2b7e331257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78b6b7d905f1408fb72f27c1794103eb, user_id=42b8dbe338754ef49c831635abad8d1c, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:39.398824 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3129135-68f5-4e77-abf5-3a2b7e331257 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:39.437507 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 840/1689] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:53:39 2022] PUT /identity/v3/projects/78b6b7d905f1408fb72f27c1794103eb/users/42b8dbe338754ef49c831635abad8d1c/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:39.448745 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708660a8-1e65-47ae-86f3-4d26b5347f79 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:39.448745 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708660a8-1e65-47ae-86f3-4d26b5347f79 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:39.448949 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708660a8-1e65-47ae-86f3-4d26b5347f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:39.518492 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-708660a8-1e65-47ae-86f3-4d26b5347f79 None None] MFA Rules not processed for user `42b8dbe338754ef49c831635abad8d1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:39.520579 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-708660a8-1e65-47ae-86f3-4d26b5347f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:39.761215 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 850/1690] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:39.763940 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3129135-68f5-4e77-abf5-3a2b7e331257 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:39.784749 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:39.910608 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3129135-68f5-4e77-abf5-3a2b7e331257 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:39.961146 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32aebb7-14f4-485a-a8ea-bbcf1450d89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:39.961848 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32aebb7-14f4-485a-a8ea-bbcf1450d89e admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:39.962140 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32aebb7-14f4-485a-a8ea-bbcf1450d89e admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:39.962464 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32aebb7-14f4-485a-a8ea-bbcf1450d89e admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:39.963246 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32aebb7-14f4-485a-a8ea-bbcf1450d89e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:39.965172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32aebb7-14f4-485a-a8ea-bbcf1450d89e admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:40.068103 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 841/1691] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:53:39 2022] POST /identity/v3/projects => generated 377 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:53:40.072328 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708660a8-1e65-47ae-86f3-4d26b5347f79 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:40.097153 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708660a8-1e65-47ae-86f3-4d26b5347f79 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:40.165947 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a984c-3c3a-4570-9800-fcb05a90efd4 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:40.166470 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a984c-3c3a-4570-9800-fcb05a90efd4 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:40.166907 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a984c-3c3a-4570-9800-fcb05a90efd4 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:40.169681 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 842/1692] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jun 24 10:53:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:53:40.260307 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374ec2b-0114-4ddd-9d72-1a2e4e0f444b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:40.261717 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374ec2b-0114-4ddd-9d72-1a2e4e0f444b admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:40.262151 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374ec2b-0114-4ddd-9d72-1a2e4e0f444b admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:40.262582 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374ec2b-0114-4ddd-9d72-1a2e4e0f444b admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:40.263470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374ec2b-0114-4ddd-9d72-1a2e4e0f444b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:40.265605 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374ec2b-0114-4ddd-9d72-1a2e4e0f444b admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:40.338093 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a984c-3c3a-4570-9800-fcb05a90efd4 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:40.345946 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 851/1693] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:53:40 2022] POST /identity/v3/users => generated 295 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:53:40.353971 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a984c-3c3a-4570-9800-fcb05a90efd4 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:40.378338 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c22aa4-f242-451b-84e7-13816470df86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:40.379737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c22aa4-f242-451b-84e7-13816470df86 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:40.380065 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c22aa4-f242-451b-84e7-13816470df86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:40.380394 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c22aa4-f242-451b-84e7-13816470df86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:40.381628 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c22aa4-f242-451b-84e7-13816470df86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:40.384107 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c22aa4-f242-451b-84e7-13816470df86 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:40.425444 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374ec2b-0114-4ddd-9d72-1a2e4e0f444b admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:40.436808 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 843/1694] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:40.437690 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374ec2b-0114-4ddd-9d72-1a2e4e0f444b admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:40.447184 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855446b-a933-48e5-ba09-a6b021d1a6e4 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:40.447678 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855446b-a933-48e5-ba09-a6b021d1a6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:40.447789 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855446b-a933-48e5-ba09-a6b021d1a6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:40.457465 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64128124-4d95-45d3-8eab-3424f8e8b8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:40.458394 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64128124-4d95-45d3-8eab-3424f8e8b8f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:40.458680 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64128124-4d95-45d3-8eab-3424f8e8b8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:40.458959 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64128124-4d95-45d3-8eab-3424f8e8b8f6 admin admin] PATH_INFO: `/v3/projects/7c512e1de2de499688d1126b14dd477e/users/47fe7c730e1743e1be9cd3cb53e891f0/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:40.470692 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-2855446b-a933-48e5-ba09-a6b021d1a6e4 None None] MFA Rules not processed for user `e8034bad51144002a7386c975e412992`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:40.472552 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-2855446b-a933-48e5-ba09-a6b021d1a6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:40.492495 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64128124-4d95-45d3-8eab-3424f8e8b8f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c512e1de2de499688d1126b14dd477e, user_id=47fe7c730e1743e1be9cd3cb53e891f0, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:40.496016 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64128124-4d95-45d3-8eab-3424f8e8b8f6 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:40.523910 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 852/1695] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:53:40 2022] PUT /identity/v3/projects/7c512e1de2de499688d1126b14dd477e/users/47fe7c730e1743e1be9cd3cb53e891f0/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:53:40.524893 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64128124-4d95-45d3-8eab-3424f8e8b8f6 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:40.530961 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-64128124-4d95-45d3-8eab-3424f8e8b8f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:40.613959 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:40.664946 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 844/1696] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jun 24 10:53:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:40.666016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855446b-a933-48e5-ba09-a6b021d1a6e4 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:40.669105 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64128124-4d95-45d3-8eab-3424f8e8b8f6 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:40.681240 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855446b-a933-48e5-ba09-a6b021d1a6e4 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:40.683527 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2e707-c75e-41eb-9a96-af10f936776b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:40.684465 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2e707-c75e-41eb-9a96-af10f936776b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:40.684751 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2e707-c75e-41eb-9a96-af10f936776b admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:40.685036 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2e707-c75e-41eb-9a96-af10f936776b admin admin] PATH_INFO: `/v3/projects/5fe136a765474178ab4ad9634b9faf5e` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:40.686299 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2e707-c75e-41eb-9a96-af10f936776b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fe136a765474178ab4ad9634b9faf5e)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:40.687390 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: WARNING py.warnings [None req-0ad2e707-c75e-41eb-9a96-af10f936776b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:53:40.687390 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: warnings.warn(msg) Jun 24 10:53:40.687390 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: Jun 24 10:53:40.688669 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2e707-c75e-41eb-9a96-af10f936776b admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:40.689176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f1233-2924-4ee0-90c4-948aaa92f76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:40.690504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f1233-2924-4ee0-90c4-948aaa92f76b admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:40.690943 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f1233-2924-4ee0-90c4-948aaa92f76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:40.691447 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f1233-2924-4ee0-90c4-948aaa92f76b admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:40.692376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f1233-2924-4ee0-90c4-948aaa92f76b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:40.695383 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f1233-2924-4ee0-90c4-948aaa92f76b admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:40.709578 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 845/1697] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:40.711309 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f1233-2924-4ee0-90c4-948aaa92f76b admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:40.713358 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-679f1233-2924-4ee0-90c4-948aaa92f76b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:40.727762 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f1233-2924-4ee0-90c4-948aaa92f76b admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:40.734242 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508437f5-7c26-419d-abc2-32258e905702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:40.735281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508437f5-7c26-419d-abc2-32258e905702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:40.735717 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508437f5-7c26-419d-abc2-32258e905702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:40.736002 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508437f5-7c26-419d-abc2-32258e905702 admin admin] PATH_INFO: `/v3/projects/5168276d9d244a759bb6386b3b577d33` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:40.737270 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508437f5-7c26-419d-abc2-32258e905702 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5168276d9d244a759bb6386b3b577d33)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:40.739362 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508437f5-7c26-419d-abc2-32258e905702 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:40.842404 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-0ad2e707-c75e-41eb-9a96-af10f936776b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fe136a765474178ab4ad9634b9faf5e', 'request_id': 'req-0ad2e707-c75e-41eb-9a96-af10f936776b'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:40.843490 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-508437f5-7c26-419d-abc2-32258e905702 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5168276d9d244a759bb6386b3b577d33', 'request_id': 'req-508437f5-7c26-419d-abc2-32258e905702'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:40.858178 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-508437f5-7c26-419d-abc2-32258e905702 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5168276d9d244a759bb6386b3b577d33', 'request_id': 'req-508437f5-7c26-419d-abc2-32258e905702'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:40.861613 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:40.864692 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-0ad2e707-c75e-41eb-9a96-af10f936776b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fe136a765474178ab4ad9634b9faf5e', 'request_id': 'req-0ad2e707-c75e-41eb-9a96-af10f936776b'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:40.881024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-508437f5-7c26-419d-abc2-32258e905702 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5168276d9d244a759bb6386b3b577d33', 'request_id': 'req-508437f5-7c26-419d-abc2-32258e905702'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:40.885110 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-0ad2e707-c75e-41eb-9a96-af10f936776b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fe136a765474178ab4ad9634b9faf5e', 'request_id': 'req-0ad2e707-c75e-41eb-9a96-af10f936776b'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:40.910776 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-508437f5-7c26-419d-abc2-32258e905702 admin admin] The token cache is being invalidate because project 5168276d9d244a759bb6386b3b577d33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:53:40.912287 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-508437f5-7c26-419d-abc2-32258e905702 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:40.913224 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-508437f5-7c26-419d-abc2-32258e905702 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:40.916545 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 846/1698] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:53:40 2022] DELETE /identity/v3/projects/5168276d9d244a759bb6386b3b577d33 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:40.918432 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508437f5-7c26-419d-abc2-32258e905702 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:40.920063 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-508437f5-7c26-419d-abc2-32258e905702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:40.961936 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-0ad2e707-c75e-41eb-9a96-af10f936776b admin admin] The token cache is being invalidate because project 5fe136a765474178ab4ad9634b9faf5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:53:40.962231 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-0ad2e707-c75e-41eb-9a96-af10f936776b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:40.967667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-0ad2e707-c75e-41eb-9a96-af10f936776b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:40.969963 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 853/1699] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:53:40 2022] DELETE /identity/v3/projects/5fe136a765474178ab4ad9634b9faf5e => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:40.974151 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f920195-f00b-4727-8cda-8f1edfce1c0f None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:40.974444 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f920195-f00b-4727-8cda-8f1edfce1c0f None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:40.974788 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f920195-f00b-4727-8cda-8f1edfce1c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:41.047854 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-8f920195-f00b-4727-8cda-8f1edfce1c0f None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:41.071704 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-8f920195-f00b-4727-8cda-8f1edfce1c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:41.097945 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 854/1700] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:41.108517 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f920195-f00b-4727-8cda-8f1edfce1c0f None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:41.113464 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508437f5-7c26-419d-abc2-32258e905702 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:41.114434 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-8f920195-f00b-4727-8cda-8f1edfce1c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:41.122881 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6684173-3662-41a2-9146-ff5b45e49d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:41.124387 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6684173-3662-41a2-9146-ff5b45e49d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:41.125039 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6684173-3662-41a2-9146-ff5b45e49d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:41.127867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6684173-3662-41a2-9146-ff5b45e49d8c admin admin] PATH_INFO: `/v3/projects/7c512e1de2de499688d1126b14dd477e/users/47fe7c730e1743e1be9cd3cb53e891f0/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:41.131644 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6684173-3662-41a2-9146-ff5b45e49d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c512e1de2de499688d1126b14dd477e, user_id=47fe7c730e1743e1be9cd3cb53e891f0, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:41.135017 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6684173-3662-41a2-9146-ff5b45e49d8c admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:41.168888 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 847/1701] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:53:40 2022] PUT /identity/v3/projects/7c512e1de2de499688d1126b14dd477e/users/47fe7c730e1743e1be9cd3cb53e891f0/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:41.170326 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6684173-3662-41a2-9146-ff5b45e49d8c admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:41.175525 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-d6684173-3662-41a2-9146-ff5b45e49d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:41.285819 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6684173-3662-41a2-9146-ff5b45e49d8c admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:41.307986 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34669223-c117-4d38-8e0d-77b60f96c589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:41.309563 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34669223-c117-4d38-8e0d-77b60f96c589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:41.311395 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34669223-c117-4d38-8e0d-77b60f96c589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:41.311834 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34669223-c117-4d38-8e0d-77b60f96c589 admin admin] PATH_INFO: `/v3/users/074b9b5e7e0848dcb9b743649fe44291` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:41.316932 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34669223-c117-4d38-8e0d-77b60f96c589 admin admin] RBAC: Authorizing `identity:delete_user(user_id=074b9b5e7e0848dcb9b743649fe44291)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:41.323687 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34669223-c117-4d38-8e0d-77b60f96c589 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:41.333395 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f920195-f00b-4727-8cda-8f1edfce1c0f None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:41.413260 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:41.443350 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d7f53-2cab-4321-b8a7-697640b085a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:41.446491 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d7f53-2cab-4321-b8a7-697640b085a5 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:41.446929 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d7f53-2cab-4321-b8a7-697640b085a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:41.448913 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d7f53-2cab-4321-b8a7-697640b085a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:41.455591 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-405d7f53-2cab-4321-b8a7-697640b085a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:41.485561 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d7f53-2cab-4321-b8a7-697640b085a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:41.489867 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d7f53-2cab-4321-b8a7-697640b085a5 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:41.524334 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 855/1702] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:53:41.527701 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d66801-f60d-4c75-a557-593b0a7d57c7 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:41.529072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-34669223-c117-4d38-8e0d-77b60f96c589 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '074b9b5e7e0848dcb9b743649fe44291'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:41.529802 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d66801-f60d-4c75-a557-593b0a7d57c7 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:41.531038 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d66801-f60d-4c75-a557-593b0a7d57c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:41.564578 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-34669223-c117-4d38-8e0d-77b60f96c589 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '074b9b5e7e0848dcb9b743649fe44291'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:41.581248 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-c0d66801-f60d-4c75-a557-593b0a7d57c7 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:41.582397 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c0d66801-f60d-4c75-a557-593b0a7d57c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:41.590309 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-34669223-c117-4d38-8e0d-77b60f96c589 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '074b9b5e7e0848dcb9b743649fe44291'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:41.591115 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-34669223-c117-4d38-8e0d-77b60f96c589 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '074b9b5e7e0848dcb9b743649fe44291'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:41.635350 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 856/1703] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:41.636968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e7ee6-3fa3-41f8-b11c-f4c1e2d3ceff None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:41.637146 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e7ee6-3fa3-41f8-b11c-f4c1e2d3ceff None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:41.637380 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e7ee6-3fa3-41f8-b11c-f4c1e2d3ceff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:41.647385 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-34669223-c117-4d38-8e0d-77b60f96c589 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '074b9b5e7e0848dcb9b743649fe44291'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:41.664871 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:41.672762 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 848/1704] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:53:41 2022] DELETE /identity/v3/users/074b9b5e7e0848dcb9b743649fe44291 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:41.677347 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34669223-c117-4d38-8e0d-77b60f96c589 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:41.683170 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-34669223-c117-4d38-8e0d-77b60f96c589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:41.714987 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-af0e7ee6-3fa3-41f8-b11c-f4c1e2d3ceff None None] MFA Rules not processed for user `47fe7c730e1743e1be9cd3cb53e891f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:41.716704 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-af0e7ee6-3fa3-41f8-b11c-f4c1e2d3ceff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:41.879730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34669223-c117-4d38-8e0d-77b60f96c589 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:41.895786 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcdb4f3-1d8e-42d0-9c27-97f96f4ced3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:41.896831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdb4f3-1d8e-42d0-9c27-97f96f4ced3a admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:41.896936 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdb4f3-1d8e-42d0-9c27-97f96f4ced3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:41.897425 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdb4f3-1d8e-42d0-9c27-97f96f4ced3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:41.898997 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcdb4f3-1d8e-42d0-9c27-97f96f4ced3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:53:41.898997 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcdb4f3-1d8e-42d0-9c27-97f96f4ced3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:41.905672 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcdb4f3-1d8e-42d0-9c27-97f96f4ced3a admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:41.914349 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 857/1705] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:41.923690 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e7ee6-3fa3-41f8-b11c-f4c1e2d3ceff None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:41.928690 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-af0e7ee6-3fa3-41f8-b11c-f4c1e2d3ceff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:41.976650 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 849/1706] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:53:41.989983 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcdb4f3-1d8e-42d0-9c27-97f96f4ced3a admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:42.050651 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcdb4f3-1d8e-42d0-9c27-97f96f4ced3a admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:42.094732 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e445a4-3f10-4e75-b098-5fb8c9c83a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:42.097121 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e445a4-3f10-4e75-b098-5fb8c9c83a04 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:42.097268 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e445a4-3f10-4e75-b098-5fb8c9c83a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:42.099078 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e445a4-3f10-4e75-b098-5fb8c9c83a04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:42.099894 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e445a4-3f10-4e75-b098-5fb8c9c83a04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:42.108667 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e445a4-3f10-4e75-b098-5fb8c9c83a04 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:42.155869 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e7ee6-3fa3-41f8-b11c-f4c1e2d3ceff None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:42.168141 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8615c-0998-4ad1-bc5b-759b4002b05e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:42.169158 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8615c-0998-4ad1-bc5b-759b4002b05e service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:42.169597 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8615c-0998-4ad1-bc5b-759b4002b05e service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:42.170121 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8615c-0998-4ad1-bc5b-759b4002b05e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:42.180792 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-2ba8615c-0998-4ad1-bc5b-759b4002b05e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:42.236349 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 850/1707] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:53:41 2022] POST /identity/v3/projects => generated 375 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:53:42.240649 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e445a4-3f10-4e75-b098-5fb8c9c83a04 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:42.324446 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8615c-0998-4ad1-bc5b-759b4002b05e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:42.325955 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8615c-0998-4ad1-bc5b-759b4002b05e service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:42.349625 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 858/1708] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:53:42.459078 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e445a4-3f10-4e75-b098-5fb8c9c83a04 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:42.478208 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759bcd71-580e-4619-ba16-633e93c8e3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:42.479998 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bcd71-580e-4619-ba16-633e93c8e3f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:42.480801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bcd71-580e-4619-ba16-633e93c8e3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:42.481245 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bcd71-580e-4619-ba16-633e93c8e3f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:42.482947 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759bcd71-580e-4619-ba16-633e93c8e3f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:42.487974 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759bcd71-580e-4619-ba16-633e93c8e3f8 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:42.577436 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 851/1709] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:53:42 2022] POST /identity/v3/users => generated 288 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:53:42.578917 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8615c-0998-4ad1-bc5b-759b4002b05e service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:42.593643 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8615c-0998-4ad1-bc5b-759b4002b05e service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:42.607271 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01943429-1b88-4d9c-aa99-05b609337cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:42.609090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01943429-1b88-4d9c-aa99-05b609337cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:42.610817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01943429-1b88-4d9c-aa99-05b609337cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:42.611906 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01943429-1b88-4d9c-aa99-05b609337cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:42.612837 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01943429-1b88-4d9c-aa99-05b609337cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:42.623923 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01943429-1b88-4d9c-aa99-05b609337cc1 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:42.653057 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759bcd71-580e-4619-ba16-633e93c8e3f8 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:42.663733 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 859/1710] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:42.668689 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759bcd71-580e-4619-ba16-633e93c8e3f8 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:42.684533 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ead17-1b52-45f1-9598-8ca800a7d312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:42.685253 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ead17-1b52-45f1-9598-8ca800a7d312 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:42.685543 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ead17-1b52-45f1-9598-8ca800a7d312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:42.685822 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ead17-1b52-45f1-9598-8ca800a7d312 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:42.686581 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ead17-1b52-45f1-9598-8ca800a7d312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:42.688520 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ead17-1b52-45f1-9598-8ca800a7d312 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:42.721671 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 852/1711] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:42.727210 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01943429-1b88-4d9c-aa99-05b609337cc1 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:42.739291 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:42.761090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01943429-1b88-4d9c-aa99-05b609337cc1 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:42.777319 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668fc1d-7018-4fdc-b897-90ee8397b1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:42.779840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668fc1d-7018-4fdc-b897-90ee8397b1cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:42.781142 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668fc1d-7018-4fdc-b897-90ee8397b1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:42.783223 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668fc1d-7018-4fdc-b897-90ee8397b1cd admin admin] PATH_INFO: `/v3/projects/11be63017510446d89eaa2aa84cc43cf/users/3a2c072af0ab475daf161aa238a6226a/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:42.825036 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668fc1d-7018-4fdc-b897-90ee8397b1cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=11be63017510446d89eaa2aa84cc43cf, user_id=3a2c072af0ab475daf161aa238a6226a, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:42.830008 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668fc1d-7018-4fdc-b897-90ee8397b1cd admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:42.867341 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ec387-c999-48d1-9b49-d1288dd8a627 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:42.871342 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ec387-c999-48d1-9b49-d1288dd8a627 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:42.871810 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ec387-c999-48d1-9b49-d1288dd8a627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:42.882077 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 860/1712] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:53:42 2022] PUT /identity/v3/projects/11be63017510446d89eaa2aa84cc43cf/users/3a2c072af0ab475daf161aa238a6226a/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:53:42.966924 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-e66ec387-c999-48d1-9b49-d1288dd8a627 None None] MFA Rules not processed for user `3a2c072af0ab475daf161aa238a6226a`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:42.971842 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-e66ec387-c999-48d1-9b49-d1288dd8a627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:43.207685 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:43.382687 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 853/1713] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 517 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:43.916141 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668fc1d-7018-4fdc-b897-90ee8397b1cd admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:43.920258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-3668fc1d-7018-4fdc-b897-90ee8397b1cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:44.212427 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668fc1d-7018-4fdc-b897-90ee8397b1cd admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:44.240584 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca55828-96e3-4e0a-9db9-b81e4d9b5672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:44.241914 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca55828-96e3-4e0a-9db9-b81e4d9b5672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:44.242241 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca55828-96e3-4e0a-9db9-b81e4d9b5672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:44.242850 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca55828-96e3-4e0a-9db9-b81e4d9b5672 admin admin] PATH_INFO: `/v3/projects/45b8ab1a9f7e474084df1ca9ba8de009` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:44.246143 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca55828-96e3-4e0a-9db9-b81e4d9b5672 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45b8ab1a9f7e474084df1ca9ba8de009)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:44.253401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca55828-96e3-4e0a-9db9-b81e4d9b5672 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:44.392676 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-dca55828-96e3-4e0a-9db9-b81e4d9b5672 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45b8ab1a9f7e474084df1ca9ba8de009', 'request_id': 'req-dca55828-96e3-4e0a-9db9-b81e4d9b5672'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:44.408350 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-dca55828-96e3-4e0a-9db9-b81e4d9b5672 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45b8ab1a9f7e474084df1ca9ba8de009', 'request_id': 'req-dca55828-96e3-4e0a-9db9-b81e4d9b5672'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:44.418573 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-dca55828-96e3-4e0a-9db9-b81e4d9b5672 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45b8ab1a9f7e474084df1ca9ba8de009', 'request_id': 'req-dca55828-96e3-4e0a-9db9-b81e4d9b5672'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:44.445884 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-dca55828-96e3-4e0a-9db9-b81e4d9b5672 admin admin] The token cache is being invalidate because project 45b8ab1a9f7e474084df1ca9ba8de009 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:53:44.446180 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-dca55828-96e3-4e0a-9db9-b81e4d9b5672 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:44.448500 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-dca55828-96e3-4e0a-9db9-b81e4d9b5672 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:44.454591 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 861/1714] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:53:43 2022] DELETE /identity/v3/projects/45b8ab1a9f7e474084df1ca9ba8de009 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:44.459363 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99c564-10b8-4990-a95e-2724cdb1e6e9 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:44.460395 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99c564-10b8-4990-a95e-2724cdb1e6e9 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:44.460814 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99c564-10b8-4990-a95e-2724cdb1e6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:44.481810 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-ad99c564-10b8-4990-a95e-2724cdb1e6e9 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:44.483310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-ad99c564-10b8-4990-a95e-2724cdb1e6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:44.637276 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 854/1715] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:44.639091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d740d-b4f7-491e-8244-e121d632a178 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:44.639424 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d740d-b4f7-491e-8244-e121d632a178 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:44.639709 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d740d-b4f7-491e-8244-e121d632a178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:44.692844 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-b88d740d-b4f7-491e-8244-e121d632a178 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:44.694336 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b88d740d-b4f7-491e-8244-e121d632a178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:44.723123 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 862/1716] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:44.725797 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99c564-10b8-4990-a95e-2724cdb1e6e9 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:44.749306 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d740d-b4f7-491e-8244-e121d632a178 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:44.751272 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99c564-10b8-4990-a95e-2724cdb1e6e9 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:44.751992 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b88d740d-b4f7-491e-8244-e121d632a178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:44.781583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67175191-6166-42ef-be75-32bef40ccb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:44.782310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67175191-6166-42ef-be75-32bef40ccb75 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:44.782601 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67175191-6166-42ef-be75-32bef40ccb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:44.782883 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67175191-6166-42ef-be75-32bef40ccb75 admin admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:44.783739 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67175191-6166-42ef-be75-32bef40ccb75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:53:44.783962 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67175191-6166-42ef-be75-32bef40ccb75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:44.809490 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67175191-6166-42ef-be75-32bef40ccb75 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:44.892434 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 855/1717] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:53:44.896934 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67175191-6166-42ef-be75-32bef40ccb75 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:44.936982 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67175191-6166-42ef-be75-32bef40ccb75 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:44.951930 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993a0f5-bd03-4e2e-ad74-9b30da8e6105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:44.954571 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993a0f5-bd03-4e2e-ad74-9b30da8e6105 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:44.956460 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993a0f5-bd03-4e2e-ad74-9b30da8e6105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:44.957550 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993a0f5-bd03-4e2e-ad74-9b30da8e6105 admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:44.959089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993a0f5-bd03-4e2e-ad74-9b30da8e6105 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:44.963648 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993a0f5-bd03-4e2e-ad74-9b30da8e6105 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:44.979253 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:45.008082 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d740d-b4f7-491e-8244-e121d632a178 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:45.014256 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 856/1718] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:53:44 2022] POST /identity/v3/projects => generated 363 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:53:45.019565 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993a0f5-bd03-4e2e-ad74-9b30da8e6105 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:45.204019 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993a0f5-bd03-4e2e-ad74-9b30da8e6105 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:45.219847 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d341da7-1693-45f7-94c9-1fb746d4aa3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:45.221503 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d341da7-1693-45f7-94c9-1fb746d4aa3c admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:45.221618 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb83c4d-adec-4a0b-b650-f87da61ea3e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:45.221983 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d341da7-1693-45f7-94c9-1fb746d4aa3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:45.222285 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d341da7-1693-45f7-94c9-1fb746d4aa3c admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:45.224219 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb83c4d-adec-4a0b-b650-f87da61ea3e6 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:45.226528 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d341da7-1693-45f7-94c9-1fb746d4aa3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:45.226824 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb83c4d-adec-4a0b-b650-f87da61ea3e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:45.228262 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb83c4d-adec-4a0b-b650-f87da61ea3e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:45.233125 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9fb83c4d-adec-4a0b-b650-f87da61ea3e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:45.236591 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d341da7-1693-45f7-94c9-1fb746d4aa3c admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:45.297232 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 857/1719] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:53:45 2022] POST /identity/v3/users => generated 282 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:53:45.303877 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d341da7-1693-45f7-94c9-1fb746d4aa3c admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:45.320746 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d341da7-1693-45f7-94c9-1fb746d4aa3c admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:45.341225 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe1202-7cc9-472f-99b9-e58a91d46c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:45.341996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe1202-7cc9-472f-99b9-e58a91d46c7c admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:45.342286 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe1202-7cc9-472f-99b9-e58a91d46c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:45.342569 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe1202-7cc9-472f-99b9-e58a91d46c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:45.343356 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe1202-7cc9-472f-99b9-e58a91d46c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:45.345064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe1202-7cc9-472f-99b9-e58a91d46c7c admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:45.395067 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 858/1720] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:45.401857 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe1202-7cc9-472f-99b9-e58a91d46c7c admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:45.449312 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe1202-7cc9-472f-99b9-e58a91d46c7c admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:45.467922 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84a751-c690-4929-9e37-10dfcc1ffd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:45.469571 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84a751-c690-4929-9e37-10dfcc1ffd25 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:45.470058 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84a751-c690-4929-9e37-10dfcc1ffd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:45.470504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84a751-c690-4929-9e37-10dfcc1ffd25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:45.471445 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84a751-c690-4929-9e37-10dfcc1ffd25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:45.475103 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84a751-c690-4929-9e37-10dfcc1ffd25 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:45.528096 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 859/1721] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:45.529105 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84a751-c690-4929-9e37-10dfcc1ffd25 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:45.537380 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb83c4d-adec-4a0b-b650-f87da61ea3e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:45.548301 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb83c4d-adec-4a0b-b650-f87da61ea3e6 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:45.567970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84a751-c690-4929-9e37-10dfcc1ffd25 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:45.581415 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf6ae7-c8c6-4fcd-b628-0510131d8c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:45.582610 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf6ae7-c8c6-4fcd-b628-0510131d8c51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:45.583066 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf6ae7-c8c6-4fcd-b628-0510131d8c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:45.583521 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf6ae7-c8c6-4fcd-b628-0510131d8c51 admin admin] PATH_INFO: `/v3/projects/a86df27466064e1dbc3651f404510640/users/f3ba67bfc0b2476287a9b4492431d5a4/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:45.598564 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 863/1722] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 851 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:53:45.604835 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:45.617196 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf6ae7-c8c6-4fcd-b628-0510131d8c51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a86df27466064e1dbc3651f404510640, user_id=f3ba67bfc0b2476287a9b4492431d5a4, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:45.628084 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf6ae7-c8c6-4fcd-b628-0510131d8c51 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:45.652824 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 860/1723] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:53:45 2022] PUT /identity/v3/projects/a86df27466064e1dbc3651f404510640/users/f3ba67bfc0b2476287a9b4492431d5a4/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:45.664257 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf5dd8-8bb4-4418-9667-ad8694a11796 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:45.664556 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf5dd8-8bb4-4418-9667-ad8694a11796 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:45.664919 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf5dd8-8bb4-4418-9667-ad8694a11796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:45.725194 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-24bf5dd8-8bb4-4418-9667-ad8694a11796 None None] MFA Rules not processed for user `f3ba67bfc0b2476287a9b4492431d5a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:45.726478 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-24bf5dd8-8bb4-4418-9667-ad8694a11796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:45.856028 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 864/1724] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:45 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:45.861783 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf6ae7-c8c6-4fcd-b628-0510131d8c51 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:45.971473 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf6ae7-c8c6-4fcd-b628-0510131d8c51 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:45.977126 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fdbbf-206e-4f49-833c-c84309cbd081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:45.977796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fdbbf-206e-4f49-833c-c84309cbd081 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:45.978084 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fdbbf-206e-4f49-833c-c84309cbd081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:45.978362 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fdbbf-206e-4f49-833c-c84309cbd081 admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:45.979592 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93fdbbf-206e-4f49-833c-c84309cbd081 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:45.981213 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93fdbbf-206e-4f49-833c-c84309cbd081 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:46.012094 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 861/1725] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:53:45 2022] POST /identity/v3/projects => generated 365 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:53:46.016272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf5dd8-8bb4-4418-9667-ad8694a11796 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:46.028045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf5dd8-8bb4-4418-9667-ad8694a11796 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:46.058544 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:46.096610 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d1774-5a17-4c5d-91d0-392ab85b7e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:46.097471 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d1774-5a17-4c5d-91d0-392ab85b7e2f admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:46.097755 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d1774-5a17-4c5d-91d0-392ab85b7e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:46.098037 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d1774-5a17-4c5d-91d0-392ab85b7e2f admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:46.098763 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d1774-5a17-4c5d-91d0-392ab85b7e2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:46.101736 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d1774-5a17-4c5d-91d0-392ab85b7e2f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:46.127886 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 865/1726] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:53:46 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:53:46.132046 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fdbbf-206e-4f49-833c-c84309cbd081 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:46.145772 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fdbbf-206e-4f49-833c-c84309cbd081 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:46.152239 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df4019-1656-45da-b595-64b95651f526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:46.153210 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df4019-1656-45da-b595-64b95651f526 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:46.153561 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df4019-1656-45da-b595-64b95651f526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:46.153905 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df4019-1656-45da-b595-64b95651f526 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:46.154854 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df4019-1656-45da-b595-64b95651f526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:46.156814 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df4019-1656-45da-b595-64b95651f526 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:46.173529 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 862/1727] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:46.178515 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d1774-5a17-4c5d-91d0-392ab85b7e2f admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:46.193293 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d1774-5a17-4c5d-91d0-392ab85b7e2f admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:46.198124 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75ffd5-cb43-4a1a-a60a-d438f435ad3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:46.199076 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75ffd5-cb43-4a1a-a60a-d438f435ad3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:46.199575 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75ffd5-cb43-4a1a-a60a-d438f435ad3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:46.199907 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75ffd5-cb43-4a1a-a60a-d438f435ad3e admin admin] PATH_INFO: `/v3/projects/8537499645764e2f82dcbdf676218326/users/47f7052991994a2fb9b6133373739aad/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:46.222308 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75ffd5-cb43-4a1a-a60a-d438f435ad3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8537499645764e2f82dcbdf676218326, user_id=47f7052991994a2fb9b6133373739aad, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:46.232352 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75ffd5-cb43-4a1a-a60a-d438f435ad3e admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:46.256814 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 866/1728] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:53:46 2022] PUT /identity/v3/projects/8537499645764e2f82dcbdf676218326/users/47f7052991994a2fb9b6133373739aad/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:46.262558 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df4019-1656-45da-b595-64b95651f526 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:46.280602 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df4019-1656-45da-b595-64b95651f526 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:46.374303 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda72f5-6719-4c66-a022-bbf81cd1973a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:46.375013 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda72f5-6719-4c66-a022-bbf81cd1973a admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:46.375429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda72f5-6719-4c66-a022-bbf81cd1973a admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:46.381658 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda72f5-6719-4c66-a022-bbf81cd1973a admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:46.383735 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda72f5-6719-4c66-a022-bbf81cd1973a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:46.387633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda72f5-6719-4c66-a022-bbf81cd1973a admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:46.413320 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75ffd5-cb43-4a1a-a60a-d438f435ad3e admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:46.415354 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 863/1729] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:46.428064 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75ffd5-cb43-4a1a-a60a-d438f435ad3e admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:46.439587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1c027-b95b-4bcc-b1ab-f74ce97edff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:46.440799 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1c027-b95b-4bcc-b1ab-f74ce97edff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:46.441340 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1c027-b95b-4bcc-b1ab-f74ce97edff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:46.442335 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1c027-b95b-4bcc-b1ab-f74ce97edff6 admin admin] PATH_INFO: `/v3/projects/8537499645764e2f82dcbdf676218326/users/47f7052991994a2fb9b6133373739aad/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:46.445845 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1c027-b95b-4bcc-b1ab-f74ce97edff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8537499645764e2f82dcbdf676218326, user_id=47f7052991994a2fb9b6133373739aad, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:46.449489 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1c027-b95b-4bcc-b1ab-f74ce97edff6 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:46.468811 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 867/1730] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:53:46 2022] PUT /identity/v3/projects/8537499645764e2f82dcbdf676218326/users/47f7052991994a2fb9b6133373739aad/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:46.480198 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909bcd3-cb46-4dca-afc3-d6cc2567e550 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:46.480743 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909bcd3-cb46-4dca-afc3-d6cc2567e550 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:46.480743 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909bcd3-cb46-4dca-afc3-d6cc2567e550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:46.513354 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-c909bcd3-cb46-4dca-afc3-d6cc2567e550 None None] MFA Rules not processed for user `47f7052991994a2fb9b6133373739aad`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:46.514801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-c909bcd3-cb46-4dca-afc3-d6cc2567e550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:46.585910 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266c29f-30f5-492a-b2bb-de1c8249bc34 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:46.586513 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266c29f-30f5-492a-b2bb-de1c8249bc34 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:46.586934 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266c29f-30f5-492a-b2bb-de1c8249bc34 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:46.587948 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:46.590905 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 868/1731] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jun 24 10:53:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:53:46.623222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 864/1732] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:46 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:46.631965 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266c29f-30f5-492a-b2bb-de1c8249bc34 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:46.634744 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-0266c29f-30f5-492a-b2bb-de1c8249bc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:46.678250 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a56d7c-60a7-44cf-8987-ee69470bc684 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:46.678763 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a56d7c-60a7-44cf-8987-ee69470bc684 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:46.679343 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a56d7c-60a7-44cf-8987-ee69470bc684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:46.710056 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-96a56d7c-60a7-44cf-8987-ee69470bc684 None None] MFA Rules not processed for user `e8034bad51144002a7386c975e412992`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:46.712285 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266c29f-30f5-492a-b2bb-de1c8249bc34 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:46.715344 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-96a56d7c-60a7-44cf-8987-ee69470bc684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:46.716902 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a55bc4-f89c-447a-9532-b15f8be892f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:46.717779 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a55bc4-f89c-447a-9532-b15f8be892f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:46.718132 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a55bc4-f89c-447a-9532-b15f8be892f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:46.718514 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a55bc4-f89c-447a-9532-b15f8be892f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:46.737747 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a55bc4-f89c-447a-9532-b15f8be892f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:46.739262 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a55bc4-f89c-447a-9532-b15f8be892f5 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:46.762186 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 869/1733] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:46 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:53:46.884346 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 865/1734] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jun 24 10:53:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:53:47.027923 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a55bc4-f89c-447a-9532-b15f8be892f5 service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:47.047876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a55bc4-f89c-447a-9532-b15f8be892f5 service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:47.070239 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01c369-8901-421e-87d0-3676d702e6f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:47.071142 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01c369-8901-421e-87d0-3676d702e6f2 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:47.072618 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01c369-8901-421e-87d0-3676d702e6f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:47.072618 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01c369-8901-421e-87d0-3676d702e6f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:47.103255 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01c369-8901-421e-87d0-3676d702e6f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:47.104914 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01c369-8901-421e-87d0-3676d702e6f2 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:47.140316 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 870/1735] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:53:47.437019 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a56d7c-60a7-44cf-8987-ee69470bc684 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:47.437617 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-96a56d7c-60a7-44cf-8987-ee69470bc684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:47.662168 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a56d7c-60a7-44cf-8987-ee69470bc684 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:47.668871 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae0dcb-b9e2-4a79-a505-3391170dafed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:47.670088 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae0dcb-b9e2-4a79-a505-3391170dafed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:47.671111 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae0dcb-b9e2-4a79-a505-3391170dafed admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:47.671568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae0dcb-b9e2-4a79-a505-3391170dafed admin admin] PATH_INFO: `/v3/users/3a2c072af0ab475daf161aa238a6226a` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:47.673198 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae0dcb-b9e2-4a79-a505-3391170dafed admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a2c072af0ab475daf161aa238a6226a)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:47.676746 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae0dcb-b9e2-4a79-a505-3391170dafed admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:47.691541 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01c369-8901-421e-87d0-3676d702e6f2 service nova] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:47.706556 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01c369-8901-421e-87d0-3676d702e6f2 service nova] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:47.720696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d393a-9829-436a-a042-864b7e9c6156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:47.722020 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d393a-9829-436a-a042-864b7e9c6156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:47.722475 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d393a-9829-436a-a042-864b7e9c6156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:47.722937 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d393a-9829-436a-a042-864b7e9c6156 admin admin] PATH_INFO: `/v3/users/f3ba67bfc0b2476287a9b4492431d5a4` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:47.724869 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d393a-9829-436a-a042-864b7e9c6156 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3ba67bfc0b2476287a9b4492431d5a4)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:47.727192 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d393a-9829-436a-a042-864b7e9c6156 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:47.741568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-95ae0dcb-b9e2-4a79-a505-3391170dafed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a2c072af0ab475daf161aa238a6226a'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:47.752242 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-95ae0dcb-b9e2-4a79-a505-3391170dafed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a2c072af0ab475daf161aa238a6226a'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:47.762297 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-95ae0dcb-b9e2-4a79-a505-3391170dafed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a2c072af0ab475daf161aa238a6226a'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:47.763264 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-95ae0dcb-b9e2-4a79-a505-3391170dafed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a2c072af0ab475daf161aa238a6226a'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:47.777406 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:47.779605 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-95ae0dcb-b9e2-4a79-a505-3391170dafed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a2c072af0ab475daf161aa238a6226a'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:47.790192 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 866/1736] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:53:47 2022] DELETE /identity/v3/users/3a2c072af0ab475daf161aa238a6226a => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:47.793429 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-011d393a-9829-436a-a042-864b7e9c6156 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3ba67bfc0b2476287a9b4492431d5a4'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:47.795715 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fb6bf-25b6-4273-972d-b857705adce3 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:47.796216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fb6bf-25b6-4273-972d-b857705adce3 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:47.796570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fb6bf-25b6-4273-972d-b857705adce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:47.799643 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-011d393a-9829-436a-a042-864b7e9c6156 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3ba67bfc0b2476287a9b4492431d5a4'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:47.809368 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-011d393a-9829-436a-a042-864b7e9c6156 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3ba67bfc0b2476287a9b4492431d5a4'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:47.810144 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-011d393a-9829-436a-a042-864b7e9c6156 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3ba67bfc0b2476287a9b4492431d5a4'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:47.812927 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:47.816389 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-5a9fb6bf-25b6-4273-972d-b857705adce3 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:47.817739 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-5a9fb6bf-25b6-4273-972d-b857705adce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:47.830208 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-011d393a-9829-436a-a042-864b7e9c6156 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3ba67bfc0b2476287a9b4492431d5a4'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:47.848337 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 871/1737] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:53:47 2022] DELETE /identity/v3/users/f3ba67bfc0b2476287a9b4492431d5a4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:53:47.852710 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a0fa9-4872-4461-9bf4-07a1948ac590 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:47.855594 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a0fa9-4872-4461-9bf4-07a1948ac590 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:47.855963 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a0fa9-4872-4461-9bf4-07a1948ac590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:47.893138 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-e92a0fa9-4872-4461-9bf4-07a1948ac590 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:47.894500 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e92a0fa9-4872-4461-9bf4-07a1948ac590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:47.907131 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 867/1738] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:47.925522 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9fb6bf-25b6-4273-972d-b857705adce3 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:47.927189 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-5a9fb6bf-25b6-4273-972d-b857705adce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:48.036849 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9fb6bf-25b6-4273-972d-b857705adce3 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:48.064432 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 872/1739] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:53:48.076064 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a0fa9-4872-4461-9bf4-07a1948ac590 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:48.078910 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e92a0fa9-4872-4461-9bf4-07a1948ac590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:48.136407 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1c5ed-04e2-48e2-b0b6-b39880cf9915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:48.137365 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1c5ed-04e2-48e2-b0b6-b39880cf9915 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:48.137755 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1c5ed-04e2-48e2-b0b6-b39880cf9915 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:48.138336 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1c5ed-04e2-48e2-b0b6-b39880cf9915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:48.153774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1c5ed-04e2-48e2-b0b6-b39880cf9915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:48.155494 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1c5ed-04e2-48e2-b0b6-b39880cf9915 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:48.167707 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a0fa9-4872-4461-9bf4-07a1948ac590 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:48.170142 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 868/1740] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:53:48.172483 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fca55-caad-4e61-967a-5b24aeb40704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:48.173142 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fca55-caad-4e61-967a-5b24aeb40704 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:48.173668 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fca55-caad-4e61-967a-5b24aeb40704 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:48.174017 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fca55-caad-4e61-967a-5b24aeb40704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:48.186088 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7fca55-caad-4e61-967a-5b24aeb40704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:48.188418 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7fca55-caad-4e61-967a-5b24aeb40704 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:48.201397 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 873/1741] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:53:48.505425 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1c5ed-04e2-48e2-b0b6-b39880cf9915 service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:48.507367 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-dce1c5ed-04e2-48e2-b0b6-b39880cf9915 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:48.529907 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1c5ed-04e2-48e2-b0b6-b39880cf9915 service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:48.536811 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fbbed-b8b0-43f0-8e73-b82aae3ab51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:48.538034 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fbbed-b8b0-43f0-8e73-b82aae3ab51c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:48.538492 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fbbed-b8b0-43f0-8e73-b82aae3ab51c admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:48.550651 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fbbed-b8b0-43f0-8e73-b82aae3ab51c admin admin] PATH_INFO: `/v3/projects/11be63017510446d89eaa2aa84cc43cf` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:48.553595 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fbbed-b8b0-43f0-8e73-b82aae3ab51c admin admin] RBAC: Authorizing `identity:delete_project(project_id=11be63017510446d89eaa2aa84cc43cf)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:48.556863 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fbbed-b8b0-43f0-8e73-b82aae3ab51c admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:48.650092 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-9b2fbbed-b8b0-43f0-8e73-b82aae3ab51c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11be63017510446d89eaa2aa84cc43cf', 'request_id': 'req-9b2fbbed-b8b0-43f0-8e73-b82aae3ab51c'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:48.658945 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:48.669948 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-9b2fbbed-b8b0-43f0-8e73-b82aae3ab51c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11be63017510446d89eaa2aa84cc43cf', 'request_id': 'req-9b2fbbed-b8b0-43f0-8e73-b82aae3ab51c'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:48.671092 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fca55-caad-4e61-967a-5b24aeb40704 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:48.672645 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-be7fca55-caad-4e61-967a-5b24aeb40704 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:48.678902 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-9b2fbbed-b8b0-43f0-8e73-b82aae3ab51c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11be63017510446d89eaa2aa84cc43cf', 'request_id': 'req-9b2fbbed-b8b0-43f0-8e73-b82aae3ab51c'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:48.692627 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-9b2fbbed-b8b0-43f0-8e73-b82aae3ab51c admin admin] The token cache is being invalidate because project 11be63017510446d89eaa2aa84cc43cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:53:48.693174 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-9b2fbbed-b8b0-43f0-8e73-b82aae3ab51c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:48.694042 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-9b2fbbed-b8b0-43f0-8e73-b82aae3ab51c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:48.695815 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fca55-caad-4e61-967a-5b24aeb40704 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:48.696178 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 869/1742] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:53:48 2022] DELETE /identity/v3/projects/11be63017510446d89eaa2aa84cc43cf => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:48.701858 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf10d12-d33f-443a-80d6-e6a9004339b4 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:48.702582 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf10d12-d33f-443a-80d6-e6a9004339b4 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:48.703211 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf10d12-d33f-443a-80d6-e6a9004339b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:48.723437 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-1cf10d12-d33f-443a-80d6-e6a9004339b4 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:48.724657 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-1cf10d12-d33f-443a-80d6-e6a9004339b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:48.785793 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644d989-a0a7-4cd7-a5bd-ab063c383933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:48.786649 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644d989-a0a7-4cd7-a5bd-ab063c383933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:48.787102 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644d989-a0a7-4cd7-a5bd-ab063c383933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:48.787653 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644d989-a0a7-4cd7-a5bd-ab063c383933 admin admin] PATH_INFO: `/v3/projects/a86df27466064e1dbc3651f404510640` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:48.789184 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644d989-a0a7-4cd7-a5bd-ab063c383933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a86df27466064e1dbc3651f404510640)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:48.791875 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644d989-a0a7-4cd7-a5bd-ab063c383933 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:48.800522 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 870/1743] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:48.808707 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02497298-8798-4aef-a528-d47834595dce None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:48.809004 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02497298-8798-4aef-a528-d47834595dce None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:48.809285 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02497298-8798-4aef-a528-d47834595dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:48.833951 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-02497298-8798-4aef-a528-d47834595dce None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:48.835898 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-02497298-8798-4aef-a528-d47834595dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:48.836848 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:48.845623 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 871/1744] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:48.850863 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02497298-8798-4aef-a528-d47834595dce None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:48.861456 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e644d989-a0a7-4cd7-a5bd-ab063c383933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a86df27466064e1dbc3651f404510640', 'request_id': 'req-e644d989-a0a7-4cd7-a5bd-ab063c383933'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:48.861658 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02497298-8798-4aef-a528-d47834595dce None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:48.876264 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e644d989-a0a7-4cd7-a5bd-ab063c383933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a86df27466064e1dbc3651f404510640', 'request_id': 'req-e644d989-a0a7-4cd7-a5bd-ab063c383933'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:48.892126 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e644d989-a0a7-4cd7-a5bd-ab063c383933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a86df27466064e1dbc3651f404510640', 'request_id': 'req-e644d989-a0a7-4cd7-a5bd-ab063c383933'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:48.919932 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e644d989-a0a7-4cd7-a5bd-ab063c383933 admin admin] The token cache is being invalidate because project a86df27466064e1dbc3651f404510640 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:53:48.920399 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e644d989-a0a7-4cd7-a5bd-ab063c383933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:48.921087 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e644d989-a0a7-4cd7-a5bd-ab063c383933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:48.923070 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 874/1745] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:53:48 2022] DELETE /identity/v3/projects/a86df27466064e1dbc3651f404510640 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:48.938378 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644d989-a0a7-4cd7-a5bd-ab063c383933 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:48.948750 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e644d989-a0a7-4cd7-a5bd-ab063c383933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:49.006673 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d75e4-d1c7-4716-aadf-a3f36dcc41ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:49.007864 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d75e4-d1c7-4716-aadf-a3f36dcc41ca admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:49.008304 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d75e4-d1c7-4716-aadf-a3f36dcc41ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:49.008596 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d75e4-d1c7-4716-aadf-a3f36dcc41ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:49.010115 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d75e4-d1c7-4716-aadf-a3f36dcc41ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:53:49.010430 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d75e4-d1c7-4716-aadf-a3f36dcc41ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:49.012245 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d75e4-d1c7-4716-aadf-a3f36dcc41ca admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:49.041778 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 872/1746] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:53:49.043037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d75e4-d1c7-4716-aadf-a3f36dcc41ca admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:49.048129 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644d989-a0a7-4cd7-a5bd-ab063c383933 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:49.049222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-1e8d75e4-d1c7-4716-aadf-a3f36dcc41ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:49.064535 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78945790-a63f-4e5a-814d-07c00313e515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:49.065530 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78945790-a63f-4e5a-814d-07c00313e515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:49.065886 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78945790-a63f-4e5a-814d-07c00313e515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:49.066162 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78945790-a63f-4e5a-814d-07c00313e515 admin admin] PATH_INFO: `/v3/users/47f7052991994a2fb9b6133373739aad` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:49.069425 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78945790-a63f-4e5a-814d-07c00313e515 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47f7052991994a2fb9b6133373739aad)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:49.073515 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78945790-a63f-4e5a-814d-07c00313e515 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:49.075922 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d75e4-d1c7-4716-aadf-a3f36dcc41ca admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:49.084894 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9473e-e2bc-48e1-94fd-715299585a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:49.085603 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9473e-e2bc-48e1-94fd-715299585a7e admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:49.086500 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9473e-e2bc-48e1-94fd-715299585a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:49.087685 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9473e-e2bc-48e1-94fd-715299585a7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:49.088445 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9473e-e2bc-48e1-94fd-715299585a7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:49.092149 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9473e-e2bc-48e1-94fd-715299585a7e admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:49.167196 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 873/1747] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:53:49 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:53:49.173622 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9473e-e2bc-48e1-94fd-715299585a7e admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:49.203028 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-78945790-a63f-4e5a-814d-07c00313e515 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47f7052991994a2fb9b6133373739aad'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:49.242487 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-78945790-a63f-4e5a-814d-07c00313e515 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47f7052991994a2fb9b6133373739aad'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:49.261788 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-78945790-a63f-4e5a-814d-07c00313e515 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47f7052991994a2fb9b6133373739aad'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:49.262871 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-78945790-a63f-4e5a-814d-07c00313e515 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47f7052991994a2fb9b6133373739aad'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:49.268081 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:49.291339 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-78945790-a63f-4e5a-814d-07c00313e515 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47f7052991994a2fb9b6133373739aad'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:49.295270 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9473e-e2bc-48e1-94fd-715299585a7e admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:49.302441 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f2643-99d2-481b-b571-33c9810141ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:49.302441 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f2643-99d2-481b-b571-33c9810141ab admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:49.302441 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f2643-99d2-481b-b571-33c9810141ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:49.302441 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f2643-99d2-481b-b571-33c9810141ab admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:49.304121 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 875/1748] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:53:48 2022] DELETE /identity/v3/users/47f7052991994a2fb9b6133373739aad => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:49.311379 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f2643-99d2-481b-b571-33c9810141ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:49.317410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f2643-99d2-481b-b571-33c9810141ab admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:49.345927 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 874/1749] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:53:49 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:53:49.347693 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78945790-a63f-4e5a-814d-07c00313e515 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:49.349144 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-78945790-a63f-4e5a-814d-07c00313e515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:49.406287 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:49.436186 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78945790-a63f-4e5a-814d-07c00313e515 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:49.444480 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c55bd8-c366-487a-b730-28994b42a20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:49.445485 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c55bd8-c366-487a-b730-28994b42a20d admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:49.445844 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c55bd8-c366-487a-b730-28994b42a20d admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:49.446192 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c55bd8-c366-487a-b730-28994b42a20d admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:49.447214 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c55bd8-c366-487a-b730-28994b42a20d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:49.449443 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c55bd8-c366-487a-b730-28994b42a20d admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:49.474336 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 876/1750] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:49.478166 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f2643-99d2-481b-b571-33c9810141ab admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:49.496483 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f2643-99d2-481b-b571-33c9810141ab admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:49.521240 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498cc7f-5d74-4ccd-b951-a80b3dc3272a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:49.521537 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498cc7f-5d74-4ccd-b951-a80b3dc3272a admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:49.521820 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498cc7f-5d74-4ccd-b951-a80b3dc3272a admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:49.522101 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498cc7f-5d74-4ccd-b951-a80b3dc3272a admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:49.522851 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498cc7f-5d74-4ccd-b951-a80b3dc3272a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:49.524586 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498cc7f-5d74-4ccd-b951-a80b3dc3272a admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:49.540396 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 875/1751] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:49.541845 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c55bd8-c366-487a-b730-28994b42a20d admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:49.565789 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c55bd8-c366-487a-b730-28994b42a20d admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:49.584224 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece467b-72a8-4b2d-8600-1e5b1cfd9561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:49.585323 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece467b-72a8-4b2d-8600-1e5b1cfd9561 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:49.585683 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece467b-72a8-4b2d-8600-1e5b1cfd9561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:49.585959 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece467b-72a8-4b2d-8600-1e5b1cfd9561 admin admin] PATH_INFO: `/v3/projects/f2e366311a9b4c469931aa09312e345c/users/561e6bafb3fa40938edfd914a3ee9423/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:49.642227 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece467b-72a8-4b2d-8600-1e5b1cfd9561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2e366311a9b4c469931aa09312e345c, user_id=561e6bafb3fa40938edfd914a3ee9423, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:49.647318 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece467b-72a8-4b2d-8600-1e5b1cfd9561 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:49.706029 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 877/1752] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:53:49 2022] PUT /identity/v3/projects/f2e366311a9b4c469931aa09312e345c/users/561e6bafb3fa40938edfd914a3ee9423/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:49.706370 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498cc7f-5d74-4ccd-b951-a80b3dc3272a admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:49.708248 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-8498cc7f-5d74-4ccd-b951-a80b3dc3272a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:49.714737 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fa33e-915d-4692-a679-fddde7c6013f None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:49.715025 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fa33e-915d-4692-a679-fddde7c6013f None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:49.715331 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fa33e-915d-4692-a679-fddde7c6013f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:49.733808 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498cc7f-5d74-4ccd-b951-a80b3dc3272a admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:49.807875 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-de1fa33e-915d-4692-a679-fddde7c6013f None None] MFA Rules not processed for user `561e6bafb3fa40938edfd914a3ee9423`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:49.809705 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-de1fa33e-915d-4692-a679-fddde7c6013f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:49.827797 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695d7a8-1260-40e6-96a5-bd75b3dbbb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:49.828924 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695d7a8-1260-40e6-96a5-bd75b3dbbb86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:49.829216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695d7a8-1260-40e6-96a5-bd75b3dbbb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:49.829494 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695d7a8-1260-40e6-96a5-bd75b3dbbb86 admin admin] PATH_INFO: `/v3/projects/8537499645764e2f82dcbdf676218326` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:49.830737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f695d7a8-1260-40e6-96a5-bd75b3dbbb86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8537499645764e2f82dcbdf676218326)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:49.832752 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f695d7a8-1260-40e6-96a5-bd75b3dbbb86 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:49.876361 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 878/1753] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:49.880901 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fa33e-915d-4692-a679-fddde7c6013f None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:49.881207 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-f695d7a8-1260-40e6-96a5-bd75b3dbbb86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8537499645764e2f82dcbdf676218326', 'request_id': 'req-f695d7a8-1260-40e6-96a5-bd75b3dbbb86'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:49.889490 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-f695d7a8-1260-40e6-96a5-bd75b3dbbb86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8537499645764e2f82dcbdf676218326', 'request_id': 'req-f695d7a8-1260-40e6-96a5-bd75b3dbbb86'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:49.891497 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fa33e-915d-4692-a679-fddde7c6013f None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:49.896254 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-f695d7a8-1260-40e6-96a5-bd75b3dbbb86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8537499645764e2f82dcbdf676218326', 'request_id': 'req-f695d7a8-1260-40e6-96a5-bd75b3dbbb86'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:49.907965 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-f695d7a8-1260-40e6-96a5-bd75b3dbbb86 admin admin] The token cache is being invalidate because project 8537499645764e2f82dcbdf676218326 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:53:49.908263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-f695d7a8-1260-40e6-96a5-bd75b3dbbb86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:49.908926 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-f695d7a8-1260-40e6-96a5-bd75b3dbbb86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:49.910535 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 876/1754] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:53:49 2022] DELETE /identity/v3/projects/8537499645764e2f82dcbdf676218326 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:49.915801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747b381-f12c-4d2e-a5a6-1cec478945b7 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:49.916095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747b381-f12c-4d2e-a5a6-1cec478945b7 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:49.916380 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747b381-f12c-4d2e-a5a6-1cec478945b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:49.935092 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-0747b381-f12c-4d2e-a5a6-1cec478945b7 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:49.936385 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-0747b381-f12c-4d2e-a5a6-1cec478945b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:49.947986 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86059b51-f3cb-442a-86d3-163bb5980244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:49.948662 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86059b51-f3cb-442a-86d3-163bb5980244 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:49.948943 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86059b51-f3cb-442a-86d3-163bb5980244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:49.949221 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86059b51-f3cb-442a-86d3-163bb5980244 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:49.949921 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86059b51-f3cb-442a-86d3-163bb5980244 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:49.951854 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86059b51-f3cb-442a-86d3-163bb5980244 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:49.981754 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 879/1755] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:53:49 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:53:49.982756 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86059b51-f3cb-442a-86d3-163bb5980244 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:49.984403 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-86059b51-f3cb-442a-86d3-163bb5980244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:49.987220 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:50.002694 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 877/1756] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:53:50.010408 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ec0fa-933a-42dc-85da-3cfdfc24fead None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:50.010696 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ec0fa-933a-42dc-85da-3cfdfc24fead None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:50.010972 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ec0fa-933a-42dc-85da-3cfdfc24fead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:50.011671 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:50.030700 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-092ec0fa-933a-42dc-85da-3cfdfc24fead None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:50.031987 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-092ec0fa-933a-42dc-85da-3cfdfc24fead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:50.053291 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86059b51-f3cb-442a-86d3-163bb5980244 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:50.058433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bb67b-b071-4885-9f17-211f67d13aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:50.059057 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bb67b-b071-4885-9f17-211f67d13aef admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:50.059373 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bb67b-b071-4885-9f17-211f67d13aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:50.059650 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bb67b-b071-4885-9f17-211f67d13aef admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:50.060345 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7bb67b-b071-4885-9f17-211f67d13aef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:50.062338 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7bb67b-b071-4885-9f17-211f67d13aef admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:50.083297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 880/1757] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:53:49 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:53:50.087285 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bb67b-b071-4885-9f17-211f67d13aef admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:50.091969 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 878/1758] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:53:50.097305 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bb67b-b071-4885-9f17-211f67d13aef admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:50.098379 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ec0fa-933a-42dc-85da-3cfdfc24fead None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:50.102394 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da4502-3cb3-4245-a89a-450e46c1af55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:50.103091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da4502-3cb3-4245-a89a-450e46c1af55 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:50.103418 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da4502-3cb3-4245-a89a-450e46c1af55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:50.104127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da4502-3cb3-4245-a89a-450e46c1af55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:50.104438 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da4502-3cb3-4245-a89a-450e46c1af55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:50.106020 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da4502-3cb3-4245-a89a-450e46c1af55 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:50.107366 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ec0fa-933a-42dc-85da-3cfdfc24fead None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:50.112506 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4586b-c397-4fee-8ac2-194c273a931c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:50.113161 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4586b-c397-4fee-8ac2-194c273a931c admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:50.113453 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4586b-c397-4fee-8ac2-194c273a931c admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:50.113734 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4586b-c397-4fee-8ac2-194c273a931c admin admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:50.114450 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4586b-c397-4fee-8ac2-194c273a931c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:53:50.114760 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4586b-c397-4fee-8ac2-194c273a931c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:50.119456 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 881/1759] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:53:50.119604 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4586b-c397-4fee-8ac2-194c273a931c admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:50.120414 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da4502-3cb3-4245-a89a-450e46c1af55 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:50.129144 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 879/1760] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:53:50.130078 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da4502-3cb3-4245-a89a-450e46c1af55 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:50.132848 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4586b-c397-4fee-8ac2-194c273a931c admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:50.134743 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4091bd35-d6c9-41af-87d7-8c9271b0b49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:50.135663 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091bd35-d6c9-41af-87d7-8c9271b0b49e admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:50.136030 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091bd35-d6c9-41af-87d7-8c9271b0b49e admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:50.136231 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091bd35-d6c9-41af-87d7-8c9271b0b49e admin admin] PATH_INFO: `/v3/projects/e35a2cd987c34b709c4f4104a2fc116c/users/6631b71de8f246e2a1f80721a409c4fe/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:50.147655 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4586b-c397-4fee-8ac2-194c273a931c admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:50.152863 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b35f3-4ab3-4ec8-93e9-b9a046cd6bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:50.153250 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4091bd35-d6c9-41af-87d7-8c9271b0b49e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e35a2cd987c34b709c4f4104a2fc116c, user_id=6631b71de8f246e2a1f80721a409c4fe, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:50.153979 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b35f3-4ab3-4ec8-93e9-b9a046cd6bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:50.154465 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b35f3-4ab3-4ec8-93e9-b9a046cd6bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:50.154835 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b35f3-4ab3-4ec8-93e9-b9a046cd6bd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:50.155701 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b35f3-4ab3-4ec8-93e9-b9a046cd6bd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:50.155972 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4091bd35-d6c9-41af-87d7-8c9271b0b49e admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:50.160969 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b35f3-4ab3-4ec8-93e9-b9a046cd6bd6 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:50.170801 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 882/1761] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:53:50 2022] PUT /identity/v3/projects/e35a2cd987c34b709c4f4104a2fc116c/users/6631b71de8f246e2a1f80721a409c4fe/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:53:50.174811 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4091bd35-d6c9-41af-87d7-8c9271b0b49e admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:50.190860 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 880/1762] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:53:50 2022] POST /identity/v3/projects => generated 363 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:53:50.191880 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b35f3-4ab3-4ec8-93e9-b9a046cd6bd6 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:50.246245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4091bd35-d6c9-41af-87d7-8c9271b0b49e admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:50.285296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b35f3-4ab3-4ec8-93e9-b9a046cd6bd6 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:50.302549 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a3aab-a247-455a-ae0d-8f5689305bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:50.303600 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a3aab-a247-455a-ae0d-8f5689305bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:50.304219 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a3aab-a247-455a-ae0d-8f5689305bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:50.304784 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a3aab-a247-455a-ae0d-8f5689305bc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:50.306569 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a3aab-a247-455a-ae0d-8f5689305bc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:50.309587 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a3aab-a247-455a-ae0d-8f5689305bc1 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:50.350330 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 881/1763] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:53:50 2022] POST /identity/v3/users => generated 282 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:53:50.353019 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a3aab-a247-455a-ae0d-8f5689305bc1 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:50.377193 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a3aab-a247-455a-ae0d-8f5689305bc1 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:50.378193 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd595a6c-b37c-4c8a-ac68-69967ce21818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:50.380372 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd595a6c-b37c-4c8a-ac68-69967ce21818 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:50.381779 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd595a6c-b37c-4c8a-ac68-69967ce21818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:50.382142 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd595a6c-b37c-4c8a-ac68-69967ce21818 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:50.384148 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd595a6c-b37c-4c8a-ac68-69967ce21818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:50.387250 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd595a6c-b37c-4c8a-ac68-69967ce21818 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:50.390299 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e52a21-0d6f-43ae-8900-51fc2df080dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:50.391124 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e52a21-0d6f-43ae-8900-51fc2df080dd admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:50.391714 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e52a21-0d6f-43ae-8900-51fc2df080dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:50.392847 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e52a21-0d6f-43ae-8900-51fc2df080dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:50.393851 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e52a21-0d6f-43ae-8900-51fc2df080dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:50.398819 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e52a21-0d6f-43ae-8900-51fc2df080dd admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:50.412510 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 883/1764] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:53:50.417374 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 882/1765] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:50.420399 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd595a6c-b37c-4c8a-ac68-69967ce21818 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:50.421309 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e52a21-0d6f-43ae-8900-51fc2df080dd admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:50.433996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e52a21-0d6f-43ae-8900-51fc2df080dd admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:50.443996 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd595a6c-b37c-4c8a-ac68-69967ce21818 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:50.448942 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40609c67-32fe-4dfc-83ed-3b2b3b99f5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:50.449479 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48518a0a-8d42-42dc-be0a-67f1e8bf381d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:50.450695 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48518a0a-8d42-42dc-be0a-67f1e8bf381d admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:50.451128 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48518a0a-8d42-42dc-be0a-67f1e8bf381d admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:50.451581 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48518a0a-8d42-42dc-be0a-67f1e8bf381d admin admin] PATH_INFO: `/v3/projects/e35a2cd987c34b709c4f4104a2fc116c/users/6631b71de8f246e2a1f80721a409c4fe/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:50.452542 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40609c67-32fe-4dfc-83ed-3b2b3b99f5be admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:50.454302 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48518a0a-8d42-42dc-be0a-67f1e8bf381d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e35a2cd987c34b709c4f4104a2fc116c, user_id=6631b71de8f246e2a1f80721a409c4fe, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:50.454806 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40609c67-32fe-4dfc-83ed-3b2b3b99f5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:50.455292 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40609c67-32fe-4dfc-83ed-3b2b3b99f5be admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:50.460208 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40609c67-32fe-4dfc-83ed-3b2b3b99f5be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:50.462010 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48518a0a-8d42-42dc-be0a-67f1e8bf381d admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:50.462271 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40609c67-32fe-4dfc-83ed-3b2b3b99f5be admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:50.491722 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 884/1766] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:53:50 2022] PUT /identity/v3/projects/e35a2cd987c34b709c4f4104a2fc116c/users/6631b71de8f246e2a1f80721a409c4fe/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:50.495087 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 883/1767] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:50.502398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48518a0a-8d42-42dc-be0a-67f1e8bf381d admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:50.503813 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba114897-f016-4fdb-b27d-f42bab91bf32 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:50.504266 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba114897-f016-4fdb-b27d-f42bab91bf32 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:50.504640 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba114897-f016-4fdb-b27d-f42bab91bf32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:50.513758 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:50.544497 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-ba114897-f016-4fdb-b27d-f42bab91bf32 None None] MFA Rules not processed for user `6631b71de8f246e2a1f80721a409c4fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:50.545815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-ba114897-f016-4fdb-b27d-f42bab91bf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:50.561239 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:50.607586 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48518a0a-8d42-42dc-be0a-67f1e8bf381d admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:50.616763 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee680b-ce81-4471-a29f-0c8df4b446a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:50.617688 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee680b-ce81-4471-a29f-0c8df4b446a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:50.617970 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee680b-ce81-4471-a29f-0c8df4b446a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:50.618244 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee680b-ce81-4471-a29f-0c8df4b446a6 admin admin] PATH_INFO: `/v3/projects/f6bbef7411a0404aa6059a8d2553bf19/users/4026e1fe72864f1d931b8bc738ef3797/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:50.636489 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee680b-ce81-4471-a29f-0c8df4b446a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6bbef7411a0404aa6059a8d2553bf19, user_id=4026e1fe72864f1d931b8bc738ef3797, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:50.637762 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 884/1768] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:50 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:50.644284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba114897-f016-4fdb-b27d-f42bab91bf32 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:50.645411 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee680b-ce81-4471-a29f-0c8df4b446a6 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:50.645873 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-ba114897-f016-4fdb-b27d-f42bab91bf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:50.665499 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 885/1769] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:53:50 2022] PUT /identity/v3/projects/f6bbef7411a0404aa6059a8d2553bf19/users/4026e1fe72864f1d931b8bc738ef3797/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:50.677205 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fbf79-826f-4f7d-9021-341e927b23e6 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:50.677500 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fbf79-826f-4f7d-9021-341e927b23e6 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:50.677785 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fbf79-826f-4f7d-9021-341e927b23e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:50.707406 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-9f2fbf79-826f-4f7d-9021-341e927b23e6 None None] MFA Rules not processed for user `4026e1fe72864f1d931b8bc738ef3797`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:50.708824 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9f2fbf79-826f-4f7d-9021-341e927b23e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:50.710447 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba114897-f016-4fdb-b27d-f42bab91bf32 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:50.795770 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 886/1770] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:50 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:50.798703 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130231c-fb7e-4f92-a107-0da4e2572dee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:50.799632 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130231c-fb7e-4f92-a107-0da4e2572dee service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:50.799926 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130231c-fb7e-4f92-a107-0da4e2572dee service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:50.800217 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130231c-fb7e-4f92-a107-0da4e2572dee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:50.800809 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fbf79-826f-4f7d-9021-341e927b23e6 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:50.940969 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fbf79-826f-4f7d-9021-341e927b23e6 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:50.950227 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99134ba-b2e9-47ad-bdd6-e538347ee4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:50.950455 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99134ba-b2e9-47ad-bdd6-e538347ee4ed admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:50.951185 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99134ba-b2e9-47ad-bdd6-e538347ee4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:50.951185 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99134ba-b2e9-47ad-bdd6-e538347ee4ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:50.951835 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99134ba-b2e9-47ad-bdd6-e538347ee4ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:50.954004 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99134ba-b2e9-47ad-bdd6-e538347ee4ed admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:50.956238 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c130231c-fb7e-4f92-a107-0da4e2572dee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:50.959828 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c130231c-fb7e-4f92-a107-0da4e2572dee service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:50.976892 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 885/1771] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:53:50.996946 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 887/1772] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:53:50 2022] POST /identity/v3/projects => generated 365 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:53:51.001076 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130231c-fb7e-4f92-a107-0da4e2572dee service cinder] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:51.015063 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130231c-fb7e-4f92-a107-0da4e2572dee service cinder] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:51.035856 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:51.099873 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67b75a-ff25-4227-9ee9-5e2f9c4d503a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:51.101638 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67b75a-ff25-4227-9ee9-5e2f9c4d503a admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:51.102053 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67b75a-ff25-4227-9ee9-5e2f9c4d503a admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:51.102442 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67b75a-ff25-4227-9ee9-5e2f9c4d503a admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:51.103359 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67b75a-ff25-4227-9ee9-5e2f9c4d503a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:51.105718 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67b75a-ff25-4227-9ee9-5e2f9c4d503a admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:51.129151 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 886/1773] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:53:50 2022] POST /identity/v3/users => generated 289 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:53:51.133231 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99134ba-b2e9-47ad-bdd6-e538347ee4ed admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:51.140845 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:51.145542 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99134ba-b2e9-47ad-bdd6-e538347ee4ed admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:51.152981 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84085ef4-b1f2-43e0-97c5-c6072b86a36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:51.153938 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84085ef4-b1f2-43e0-97c5-c6072b86a36b admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:51.154308 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84085ef4-b1f2-43e0-97c5-c6072b86a36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:51.155213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84085ef4-b1f2-43e0-97c5-c6072b86a36b admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:51.155701 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84085ef4-b1f2-43e0-97c5-c6072b86a36b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:51.157874 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84085ef4-b1f2-43e0-97c5-c6072b86a36b admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:51.171702 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 888/1774] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:51.176176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67b75a-ff25-4227-9ee9-5e2f9c4d503a admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:51.195804 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67b75a-ff25-4227-9ee9-5e2f9c4d503a admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:51.203113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd3d01-ced5-4abe-968d-2b7f6f08b40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:51.204682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd3d01-ced5-4abe-968d-2b7f6f08b40d admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:51.205717 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd3d01-ced5-4abe-968d-2b7f6f08b40d admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:51.206115 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd3d01-ced5-4abe-968d-2b7f6f08b40d admin admin] PATH_INFO: `/v3/projects/c8d3f35a2c154964989c1ceade495907/users/1fd6d2e077f9437ab3fefd8a3a0655b0/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:51.245310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd3d01-ced5-4abe-968d-2b7f6f08b40d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d3f35a2c154964989c1ceade495907, user_id=1fd6d2e077f9437ab3fefd8a3a0655b0, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:51.248040 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd3d01-ced5-4abe-968d-2b7f6f08b40d admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:51.265917 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84085ef4-b1f2-43e0-97c5-c6072b86a36b admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:51.267017 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 887/1775] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:53:51 2022] PUT /identity/v3/projects/c8d3f35a2c154964989c1ceade495907/users/1fd6d2e077f9437ab3fefd8a3a0655b0/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:51.271348 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd3d01-ced5-4abe-968d-2b7f6f08b40d admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:51.353588 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84085ef4-b1f2-43e0-97c5-c6072b86a36b admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:51.372469 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd3d01-ced5-4abe-968d-2b7f6f08b40d admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:51.383620 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc8447-6a62-428c-8e0b-a043582501d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:51.384332 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc8447-6a62-428c-8e0b-a043582501d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:51.384612 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc8447-6a62-428c-8e0b-a043582501d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:51.384895 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc8447-6a62-428c-8e0b-a043582501d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:51.385641 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc8447-6a62-428c-8e0b-a043582501d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:51.387290 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc8447-6a62-428c-8e0b-a043582501d8 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:51.402170 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 888/1776] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:51.403282 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc8447-6a62-428c-8e0b-a043582501d8 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:51.413014 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688b85b-64e0-4a42-9117-ca585aa107c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:51.413801 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688b85b-64e0-4a42-9117-ca585aa107c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:51.414276 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688b85b-64e0-4a42-9117-ca585aa107c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:51.414621 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688b85b-64e0-4a42-9117-ca585aa107c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:51.416620 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-7688b85b-64e0-4a42-9117-ca585aa107c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:51.418318 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc8447-6a62-428c-8e0b-a043582501d8 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:51.424062 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fb171-e8cb-4a73-bbe3-e3d5d75f1599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:51.425093 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fb171-e8cb-4a73-bbe3-e3d5d75f1599 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:51.425377 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fb171-e8cb-4a73-bbe3-e3d5d75f1599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:51.425653 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fb171-e8cb-4a73-bbe3-e3d5d75f1599 admin admin] PATH_INFO: `/v3/projects/c8d3f35a2c154964989c1ceade495907/users/1fd6d2e077f9437ab3fefd8a3a0655b0/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:51.427886 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fb171-e8cb-4a73-bbe3-e3d5d75f1599 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d3f35a2c154964989c1ceade495907, user_id=1fd6d2e077f9437ab3fefd8a3a0655b0, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:51.431601 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fb171-e8cb-4a73-bbe3-e3d5d75f1599 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:51.448310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 889/1777] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:53:51 2022] PUT /identity/v3/projects/c8d3f35a2c154964989c1ceade495907/users/1fd6d2e077f9437ab3fefd8a3a0655b0/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:53:51.460765 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9f8df-e356-4d87-a0b9-8f0fd1a93ba3 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:51.461383 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9f8df-e356-4d87-a0b9-8f0fd1a93ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:51.462723 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9f8df-e356-4d87-a0b9-8f0fd1a93ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:51.494495 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-b1f9f8df-e356-4d87-a0b9-8f0fd1a93ba3 None None] MFA Rules not processed for user `1fd6d2e077f9437ab3fefd8a3a0655b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:51.495912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-b1f9f8df-e356-4d87-a0b9-8f0fd1a93ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:51.497386 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688b85b-64e0-4a42-9117-ca585aa107c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:51.498925 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688b85b-64e0-4a42-9117-ca585aa107c2 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:51.510114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 889/1778] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:51 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:53:51.567236 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688b85b-64e0-4a42-9117-ca585aa107c2 service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:51.581691 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688b85b-64e0-4a42-9117-ca585aa107c2 service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:51.586576 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:51.616344 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 890/1779] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:51 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:51.633882 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9f8df-e356-4d87-a0b9-8f0fd1a93ba3 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:51.636161 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-b1f9f8df-e356-4d87-a0b9-8f0fd1a93ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:51.713367 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75753caf-3cce-4f83-803a-a3179b669e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:51.714354 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75753caf-3cce-4f83-803a-a3179b669e75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:51.715344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75753caf-3cce-4f83-803a-a3179b669e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:51.715880 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75753caf-3cce-4f83-803a-a3179b669e75 admin admin] PATH_INFO: `/v3/users/561e6bafb3fa40938edfd914a3ee9423` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:51.720009 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75753caf-3cce-4f83-803a-a3179b669e75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=561e6bafb3fa40938edfd914a3ee9423)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:51.722055 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75753caf-3cce-4f83-803a-a3179b669e75 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:51.724980 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:51.759651 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9f8df-e356-4d87-a0b9-8f0fd1a93ba3 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:51.764037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c768e8-29a2-4dac-aa1c-fe4347ae309f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:51.764800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c768e8-29a2-4dac-aa1c-fe4347ae309f service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:51.766833 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c768e8-29a2-4dac-aa1c-fe4347ae309f service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:51.767401 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c768e8-29a2-4dac-aa1c-fe4347ae309f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:51.782751 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c768e8-29a2-4dac-aa1c-fe4347ae309f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:51.784927 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c768e8-29a2-4dac-aa1c-fe4347ae309f service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:51.796267 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 891/1780] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:51 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:53:51.810640 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-75753caf-3cce-4f83-803a-a3179b669e75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '561e6bafb3fa40938edfd914a3ee9423'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:51.822453 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-75753caf-3cce-4f83-803a-a3179b669e75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '561e6bafb3fa40938edfd914a3ee9423'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:51.836701 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-75753caf-3cce-4f83-803a-a3179b669e75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '561e6bafb3fa40938edfd914a3ee9423'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:51.838184 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-75753caf-3cce-4f83-803a-a3179b669e75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '561e6bafb3fa40938edfd914a3ee9423'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:51.857878 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-75753caf-3cce-4f83-803a-a3179b669e75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '561e6bafb3fa40938edfd914a3ee9423'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:51.874225 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 890/1781] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:53:51 2022] DELETE /identity/v3/users/561e6bafb3fa40938edfd914a3ee9423 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:51.878103 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624c69d-a931-44a7-b2ef-4f227ed00b89 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:51.878461 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624c69d-a931-44a7-b2ef-4f227ed00b89 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:51.878738 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624c69d-a931-44a7-b2ef-4f227ed00b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:51.893514 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75753caf-3cce-4f83-803a-a3179b669e75 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:51.895526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-75753caf-3cce-4f83-803a-a3179b669e75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:51.906450 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-c624c69d-a931-44a7-b2ef-4f227ed00b89 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:51.908498 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-c624c69d-a931-44a7-b2ef-4f227ed00b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:51.976792 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75753caf-3cce-4f83-803a-a3179b669e75 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:51.981545 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98626f9-e480-4bb7-8293-4464c0cec666 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:51.982456 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98626f9-e480-4bb7-8293-4464c0cec666 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:51.982800 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98626f9-e480-4bb7-8293-4464c0cec666 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:51.982976 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 892/1782] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:51.983343 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98626f9-e480-4bb7-8293-4464c0cec666 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:51.985363 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e98626f9-e480-4bb7-8293-4464c0cec666 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:51.994411 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624c69d-a931-44a7-b2ef-4f227ed00b89 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:51.996172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-c624c69d-a931-44a7-b2ef-4f227ed00b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:52.052167 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98626f9-e480-4bb7-8293-4464c0cec666 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:52.054189 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98626f9-e480-4bb7-8293-4464c0cec666 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:52.057038 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624c69d-a931-44a7-b2ef-4f227ed00b89 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:52.061411 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86352274-7cc0-454c-b38c-a8b2b2f36c40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:52.062105 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86352274-7cc0-454c-b38c-a8b2b2f36c40 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:52.062385 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86352274-7cc0-454c-b38c-a8b2b2f36c40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:52.062663 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86352274-7cc0-454c-b38c-a8b2b2f36c40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:52.064192 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 891/1783] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:51 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:53:52.072437 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86352274-7cc0-454c-b38c-a8b2b2f36c40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:52.073873 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86352274-7cc0-454c-b38c-a8b2b2f36c40 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:52.083697 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 893/1784] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:53:52.371331 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98626f9-e480-4bb7-8293-4464c0cec666 service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:52.373128 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e98626f9-e480-4bb7-8293-4464c0cec666 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:52.392557 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98626f9-e480-4bb7-8293-4464c0cec666 service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:52.397694 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54227464-862c-44ee-93cc-0191666fc6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:52.398670 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54227464-862c-44ee-93cc-0191666fc6f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:52.399202 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54227464-862c-44ee-93cc-0191666fc6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:52.399566 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54227464-862c-44ee-93cc-0191666fc6f1 admin admin] PATH_INFO: `/v3/projects/f2e366311a9b4c469931aa09312e345c` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:52.400868 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54227464-862c-44ee-93cc-0191666fc6f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2e366311a9b4c469931aa09312e345c)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:52.402902 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54227464-862c-44ee-93cc-0191666fc6f1 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:52.436699 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:52.454448 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-54227464-862c-44ee-93cc-0191666fc6f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2e366311a9b4c469931aa09312e345c', 'request_id': 'req-54227464-862c-44ee-93cc-0191666fc6f1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:52.463005 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-54227464-862c-44ee-93cc-0191666fc6f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2e366311a9b4c469931aa09312e345c', 'request_id': 'req-54227464-862c-44ee-93cc-0191666fc6f1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:52.469042 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-54227464-862c-44ee-93cc-0191666fc6f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2e366311a9b4c469931aa09312e345c', 'request_id': 'req-54227464-862c-44ee-93cc-0191666fc6f1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:52.481413 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-54227464-862c-44ee-93cc-0191666fc6f1 admin admin] The token cache is being invalidate because project f2e366311a9b4c469931aa09312e345c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:53:52.481707 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-54227464-862c-44ee-93cc-0191666fc6f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:52.482377 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-54227464-862c-44ee-93cc-0191666fc6f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:52.484248 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 892/1785] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:53:52 2022] DELETE /identity/v3/projects/f2e366311a9b4c469931aa09312e345c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:52.491067 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86352274-7cc0-454c-b38c-a8b2b2f36c40 service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:52.502425 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86352274-7cc0-454c-b38c-a8b2b2f36c40 service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:52.536040 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:52.568737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1e99a-6ab1-4afb-84dc-a9676b68c3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:52.569636 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1e99a-6ab1-4afb-84dc-a9676b68c3e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:52.569927 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1e99a-6ab1-4afb-84dc-a9676b68c3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:52.570212 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1e99a-6ab1-4afb-84dc-a9676b68c3e2 admin admin] PATH_INFO: `/v3/users/6631b71de8f246e2a1f80721a409c4fe` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:52.571530 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1e99a-6ab1-4afb-84dc-a9676b68c3e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6631b71de8f246e2a1f80721a409c4fe)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:52.573480 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1e99a-6ab1-4afb-84dc-a9676b68c3e2 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:52.622156 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-93b1e99a-6ab1-4afb-84dc-a9676b68c3e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6631b71de8f246e2a1f80721a409c4fe'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:52.629040 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-93b1e99a-6ab1-4afb-84dc-a9676b68c3e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6631b71de8f246e2a1f80721a409c4fe'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:52.637950 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-93b1e99a-6ab1-4afb-84dc-a9676b68c3e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6631b71de8f246e2a1f80721a409c4fe'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:52.638666 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-93b1e99a-6ab1-4afb-84dc-a9676b68c3e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6631b71de8f246e2a1f80721a409c4fe'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:52.650767 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-93b1e99a-6ab1-4afb-84dc-a9676b68c3e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6631b71de8f246e2a1f80721a409c4fe'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:52.656868 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 894/1786] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:53:52 2022] DELETE /identity/v3/users/6631b71de8f246e2a1f80721a409c4fe => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:53.102110 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54227464-862c-44ee-93cc-0191666fc6f1 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:53.103690 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-54227464-862c-44ee-93cc-0191666fc6f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:53.119049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54227464-862c-44ee-93cc-0191666fc6f1 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:53.178917 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759550fb-89df-4a43-bb25-d850d47397f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:53.179759 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759550fb-89df-4a43-bb25-d850d47397f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:53.180024 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759550fb-89df-4a43-bb25-d850d47397f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:53.180298 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759550fb-89df-4a43-bb25-d850d47397f5 admin admin] PATH_INFO: `/v3/projects/e35a2cd987c34b709c4f4104a2fc116c` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:53.181884 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759550fb-89df-4a43-bb25-d850d47397f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e35a2cd987c34b709c4f4104a2fc116c)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:53.183836 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759550fb-89df-4a43-bb25-d850d47397f5 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:53.232444 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-759550fb-89df-4a43-bb25-d850d47397f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e35a2cd987c34b709c4f4104a2fc116c', 'request_id': 'req-759550fb-89df-4a43-bb25-d850d47397f5'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:53.242406 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-759550fb-89df-4a43-bb25-d850d47397f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e35a2cd987c34b709c4f4104a2fc116c', 'request_id': 'req-759550fb-89df-4a43-bb25-d850d47397f5'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:53.249196 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-759550fb-89df-4a43-bb25-d850d47397f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e35a2cd987c34b709c4f4104a2fc116c', 'request_id': 'req-759550fb-89df-4a43-bb25-d850d47397f5'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:53.260975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-759550fb-89df-4a43-bb25-d850d47397f5 admin admin] The token cache is being invalidate because project e35a2cd987c34b709c4f4104a2fc116c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:53:53.261268 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-759550fb-89df-4a43-bb25-d850d47397f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:53.261967 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-759550fb-89df-4a43-bb25-d850d47397f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:53:53.263576 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 893/1787] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:53:53 2022] DELETE /identity/v3/projects/e35a2cd987c34b709c4f4104a2fc116c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:53.268514 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9bb6e-098d-4119-a211-10497377e4ff None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:53.269026 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9bb6e-098d-4119-a211-10497377e4ff None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:53.269125 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9bb6e-098d-4119-a211-10497377e4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:53.286824 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-5ad9bb6e-098d-4119-a211-10497377e4ff None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:53.288038 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-5ad9bb6e-098d-4119-a211-10497377e4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:53.355212 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 895/1788] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:53.358499 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95bb7c5-4867-4d0b-85c1-f4c5ff8890c4 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:53.358793 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95bb7c5-4867-4d0b-85c1-f4c5ff8890c4 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:53.359078 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95bb7c5-4867-4d0b-85c1-f4c5ff8890c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:53.382436 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-b95bb7c5-4867-4d0b-85c1-f4c5ff8890c4 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:53.384225 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b95bb7c5-4867-4d0b-85c1-f4c5ff8890c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:53.394296 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 894/1789] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:53.398110 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9bb6e-098d-4119-a211-10497377e4ff None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:53.409411 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9bb6e-098d-4119-a211-10497377e4ff None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:53.414199 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed920df-beaa-4690-866e-1753c408c9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:53.414969 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed920df-beaa-4690-866e-1753c408c9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:53.415285 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed920df-beaa-4690-866e-1753c408c9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:53.415568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed920df-beaa-4690-866e-1753c408c9c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:53.416320 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed920df-beaa-4690-866e-1753c408c9c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:53:53.416633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed920df-beaa-4690-866e-1753c408c9c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:53.418330 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed920df-beaa-4690-866e-1753c408c9c6 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:53.434536 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 896/1790] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:53:53.435606 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95bb7c5-4867-4d0b-85c1-f4c5ff8890c4 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:53.445308 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95bb7c5-4867-4d0b-85c1-f4c5ff8890c4 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:53.451056 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f5f38-b6b1-4974-8311-b71fe785d428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:53.451823 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f5f38-b6b1-4974-8311-b71fe785d428 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:53.452047 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f5f38-b6b1-4974-8311-b71fe785d428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:53.452294 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f5f38-b6b1-4974-8311-b71fe785d428 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:53.453005 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f5f38-b6b1-4974-8311-b71fe785d428 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:53.455054 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f5f38-b6b1-4974-8311-b71fe785d428 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:53.486422 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 895/1791] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:53:53 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:53:53.487745 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed920df-beaa-4690-866e-1753c408c9c6 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:53.508745 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed920df-beaa-4690-866e-1753c408c9c6 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:53.592436 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:53.612599 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eed112-8083-49ca-aa31-a8f7adb4a070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:53.613535 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eed112-8083-49ca-aa31-a8f7adb4a070 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:53.613675 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eed112-8083-49ca-aa31-a8f7adb4a070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:53.614033 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eed112-8083-49ca-aa31-a8f7adb4a070 admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:53.614806 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eed112-8083-49ca-aa31-a8f7adb4a070 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:53.617061 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eed112-8083-49ca-aa31-a8f7adb4a070 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:53.650414 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 897/1792] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:53:53 2022] POST /identity/v3/users => generated 292 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:53:53.658141 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f5f38-b6b1-4974-8311-b71fe785d428 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:53.671375 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f5f38-b6b1-4974-8311-b71fe785d428 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:53.679252 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d566a-8ea5-44a4-8696-572dd7447970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:53.680141 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d566a-8ea5-44a4-8696-572dd7447970 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:53.680960 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d566a-8ea5-44a4-8696-572dd7447970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:53.681339 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d566a-8ea5-44a4-8696-572dd7447970 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:53.682448 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d566a-8ea5-44a4-8696-572dd7447970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:53.684791 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d566a-8ea5-44a4-8696-572dd7447970 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:53.831233 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 896/1793] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:53.837274 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eed112-8083-49ca-aa31-a8f7adb4a070 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:53.848735 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eed112-8083-49ca-aa31-a8f7adb4a070 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:53.854501 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7ca47-f26f-4476-bc1f-5c42c5acf6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:53.855212 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7ca47-f26f-4476-bc1f-5c42c5acf6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:53.855516 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7ca47-f26f-4476-bc1f-5c42c5acf6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:53.855793 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7ca47-f26f-4476-bc1f-5c42c5acf6d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:53.856520 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7ca47-f26f-4476-bc1f-5c42c5acf6d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:53.858162 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7ca47-f26f-4476-bc1f-5c42c5acf6d3 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:53.869432 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 898/1794] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:53:53.873496 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d566a-8ea5-44a4-8696-572dd7447970 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:53.884198 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d566a-8ea5-44a4-8696-572dd7447970 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:53.888865 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79b138-8fa9-4d15-b48b-a3e731eb6a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:53.889741 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79b138-8fa9-4d15-b48b-a3e731eb6a3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:53.890022 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79b138-8fa9-4d15-b48b-a3e731eb6a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:53.890295 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79b138-8fa9-4d15-b48b-a3e731eb6a3e admin admin] PATH_INFO: `/v3/projects/c9e1ceae8a1145fc86f7ac01c0af353d/users/8cca1e33b1c84e809bc47135fa14b442/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:53.892579 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:53.906908 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79b138-8fa9-4d15-b48b-a3e731eb6a3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9e1ceae8a1145fc86f7ac01c0af353d, user_id=8cca1e33b1c84e809bc47135fa14b442, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:53.910420 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79b138-8fa9-4d15-b48b-a3e731eb6a3e admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:53.926042 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 897/1795] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:53:53 2022] PUT /identity/v3/projects/c9e1ceae8a1145fc86f7ac01c0af353d/users/8cca1e33b1c84e809bc47135fa14b442/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:53:53.937975 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f77053-135a-4174-a4af-f50ad506c915 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:53.938214 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f77053-135a-4174-a4af-f50ad506c915 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:53.938516 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f77053-135a-4174-a4af-f50ad506c915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:53.969213 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-32f77053-135a-4174-a4af-f50ad506c915 None None] MFA Rules not processed for user `8cca1e33b1c84e809bc47135fa14b442`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:53.970439 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-32f77053-135a-4174-a4af-f50ad506c915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:54.037036 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 899/1796] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:54.041497 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79b138-8fa9-4d15-b48b-a3e731eb6a3e admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:54.116832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79b138-8fa9-4d15-b48b-a3e731eb6a3e admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:54.121503 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94eeb67-dd65-463b-84a7-03f1cc597178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:54.122180 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94eeb67-dd65-463b-84a7-03f1cc597178 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:54.122472 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94eeb67-dd65-463b-84a7-03f1cc597178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:54.122755 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94eeb67-dd65-463b-84a7-03f1cc597178 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:54.123518 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94eeb67-dd65-463b-84a7-03f1cc597178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:54.125488 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94eeb67-dd65-463b-84a7-03f1cc597178 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:54.153456 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 898/1797] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:53:54 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:53:54.157681 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f77053-135a-4174-a4af-f50ad506c915 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:54.168895 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f77053-135a-4174-a4af-f50ad506c915 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:54.226645 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226f0c4-3774-4fe2-a565-42ece598e8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:54.227297 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226f0c4-3774-4fe2-a565-42ece598e8cd admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:54.227590 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226f0c4-3774-4fe2-a565-42ece598e8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:54.227873 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226f0c4-3774-4fe2-a565-42ece598e8cd admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:54.228588 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226f0c4-3774-4fe2-a565-42ece598e8cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:54.230548 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226f0c4-3774-4fe2-a565-42ece598e8cd admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:54.252672 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 900/1798] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:53:54 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:53:54.256744 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94eeb67-dd65-463b-84a7-03f1cc597178 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:54.267827 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94eeb67-dd65-463b-84a7-03f1cc597178 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:54.272697 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7aa133-90e2-40ba-b1fe-1fae23c598da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:54.273374 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7aa133-90e2-40ba-b1fe-1fae23c598da admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:54.273662 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7aa133-90e2-40ba-b1fe-1fae23c598da admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:54.273940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7aa133-90e2-40ba-b1fe-1fae23c598da admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:54.274673 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7aa133-90e2-40ba-b1fe-1fae23c598da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:54.276308 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7aa133-90e2-40ba-b1fe-1fae23c598da admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:54.286755 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 899/1799] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:54.290851 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226f0c4-3774-4fe2-a565-42ece598e8cd admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:54.301471 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226f0c4-3774-4fe2-a565-42ece598e8cd admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:54.307034 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306f49e-510b-4428-a017-6a711f09989c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:54.307754 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306f49e-510b-4428-a017-6a711f09989c admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:54.308186 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306f49e-510b-4428-a017-6a711f09989c admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:54.308471 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306f49e-510b-4428-a017-6a711f09989c admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:54.309210 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306f49e-510b-4428-a017-6a711f09989c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:54.310813 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306f49e-510b-4428-a017-6a711f09989c admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:54.321595 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 901/1800] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:54.325804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7aa133-90e2-40ba-b1fe-1fae23c598da admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:54.336117 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7aa133-90e2-40ba-b1fe-1fae23c598da admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:54.341180 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ffaef-9b9a-4082-b436-29705652f15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:54.342055 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ffaef-9b9a-4082-b436-29705652f15a admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:54.342338 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ffaef-9b9a-4082-b436-29705652f15a admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:54.342618 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ffaef-9b9a-4082-b436-29705652f15a admin admin] PATH_INFO: `/v3/projects/dee21f6ca8744a22b66b326477962441/users/54e1043c717d4f65a7f7adb7745e3d1b/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:54.357390 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ffaef-9b9a-4082-b436-29705652f15a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dee21f6ca8744a22b66b326477962441, user_id=54e1043c717d4f65a7f7adb7745e3d1b, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:54.360132 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ffaef-9b9a-4082-b436-29705652f15a admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:54.375351 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 900/1801] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:53:54 2022] PUT /identity/v3/projects/dee21f6ca8744a22b66b326477962441/users/54e1043c717d4f65a7f7adb7745e3d1b/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:53:54.386579 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9a194-fa61-481a-ad12-3ceeab85b277 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:54.386878 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9a194-fa61-481a-ad12-3ceeab85b277 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:54.387196 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9a194-fa61-481a-ad12-3ceeab85b277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:54.416012 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-79d9a194-fa61-481a-ad12-3ceeab85b277 None None] MFA Rules not processed for user `54e1043c717d4f65a7f7adb7745e3d1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:54.417224 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-79d9a194-fa61-481a-ad12-3ceeab85b277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:54.439292 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:54.500849 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 902/1802] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:54.507809 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ffaef-9b9a-4082-b436-29705652f15a admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:54.575621 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ffaef-9b9a-4082-b436-29705652f15a admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:54.581131 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c33a78-4402-4beb-9c59-709944e53f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:54.581828 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c33a78-4402-4beb-9c59-709944e53f8a admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:54.582112 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c33a78-4402-4beb-9c59-709944e53f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:54.582389 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c33a78-4402-4beb-9c59-709944e53f8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:54.583083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c33a78-4402-4beb-9c59-709944e53f8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:54.585029 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c33a78-4402-4beb-9c59-709944e53f8a admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:54.613914 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 901/1803] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:53:54 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:53:54.619830 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9a194-fa61-481a-ad12-3ceeab85b277 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:54.631518 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9a194-fa61-481a-ad12-3ceeab85b277 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:54.701479 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e86e8-c138-4752-abb7-c67bdeca55b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:54.702176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e86e8-c138-4752-abb7-c67bdeca55b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:54.702482 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e86e8-c138-4752-abb7-c67bdeca55b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:54.702741 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e86e8-c138-4752-abb7-c67bdeca55b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:54.703540 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e86e8-c138-4752-abb7-c67bdeca55b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:54.705535 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e86e8-c138-4752-abb7-c67bdeca55b8 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:54.733507 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 903/1804] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:53:54 2022] POST /identity/v3/users => generated 299 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:53:54.734443 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c33a78-4402-4beb-9c59-709944e53f8a admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:54.745415 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c33a78-4402-4beb-9c59-709944e53f8a admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:54.751165 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b40f6-33cd-4038-b406-1ad4be4f6a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:54.751876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b40f6-33cd-4038-b406-1ad4be4f6a95 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:54.752164 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b40f6-33cd-4038-b406-1ad4be4f6a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:54.762831 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b40f6-33cd-4038-b406-1ad4be4f6a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:54.762831 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b40f6-33cd-4038-b406-1ad4be4f6a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:54.763835 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b40f6-33cd-4038-b406-1ad4be4f6a95 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:54.779205 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 902/1805] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:53:54.780978 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e86e8-c138-4752-abb7-c67bdeca55b8 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:54.792881 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e86e8-c138-4752-abb7-c67bdeca55b8 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:54.798979 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e9691-2007-48e1-b91c-58361aa5c367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:54.800003 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e9691-2007-48e1-b91c-58361aa5c367 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:54.800456 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e9691-2007-48e1-b91c-58361aa5c367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:54.800728 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e9691-2007-48e1-b91c-58361aa5c367 admin admin] PATH_INFO: `/v3/projects/32c0853471fe41b2b9fa73dba3f6f448/users/60af543769154f00b8a8f226fb497791/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:54.819232 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e9691-2007-48e1-b91c-58361aa5c367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c0853471fe41b2b9fa73dba3f6f448, user_id=60af543769154f00b8a8f226fb497791, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:54.822067 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e9691-2007-48e1-b91c-58361aa5c367 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:54.838331 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 904/1806] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:53:54 2022] PUT /identity/v3/projects/32c0853471fe41b2b9fa73dba3f6f448/users/60af543769154f00b8a8f226fb497791/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:54.842525 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b40f6-33cd-4038-b406-1ad4be4f6a95 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:54.853007 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b40f6-33cd-4038-b406-1ad4be4f6a95 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:54.856817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:54.916271 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04497928-44d4-4ece-b390-22cfe73735b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:54.916958 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04497928-44d4-4ece-b390-22cfe73735b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:54.917245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04497928-44d4-4ece-b390-22cfe73735b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:54.917523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04497928-44d4-4ece-b390-22cfe73735b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:54.918255 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04497928-44d4-4ece-b390-22cfe73735b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:54.919898 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04497928-44d4-4ece-b390-22cfe73735b8 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:54.933841 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 903/1807] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:53:54.935003 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e9691-2007-48e1-b91c-58361aa5c367 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:54.946264 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e9691-2007-48e1-b91c-58361aa5c367 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:54.951429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff44be-ce7c-47ca-8989-dbef5d0d3b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:54.952456 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff44be-ce7c-47ca-8989-dbef5d0d3b1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:54.952740 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff44be-ce7c-47ca-8989-dbef5d0d3b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:54.953003 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff44be-ce7c-47ca-8989-dbef5d0d3b1c admin admin] PATH_INFO: `/v3/projects/32c0853471fe41b2b9fa73dba3f6f448/users/60af543769154f00b8a8f226fb497791/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:54.955909 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff44be-ce7c-47ca-8989-dbef5d0d3b1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c0853471fe41b2b9fa73dba3f6f448, user_id=60af543769154f00b8a8f226fb497791, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:54.958554 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff44be-ce7c-47ca-8989-dbef5d0d3b1c admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:54.970449 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 905/1808] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:53:54 2022] PUT /identity/v3/projects/32c0853471fe41b2b9fa73dba3f6f448/users/60af543769154f00b8a8f226fb497791/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:53:54.982406 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d80fe-936e-41e3-af71-46111cee74a7 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:54.982701 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d80fe-936e-41e3-af71-46111cee74a7 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:54.982983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d80fe-936e-41e3-af71-46111cee74a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:55.015098 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-e48d80fe-936e-41e3-af71-46111cee74a7 None None] MFA Rules not processed for user `60af543769154f00b8a8f226fb497791`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:53:55.016590 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e48d80fe-936e-41e3-af71-46111cee74a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:55.087220 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 904/1809] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:53:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:53:55.099413 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff44be-ce7c-47ca-8989-dbef5d0d3b1c admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:53:55.101340 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-b9ff44be-ce7c-47ca-8989-dbef5d0d3b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:53:55.162515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff44be-ce7c-47ca-8989-dbef5d0d3b1c admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:53:55.166188 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06805949-e0d6-4b2f-8ad4-9ec7d39422ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:53:55.166948 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06805949-e0d6-4b2f-8ad4-9ec7d39422ee service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:53:55.167334 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06805949-e0d6-4b2f-8ad4-9ec7d39422ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:53:55.167680 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06805949-e0d6-4b2f-8ad4-9ec7d39422ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:53:55.194896 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:53:55.230850 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06805949-e0d6-4b2f-8ad4-9ec7d39422ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:53:55.232350 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06805949-e0d6-4b2f-8ad4-9ec7d39422ee service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:53:55.242296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 906/1810] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:53:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:54:05.083088 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=60 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:05.237991 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=15 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:06.300929 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d80fe-936e-41e3-af71-46111cee74a7 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:06.302585 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e48d80fe-936e-41e3-af71-46111cee74a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:06.316258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d80fe-936e-41e3-af71-46111cee74a7 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:06.320276 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8d16d-c8bd-4c76-9302-055645107f5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:06.321017 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8d16d-c8bd-4c76-9302-055645107f5d service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:06.321311 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8d16d-c8bd-4c76-9302-055645107f5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:06.321593 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8d16d-c8bd-4c76-9302-055645107f5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:06.387187 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8d16d-c8bd-4c76-9302-055645107f5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:06.388679 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8d16d-c8bd-4c76-9302-055645107f5d service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:06.398354 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 905/1811] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:54:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:54:07.159617 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06805949-e0d6-4b2f-8ad4-9ec7d39422ee service cinder] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:07.167766 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06805949-e0d6-4b2f-8ad4-9ec7d39422ee service cinder] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:07.171509 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3cccc5-efd5-4e00-92c1-306ef70b2c44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:07.172153 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cccc5-efd5-4e00-92c1-306ef70b2c44 service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:07.172439 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cccc5-efd5-4e00-92c1-306ef70b2c44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:07.172717 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cccc5-efd5-4e00-92c1-306ef70b2c44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:07.182680 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3cccc5-efd5-4e00-92c1-306ef70b2c44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:07.184254 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3cccc5-efd5-4e00-92c1-306ef70b2c44 service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:07.193987 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 907/1812] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:54:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:54:16.393963 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=28 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:17.039985 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b245e5b-edb6-4fe4-93dc-25589a3c3382 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:17.040223 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b245e5b-edb6-4fe4-93dc-25589a3c3382 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:17.040698 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b245e5b-edb6-4fe4-93dc-25589a3c3382 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:17.042711 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 906/1813] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jun 24 10:54:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:54:17.050201 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6bd22-e629-4358-84af-362e3429c2b6 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:17.050719 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6bd22-e629-4358-84af-362e3429c2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:17.050913 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6bd22-e629-4358-84af-362e3429c2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:17.073263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-12f6bd22-e629-4358-84af-362e3429c2b6 None None] MFA Rules not processed for user `e8034bad51144002a7386c975e412992`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:17.074724 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-12f6bd22-e629-4358-84af-362e3429c2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:17.146498 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 908/1814] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jun 24 10:54:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:54:17.159608 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b245e5b-edb6-4fe4-93dc-25589a3c3382 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:17.161579 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-8b245e5b-edb6-4fe4-93dc-25589a3c3382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:17.179171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b245e5b-edb6-4fe4-93dc-25589a3c3382 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:17.184825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f89207-72e2-4dfd-aba1-7088a9dc6a9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:17.185474 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f89207-72e2-4dfd-aba1-7088a9dc6a9f service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:17.185777 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f89207-72e2-4dfd-aba1-7088a9dc6a9f service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:17.186305 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f89207-72e2-4dfd-aba1-7088a9dc6a9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:17.196136 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f89207-72e2-4dfd-aba1-7088a9dc6a9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:17.197739 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f89207-72e2-4dfd-aba1-7088a9dc6a9f service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:17.210366 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 907/1815] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:54:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:54:26.007985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6bd22-e629-4358-84af-362e3429c2b6 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:26.084013 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6bd22-e629-4358-84af-362e3429c2b6 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:26.091332 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e493c-f96c-4f85-a4d3-5785dd6fd57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:26.092669 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e493c-f96c-4f85-a4d3-5785dd6fd57e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:26.093032 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e493c-f96c-4f85-a4d3-5785dd6fd57e admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:26.093390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e493c-f96c-4f85-a4d3-5785dd6fd57e admin admin] PATH_INFO: `/v3/users/8cca1e33b1c84e809bc47135fa14b442` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:26.095470 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e493c-f96c-4f85-a4d3-5785dd6fd57e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cca1e33b1c84e809bc47135fa14b442)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:26.098606 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e493c-f96c-4f85-a4d3-5785dd6fd57e admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:26.159878 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-274e493c-f96c-4f85-a4d3-5785dd6fd57e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cca1e33b1c84e809bc47135fa14b442'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:26.168198 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-274e493c-f96c-4f85-a4d3-5785dd6fd57e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cca1e33b1c84e809bc47135fa14b442'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:26.178683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-274e493c-f96c-4f85-a4d3-5785dd6fd57e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cca1e33b1c84e809bc47135fa14b442'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:26.179362 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-274e493c-f96c-4f85-a4d3-5785dd6fd57e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cca1e33b1c84e809bc47135fa14b442'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:26.191551 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-274e493c-f96c-4f85-a4d3-5785dd6fd57e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cca1e33b1c84e809bc47135fa14b442'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:26.193216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:26.198889 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 909/1816] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:54:26 2022] DELETE /identity/v3/users/8cca1e33b1c84e809bc47135fa14b442 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:26.203834 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708e852-e6a1-410d-8114-3e34e2dfaf95 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:26.204380 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708e852-e6a1-410d-8114-3e34e2dfaf95 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:26.204380 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708e852-e6a1-410d-8114-3e34e2dfaf95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:26.222736 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-c708e852-e6a1-410d-8114-3e34e2dfaf95 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:26.223804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c708e852-e6a1-410d-8114-3e34e2dfaf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:26.290648 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 908/1817] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:54:26.300803 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e493c-f96c-4f85-a4d3-5785dd6fd57e admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:26.302299 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-274e493c-f96c-4f85-a4d3-5785dd6fd57e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:26.376478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e493c-f96c-4f85-a4d3-5785dd6fd57e admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:26.382735 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23638d-a775-4641-8a6b-62c1268d20e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:26.383526 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23638d-a775-4641-8a6b-62c1268d20e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:26.383875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23638d-a775-4641-8a6b-62c1268d20e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:26.384211 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23638d-a775-4641-8a6b-62c1268d20e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:26.396820 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23638d-a775-4641-8a6b-62c1268d20e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:26.397643 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23638d-a775-4641-8a6b-62c1268d20e5 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:26.408934 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 910/1818] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:54:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:54:26.518773 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708e852-e6a1-410d-8114-3e34e2dfaf95 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:26.521317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c708e852-e6a1-410d-8114-3e34e2dfaf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:26.533444 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708e852-e6a1-410d-8114-3e34e2dfaf95 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:26.539588 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760636b1-2671-4ec8-95f6-40120f4a345c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:26.540943 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760636b1-2671-4ec8-95f6-40120f4a345c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:26.541288 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760636b1-2671-4ec8-95f6-40120f4a345c admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:26.541570 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760636b1-2671-4ec8-95f6-40120f4a345c admin admin] PATH_INFO: `/v3/users/4026e1fe72864f1d931b8bc738ef3797` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:26.542904 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760636b1-2671-4ec8-95f6-40120f4a345c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4026e1fe72864f1d931b8bc738ef3797)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:26.545218 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760636b1-2671-4ec8-95f6-40120f4a345c admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:26.610575 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-760636b1-2671-4ec8-95f6-40120f4a345c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4026e1fe72864f1d931b8bc738ef3797'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:26.624262 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-760636b1-2671-4ec8-95f6-40120f4a345c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4026e1fe72864f1d931b8bc738ef3797'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:26.634882 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-760636b1-2671-4ec8-95f6-40120f4a345c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4026e1fe72864f1d931b8bc738ef3797'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:26.635634 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-760636b1-2671-4ec8-95f6-40120f4a345c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4026e1fe72864f1d931b8bc738ef3797'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:26.648858 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-760636b1-2671-4ec8-95f6-40120f4a345c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4026e1fe72864f1d931b8bc738ef3797'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:26.655069 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 909/1819] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:54:26 2022] DELETE /identity/v3/users/4026e1fe72864f1d931b8bc738ef3797 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:26.663170 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f994c7e-3753-4c89-b90c-895b39a05ef3 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:26.663170 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f994c7e-3753-4c89-b90c-895b39a05ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:26.663424 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f994c7e-3753-4c89-b90c-895b39a05ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:26.681317 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-4f994c7e-3753-4c89-b90c-895b39a05ef3 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:26.682557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-4f994c7e-3753-4c89-b90c-895b39a05ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:26.747934 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 911/1820] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:54:26.758049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760636b1-2671-4ec8-95f6-40120f4a345c admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:26.759598 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-760636b1-2671-4ec8-95f6-40120f4a345c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:26.821002 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760636b1-2671-4ec8-95f6-40120f4a345c admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:26.824626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8519207-e122-481e-9f72-1695e9fb4afa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:26.825333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8519207-e122-481e-9f72-1695e9fb4afa service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:26.825616 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8519207-e122-481e-9f72-1695e9fb4afa service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:26.825959 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8519207-e122-481e-9f72-1695e9fb4afa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:26.842535 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8519207-e122-481e-9f72-1695e9fb4afa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:26.844169 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8519207-e122-481e-9f72-1695e9fb4afa service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:26.855409 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 910/1821] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:54:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:54:26.890024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f994c7e-3753-4c89-b90c-895b39a05ef3 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:26.891884 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-4f994c7e-3753-4c89-b90c-895b39a05ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:26.906419 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f994c7e-3753-4c89-b90c-895b39a05ef3 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:26.914450 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66abfb-ef96-4e40-af2e-0d2339d3251e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:26.924458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66abfb-ef96-4e40-af2e-0d2339d3251e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:26.925019 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66abfb-ef96-4e40-af2e-0d2339d3251e admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:26.926328 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66abfb-ef96-4e40-af2e-0d2339d3251e admin admin] PATH_INFO: `/v3/projects/c9e1ceae8a1145fc86f7ac01c0af353d` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:26.928414 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e66abfb-ef96-4e40-af2e-0d2339d3251e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9e1ceae8a1145fc86f7ac01c0af353d)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:26.931817 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e66abfb-ef96-4e40-af2e-0d2339d3251e admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:27.007476 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-2e66abfb-ef96-4e40-af2e-0d2339d3251e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9e1ceae8a1145fc86f7ac01c0af353d', 'request_id': 'req-2e66abfb-ef96-4e40-af2e-0d2339d3251e'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:27.017379 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-2e66abfb-ef96-4e40-af2e-0d2339d3251e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9e1ceae8a1145fc86f7ac01c0af353d', 'request_id': 'req-2e66abfb-ef96-4e40-af2e-0d2339d3251e'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:27.025451 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-2e66abfb-ef96-4e40-af2e-0d2339d3251e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9e1ceae8a1145fc86f7ac01c0af353d', 'request_id': 'req-2e66abfb-ef96-4e40-af2e-0d2339d3251e'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:27.037609 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-2e66abfb-ef96-4e40-af2e-0d2339d3251e admin admin] The token cache is being invalidate because project c9e1ceae8a1145fc86f7ac01c0af353d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:54:27.037911 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-2e66abfb-ef96-4e40-af2e-0d2339d3251e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:27.038632 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-2e66abfb-ef96-4e40-af2e-0d2339d3251e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:27.043029 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 912/1822] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:54:26 2022] DELETE /identity/v3/projects/c9e1ceae8a1145fc86f7ac01c0af353d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:27.044615 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8519207-e122-481e-9f72-1695e9fb4afa service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:27.050262 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:27.057829 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8519207-e122-481e-9f72-1695e9fb4afa service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:27.145253 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa83c2-9ade-4d09-b2fe-0a5d41cfcb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:27.146373 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa83c2-9ade-4d09-b2fe-0a5d41cfcb85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:27.146658 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa83c2-9ade-4d09-b2fe-0a5d41cfcb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:27.146937 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa83c2-9ade-4d09-b2fe-0a5d41cfcb85 admin admin] PATH_INFO: `/v3/users/54e1043c717d4f65a7f7adb7745e3d1b` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:27.148173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa83c2-9ade-4d09-b2fe-0a5d41cfcb85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54e1043c717d4f65a7f7adb7745e3d1b)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:27.150141 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa83c2-9ade-4d09-b2fe-0a5d41cfcb85 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:27.199458 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7ffa83c2-9ade-4d09-b2fe-0a5d41cfcb85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54e1043c717d4f65a7f7adb7745e3d1b'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:27.207105 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7ffa83c2-9ade-4d09-b2fe-0a5d41cfcb85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54e1043c717d4f65a7f7adb7745e3d1b'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:27.218220 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66abfb-ef96-4e40-af2e-0d2339d3251e admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:27.218831 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7ffa83c2-9ade-4d09-b2fe-0a5d41cfcb85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54e1043c717d4f65a7f7adb7745e3d1b'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:27.219648 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7ffa83c2-9ade-4d09-b2fe-0a5d41cfcb85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54e1043c717d4f65a7f7adb7745e3d1b'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:27.219783 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-2e66abfb-ef96-4e40-af2e-0d2339d3251e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:27.234027 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66abfb-ef96-4e40-af2e-0d2339d3251e admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:27.236383 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7ffa83c2-9ade-4d09-b2fe-0a5d41cfcb85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54e1043c717d4f65a7f7adb7745e3d1b'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:27.240537 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82605c1c-019a-45da-8f81-55823abf8442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:27.244299 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 911/1823] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:54:27 2022] DELETE /identity/v3/users/54e1043c717d4f65a7f7adb7745e3d1b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:27.248647 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82605c1c-019a-45da-8f81-55823abf8442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:27.248942 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82605c1c-019a-45da-8f81-55823abf8442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:27.249224 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82605c1c-019a-45da-8f81-55823abf8442 admin admin] PATH_INFO: `/v3/projects/f6bbef7411a0404aa6059a8d2553bf19` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:27.250581 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82605c1c-019a-45da-8f81-55823abf8442 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6bbef7411a0404aa6059a8d2553bf19)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:27.252553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82605c1c-019a-45da-8f81-55823abf8442 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:27.275240 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:27.305962 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-82605c1c-019a-45da-8f81-55823abf8442 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6bbef7411a0404aa6059a8d2553bf19', 'request_id': 'req-82605c1c-019a-45da-8f81-55823abf8442'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:27.313481 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-82605c1c-019a-45da-8f81-55823abf8442 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6bbef7411a0404aa6059a8d2553bf19', 'request_id': 'req-82605c1c-019a-45da-8f81-55823abf8442'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:27.320717 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-82605c1c-019a-45da-8f81-55823abf8442 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6bbef7411a0404aa6059a8d2553bf19', 'request_id': 'req-82605c1c-019a-45da-8f81-55823abf8442'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:27.332600 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-82605c1c-019a-45da-8f81-55823abf8442 admin admin] The token cache is being invalidate because project f6bbef7411a0404aa6059a8d2553bf19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:54:27.332973 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-82605c1c-019a-45da-8f81-55823abf8442 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:27.334443 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-82605c1c-019a-45da-8f81-55823abf8442 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:27.336224 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 913/1824] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:54:27 2022] DELETE /identity/v3/projects/f6bbef7411a0404aa6059a8d2553bf19 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:27.340334 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa83c2-9ade-4d09-b2fe-0a5d41cfcb85 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:27.341888 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-7ffa83c2-9ade-4d09-b2fe-0a5d41cfcb85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:27.415433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa83c2-9ade-4d09-b2fe-0a5d41cfcb85 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:27.442764 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:27.476967 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea7ebb-cc1b-4b25-9029-bc76b7079d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:27.477877 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea7ebb-cc1b-4b25-9029-bc76b7079d75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:27.478172 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea7ebb-cc1b-4b25-9029-bc76b7079d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:27.478449 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea7ebb-cc1b-4b25-9029-bc76b7079d75 admin admin] PATH_INFO: `/v3/users/1fd6d2e077f9437ab3fefd8a3a0655b0` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:27.479668 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea7ebb-cc1b-4b25-9029-bc76b7079d75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fd6d2e077f9437ab3fefd8a3a0655b0)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:27.481602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea7ebb-cc1b-4b25-9029-bc76b7079d75 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:27.520525 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82605c1c-019a-45da-8f81-55823abf8442 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:27.522350 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-82605c1c-019a-45da-8f81-55823abf8442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:27.536943 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82605c1c-019a-45da-8f81-55823abf8442 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:27.545084 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6f1ab-35ce-4ed0-a01f-6b3a7d27713f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:27.546487 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6f1ab-35ce-4ed0-a01f-6b3a7d27713f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:27.546921 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6f1ab-35ce-4ed0-a01f-6b3a7d27713f admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:27.548461 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6f1ab-35ce-4ed0-a01f-6b3a7d27713f admin admin] PATH_INFO: `/v3/projects/dee21f6ca8744a22b66b326477962441` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:27.550373 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6f1ab-35ce-4ed0-a01f-6b3a7d27713f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dee21f6ca8744a22b66b326477962441)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:27.551211 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-fcea7ebb-cc1b-4b25-9029-bc76b7079d75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fd6d2e077f9437ab3fefd8a3a0655b0'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:27.553593 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6f1ab-35ce-4ed0-a01f-6b3a7d27713f admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:27.562065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-fcea7ebb-cc1b-4b25-9029-bc76b7079d75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fd6d2e077f9437ab3fefd8a3a0655b0'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:27.571433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-fcea7ebb-cc1b-4b25-9029-bc76b7079d75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fd6d2e077f9437ab3fefd8a3a0655b0'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:27.572063 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-fcea7ebb-cc1b-4b25-9029-bc76b7079d75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fd6d2e077f9437ab3fefd8a3a0655b0'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:27.585123 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-fcea7ebb-cc1b-4b25-9029-bc76b7079d75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fd6d2e077f9437ab3fefd8a3a0655b0'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:27.592442 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 912/1825] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:54:27 2022] DELETE /identity/v3/users/1fd6d2e077f9437ab3fefd8a3a0655b0 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:27.608067 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-4ff6f1ab-35ce-4ed0-a01f-6b3a7d27713f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dee21f6ca8744a22b66b326477962441', 'request_id': 'req-4ff6f1ab-35ce-4ed0-a01f-6b3a7d27713f'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:27.616612 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-4ff6f1ab-35ce-4ed0-a01f-6b3a7d27713f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dee21f6ca8744a22b66b326477962441', 'request_id': 'req-4ff6f1ab-35ce-4ed0-a01f-6b3a7d27713f'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:27.627933 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-4ff6f1ab-35ce-4ed0-a01f-6b3a7d27713f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dee21f6ca8744a22b66b326477962441', 'request_id': 'req-4ff6f1ab-35ce-4ed0-a01f-6b3a7d27713f'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:27.640299 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-4ff6f1ab-35ce-4ed0-a01f-6b3a7d27713f admin admin] The token cache is being invalidate because project dee21f6ca8744a22b66b326477962441 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:54:27.640590 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-4ff6f1ab-35ce-4ed0-a01f-6b3a7d27713f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:27.641263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-4ff6f1ab-35ce-4ed0-a01f-6b3a7d27713f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:27.646108 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 914/1826] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:54:27 2022] DELETE /identity/v3/projects/dee21f6ca8744a22b66b326477962441 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:54:27.647598 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea7ebb-cc1b-4b25-9029-bc76b7079d75 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:27.649000 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-fcea7ebb-cc1b-4b25-9029-bc76b7079d75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:27.727910 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea7ebb-cc1b-4b25-9029-bc76b7079d75 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:27.785313 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:27.793131 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815aee2-da85-4336-b34a-1cb4d4a40afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:27.794245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815aee2-da85-4336-b34a-1cb4d4a40afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:27.794640 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815aee2-da85-4336-b34a-1cb4d4a40afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:27.795089 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815aee2-da85-4336-b34a-1cb4d4a40afe admin admin] PATH_INFO: `/v3/users/60af543769154f00b8a8f226fb497791` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:27.796662 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815aee2-da85-4336-b34a-1cb4d4a40afe admin admin] RBAC: Authorizing `identity:delete_user(user_id=60af543769154f00b8a8f226fb497791)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:27.798821 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815aee2-da85-4336-b34a-1cb4d4a40afe admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:27.853337 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f815aee2-da85-4336-b34a-1cb4d4a40afe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60af543769154f00b8a8f226fb497791'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:27.863946 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f815aee2-da85-4336-b34a-1cb4d4a40afe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60af543769154f00b8a8f226fb497791'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:27.876814 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6f1ab-35ce-4ed0-a01f-6b3a7d27713f admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:27.878332 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-4ff6f1ab-35ce-4ed0-a01f-6b3a7d27713f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:27.885571 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f815aee2-da85-4336-b34a-1cb4d4a40afe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60af543769154f00b8a8f226fb497791'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:27.886500 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f815aee2-da85-4336-b34a-1cb4d4a40afe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60af543769154f00b8a8f226fb497791'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:27.893642 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6f1ab-35ce-4ed0-a01f-6b3a7d27713f admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:27.899568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6652cae-4f13-4fff-86d8-2223386a134a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:27.900474 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6652cae-4f13-4fff-86d8-2223386a134a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:27.900756 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6652cae-4f13-4fff-86d8-2223386a134a admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:27.901079 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6652cae-4f13-4fff-86d8-2223386a134a admin admin] PATH_INFO: `/v3/projects/c8d3f35a2c154964989c1ceade495907` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:27.902312 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6652cae-4f13-4fff-86d8-2223386a134a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8d3f35a2c154964989c1ceade495907)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:27.904392 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6652cae-4f13-4fff-86d8-2223386a134a admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:27.927185 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f815aee2-da85-4336-b34a-1cb4d4a40afe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60af543769154f00b8a8f226fb497791'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:27.941391 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 913/1827] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:54:27 2022] DELETE /identity/v3/users/60af543769154f00b8a8f226fb497791 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:27.979549 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-b6652cae-4f13-4fff-86d8-2223386a134a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8d3f35a2c154964989c1ceade495907', 'request_id': 'req-b6652cae-4f13-4fff-86d8-2223386a134a'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:27.989470 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-b6652cae-4f13-4fff-86d8-2223386a134a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8d3f35a2c154964989c1ceade495907', 'request_id': 'req-b6652cae-4f13-4fff-86d8-2223386a134a'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:27.997678 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-b6652cae-4f13-4fff-86d8-2223386a134a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8d3f35a2c154964989c1ceade495907', 'request_id': 'req-b6652cae-4f13-4fff-86d8-2223386a134a'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:28.014724 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-b6652cae-4f13-4fff-86d8-2223386a134a admin admin] The token cache is being invalidate because project c8d3f35a2c154964989c1ceade495907 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:54:28.014999 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-b6652cae-4f13-4fff-86d8-2223386a134a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:28.015661 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-b6652cae-4f13-4fff-86d8-2223386a134a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:28.023263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 915/1828] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:54:27 2022] DELETE /identity/v3/projects/c8d3f35a2c154964989c1ceade495907 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:28.024346 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b9fba-d076-4430-a466-59a4977f8ff5 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:28.024707 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b9fba-d076-4430-a466-59a4977f8ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:28.025637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b9fba-d076-4430-a466-59a4977f8ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:28.051627 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-9f4b9fba-d076-4430-a466-59a4977f8ff5 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:28.053699 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9f4b9fba-d076-4430-a466-59a4977f8ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:28.129409 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 914/1829] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:54:28.137237 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e50c06-7341-49e5-bbd8-7e3e17f1788c None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:28.137522 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e50c06-7341-49e5-bbd8-7e3e17f1788c None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:28.137800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e50c06-7341-49e5-bbd8-7e3e17f1788c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:28.157539 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-59e50c06-7341-49e5-bbd8-7e3e17f1788c None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:28.158767 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-59e50c06-7341-49e5-bbd8-7e3e17f1788c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:28.169634 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 916/1830] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:54:28.174096 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b9fba-d076-4430-a466-59a4977f8ff5 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:28.185714 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b9fba-d076-4430-a466-59a4977f8ff5 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:28.191298 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aebc398-58a9-4dfb-b2c2-454aa9ff1394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:28.192049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebc398-58a9-4dfb-b2c2-454aa9ff1394 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:28.192332 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebc398-58a9-4dfb-b2c2-454aa9ff1394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:28.192758 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebc398-58a9-4dfb-b2c2-454aa9ff1394 admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:28.194253 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aebc398-58a9-4dfb-b2c2-454aa9ff1394 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:54:28.194574 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aebc398-58a9-4dfb-b2c2-454aa9ff1394 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:28.196250 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aebc398-58a9-4dfb-b2c2-454aa9ff1394 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:28.216223 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 915/1831] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:54:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:54:28.218663 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e50c06-7341-49e5-bbd8-7e3e17f1788c None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:28.229620 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e50c06-7341-49e5-bbd8-7e3e17f1788c None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:28.235256 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b616037-71de-4141-9180-4add6bb7d28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:28.236302 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b616037-71de-4141-9180-4add6bb7d28e admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:28.236425 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b616037-71de-4141-9180-4add6bb7d28e admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:28.236737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b616037-71de-4141-9180-4add6bb7d28e admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:28.237511 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b616037-71de-4141-9180-4add6bb7d28e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:28.240179 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b616037-71de-4141-9180-4add6bb7d28e admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:28.243665 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=76,keystone:DELETE=21,keystone:INSERT=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:28.269668 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aebc398-58a9-4dfb-b2c2-454aa9ff1394 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:28.271750 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-4aebc398-58a9-4dfb-b2c2-454aa9ff1394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:28.289365 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 917/1832] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:54:28 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:54:28.292709 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b616037-71de-4141-9180-4add6bb7d28e admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:28.300872 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aebc398-58a9-4dfb-b2c2-454aa9ff1394 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:28.379732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01367a-b3d8-447b-b821-caddfe80c5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:28.379962 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b616037-71de-4141-9180-4add6bb7d28e admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:28.380815 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01367a-b3d8-447b-b821-caddfe80c5fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:28.381124 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01367a-b3d8-447b-b821-caddfe80c5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:28.381402 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01367a-b3d8-447b-b821-caddfe80c5fd admin admin] PATH_INFO: `/v3/projects/32c0853471fe41b2b9fa73dba3f6f448` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:28.382848 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c01367a-b3d8-447b-b821-caddfe80c5fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=32c0853471fe41b2b9fa73dba3f6f448)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:28.384864 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c01367a-b3d8-447b-b821-caddfe80c5fd admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:28.387091 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f2831-9447-4ca7-bc6c-666e819e1e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:28.387541 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:28.388038 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f2831-9447-4ca7-bc6c-666e819e1e7a admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:28.388662 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f2831-9447-4ca7-bc6c-666e819e1e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:28.388958 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f2831-9447-4ca7-bc6c-666e819e1e7a admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:28.389691 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f2831-9447-4ca7-bc6c-666e819e1e7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:28.392370 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f2831-9447-4ca7-bc6c-666e819e1e7a admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:28.419180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 918/1833] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:54:28 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:54:28.423435 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f2831-9447-4ca7-bc6c-666e819e1e7a admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:28.434341 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f2831-9447-4ca7-bc6c-666e819e1e7a admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:28.459310 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7c01367a-b3d8-447b-b821-caddfe80c5fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32c0853471fe41b2b9fa73dba3f6f448', 'request_id': 'req-7c01367a-b3d8-447b-b821-caddfe80c5fd'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:28.469207 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7c01367a-b3d8-447b-b821-caddfe80c5fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32c0853471fe41b2b9fa73dba3f6f448', 'request_id': 'req-7c01367a-b3d8-447b-b821-caddfe80c5fd'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:28.476505 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7c01367a-b3d8-447b-b821-caddfe80c5fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32c0853471fe41b2b9fa73dba3f6f448', 'request_id': 'req-7c01367a-b3d8-447b-b821-caddfe80c5fd'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:28.496428 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7c01367a-b3d8-447b-b821-caddfe80c5fd admin admin] The token cache is being invalidate because project 32c0853471fe41b2b9fa73dba3f6f448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:54:28.496713 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7c01367a-b3d8-447b-b821-caddfe80c5fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:28.497389 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7c01367a-b3d8-447b-b821-caddfe80c5fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:28.499273 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 916/1834] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:54:28 2022] DELETE /identity/v3/projects/32c0853471fe41b2b9fa73dba3f6f448 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:28.499384 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbd37b-986e-4ed8-8b24-910ea6879a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:28.500126 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbd37b-986e-4ed8-8b24-910ea6879a02 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:28.500945 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbd37b-986e-4ed8-8b24-910ea6879a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:28.500945 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbd37b-986e-4ed8-8b24-910ea6879a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:28.502384 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbd37b-986e-4ed8-8b24-910ea6879a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:28.503730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbd37b-986e-4ed8-8b24-910ea6879a02 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:28.504618 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3c25f-f808-44f6-ab4e-f5d883774657 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:28.504903 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3c25f-f808-44f6-ab4e-f5d883774657 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:28.505324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3c25f-f808-44f6-ab4e-f5d883774657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:28.519359 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 919/1835] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:54:28.522272 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbd37b-986e-4ed8-8b24-910ea6879a02 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:28.524303 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-51fbd37b-986e-4ed8-8b24-910ea6879a02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:28.528276 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-aff3c25f-f808-44f6-ab4e-f5d883774657 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:28.529509 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-aff3c25f-f808-44f6-ab4e-f5d883774657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:28.538021 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 917/1836] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:54:28.546202 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c2ff2-fe26-4254-9a70-5acbbd64ac71 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:28.546593 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c2ff2-fe26-4254-9a70-5acbbd64ac71 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:28.546947 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c2ff2-fe26-4254-9a70-5acbbd64ac71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:28.561702 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbd37b-986e-4ed8-8b24-910ea6879a02 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:28.566885 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98235c33-20a3-41eb-b731-1ad0e4ea256e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:28.567734 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98235c33-20a3-41eb-b731-1ad0e4ea256e admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:28.568027 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98235c33-20a3-41eb-b731-1ad0e4ea256e admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:28.568304 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98235c33-20a3-41eb-b731-1ad0e4ea256e admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:28.569298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98235c33-20a3-41eb-b731-1ad0e4ea256e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:28.570951 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98235c33-20a3-41eb-b731-1ad0e4ea256e admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:28.574205 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-696c2ff2-fe26-4254-9a70-5acbbd64ac71 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:28.575501 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-696c2ff2-fe26-4254-9a70-5acbbd64ac71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:28.582329 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 920/1837] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:54:28.586534 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98235c33-20a3-41eb-b731-1ad0e4ea256e admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:28.595300 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 918/1838] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:54:28.596852 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c2ff2-fe26-4254-9a70-5acbbd64ac71 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:28.597939 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98235c33-20a3-41eb-b731-1ad0e4ea256e admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:28.602880 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2b0df-5593-4939-b38e-e0cc3a1ff0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:28.603815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2b0df-5593-4939-b38e-e0cc3a1ff0b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:28.604227 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2b0df-5593-4939-b38e-e0cc3a1ff0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:28.604722 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2b0df-5593-4939-b38e-e0cc3a1ff0b2 admin admin] PATH_INFO: `/v3/projects/1b287e2c13804003b46fd1a7c89c2222/users/6b5b660d0c5b4ccc8ee61f82b32e13d0/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:28.606164 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c2ff2-fe26-4254-9a70-5acbbd64ac71 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:28.612221 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abe202-bf2c-4a37-8d0a-0c85ab264f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:28.612880 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abe202-bf2c-4a37-8d0a-0c85ab264f64 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:28.613162 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abe202-bf2c-4a37-8d0a-0c85ab264f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:28.613443 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abe202-bf2c-4a37-8d0a-0c85ab264f64 admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:28.614167 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abe202-bf2c-4a37-8d0a-0c85ab264f64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:54:28.614608 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abe202-bf2c-4a37-8d0a-0c85ab264f64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:28.616279 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abe202-bf2c-4a37-8d0a-0c85ab264f64 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:28.626943 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2b0df-5593-4939-b38e-e0cc3a1ff0b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b287e2c13804003b46fd1a7c89c2222, user_id=6b5b660d0c5b4ccc8ee61f82b32e13d0, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:28.631092 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2b0df-5593-4939-b38e-e0cc3a1ff0b2 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:28.635359 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 919/1839] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:54:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:54:28.636738 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abe202-bf2c-4a37-8d0a-0c85ab264f64 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:28.645956 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 921/1840] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:54:28 2022] PUT /identity/v3/projects/1b287e2c13804003b46fd1a7c89c2222/users/6b5b660d0c5b4ccc8ee61f82b32e13d0/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:28.647024 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abe202-bf2c-4a37-8d0a-0c85ab264f64 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:28.657559 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a711f-ef8f-4883-ac2f-eb490e3f449a None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:28.657912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a711f-ef8f-4883-ac2f-eb490e3f449a None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:28.658293 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a711f-ef8f-4883-ac2f-eb490e3f449a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:28.685276 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-b75a711f-ef8f-4883-ac2f-eb490e3f449a None None] MFA Rules not processed for user `6b5b660d0c5b4ccc8ee61f82b32e13d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:28.686496 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-b75a711f-ef8f-4883-ac2f-eb490e3f449a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:28.705298 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2ae34-39ed-4982-85fd-48a514c034aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:28.705970 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2ae34-39ed-4982-85fd-48a514c034aa admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:28.706254 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2ae34-39ed-4982-85fd-48a514c034aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:28.706531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2ae34-39ed-4982-85fd-48a514c034aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:28.707254 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2ae34-39ed-4982-85fd-48a514c034aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:28.709223 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2ae34-39ed-4982-85fd-48a514c034aa admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:28.711302 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:28.737508 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 920/1841] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:54:28 2022] POST /identity/v3/projects => generated 363 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:54:28.741491 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2ae34-39ed-4982-85fd-48a514c034aa admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:28.762089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 922/1842] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:54:28.763233 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a711f-ef8f-4883-ac2f-eb490e3f449a None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:28.774314 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a711f-ef8f-4883-ac2f-eb490e3f449a None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:28.795782 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:28.807983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2ae34-39ed-4982-85fd-48a514c034aa admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:28.814179 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23269387-ab3f-4dc2-b86b-5fdb7ce7f4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:28.814903 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23269387-ab3f-4dc2-b86b-5fdb7ce7f4db admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:28.815214 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23269387-ab3f-4dc2-b86b-5fdb7ce7f4db admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:28.815496 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23269387-ab3f-4dc2-b86b-5fdb7ce7f4db admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:28.816193 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23269387-ab3f-4dc2-b86b-5fdb7ce7f4db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:28.818469 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23269387-ab3f-4dc2-b86b-5fdb7ce7f4db admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:28.833587 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af2f23-33c6-4560-bd73-80ed88ad33e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:28.834470 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af2f23-33c6-4560-bd73-80ed88ad33e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:28.834753 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af2f23-33c6-4560-bd73-80ed88ad33e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:28.835034 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af2f23-33c6-4560-bd73-80ed88ad33e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:28.835763 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af2f23-33c6-4560-bd73-80ed88ad33e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:28.837672 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af2f23-33c6-4560-bd73-80ed88ad33e2 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:28.838615 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 921/1843] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:54:28 2022] POST /identity/v3/users => generated 282 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:54:28.843090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23269387-ab3f-4dc2-b86b-5fdb7ce7f4db admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:28.852477 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23269387-ab3f-4dc2-b86b-5fdb7ce7f4db admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:28.857431 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8ba02-27cc-426e-b380-c88f4febace6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:28.858181 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8ba02-27cc-426e-b380-c88f4febace6 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:28.858517 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8ba02-27cc-426e-b380-c88f4febace6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:28.858793 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8ba02-27cc-426e-b380-c88f4febace6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:28.859563 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a8ba02-27cc-426e-b380-c88f4febace6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:28.861230 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a8ba02-27cc-426e-b380-c88f4febace6 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:28.867692 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 923/1844] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:54:28 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:54:28.871864 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 922/1845] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:54:28.872017 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af2f23-33c6-4560-bd73-80ed88ad33e2 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:28.875446 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8ba02-27cc-426e-b380-c88f4febace6 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:28.885349 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8ba02-27cc-426e-b380-c88f4febace6 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:28.948294 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493d10e-fb93-4727-b654-15eb55c05155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:28.949208 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493d10e-fb93-4727-b654-15eb55c05155 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:28.949526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493d10e-fb93-4727-b654-15eb55c05155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:28.949803 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493d10e-fb93-4727-b654-15eb55c05155 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:28.950575 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493d10e-fb93-4727-b654-15eb55c05155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:28.952443 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493d10e-fb93-4727-b654-15eb55c05155 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:28.964872 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 923/1846] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:54:28.969193 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493d10e-fb93-4727-b654-15eb55c05155 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:28.980940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493d10e-fb93-4727-b654-15eb55c05155 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:28.986714 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee53f47-ba09-46a4-b1f7-f02d2717bbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:28.987719 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee53f47-ba09-46a4-b1f7-f02d2717bbc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:28.988024 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee53f47-ba09-46a4-b1f7-f02d2717bbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:28.988308 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee53f47-ba09-46a4-b1f7-f02d2717bbc5 admin admin] PATH_INFO: `/v3/projects/b6e5f9625f794a99ba7d68baaf08d850/users/8834b2df0cb74d7a92fb0af695a31510/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:29.006772 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee53f47-ba09-46a4-b1f7-f02d2717bbc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6e5f9625f794a99ba7d68baaf08d850, user_id=8834b2df0cb74d7a92fb0af695a31510, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:29.009497 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee53f47-ba09-46a4-b1f7-f02d2717bbc5 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:29.025617 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 924/1847] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:54:28 2022] PUT /identity/v3/projects/b6e5f9625f794a99ba7d68baaf08d850/users/8834b2df0cb74d7a92fb0af695a31510/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:54:29.036786 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1df41-7d84-4349-b4bb-4c54dc3ef46a None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:29.037102 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1df41-7d84-4349-b4bb-4c54dc3ef46a None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:29.037385 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1df41-7d84-4349-b4bb-4c54dc3ef46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:29.064067 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-95d1df41-7d84-4349-b4bb-4c54dc3ef46a None None] MFA Rules not processed for user `8834b2df0cb74d7a92fb0af695a31510`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:29.065512 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-95d1df41-7d84-4349-b4bb-4c54dc3ef46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:29.070038 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af2f23-33c6-4560-bd73-80ed88ad33e2 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:29.119080 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:29.125709 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84479e-cc44-4482-91fe-e5ee3a362d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:29.127033 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84479e-cc44-4482-91fe-e5ee3a362d71 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:29.127371 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84479e-cc44-4482-91fe-e5ee3a362d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:29.127652 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84479e-cc44-4482-91fe-e5ee3a362d71 admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:29.128360 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84479e-cc44-4482-91fe-e5ee3a362d71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:29.131288 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84479e-cc44-4482-91fe-e5ee3a362d71 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:29.139479 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 925/1848] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:29 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:54:29.147433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1df41-7d84-4349-b4bb-4c54dc3ef46a None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:29.148841 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-95d1df41-7d84-4349-b4bb-4c54dc3ef46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:29.154020 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 924/1849] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:54:28 2022] POST /identity/v3/users => generated 294 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:54:29.157555 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84479e-cc44-4482-91fe-e5ee3a362d71 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:29.167794 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84479e-cc44-4482-91fe-e5ee3a362d71 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:29.172476 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905727b-b882-42cf-8dae-67ec4f6f2f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:29.173130 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905727b-b882-42cf-8dae-67ec4f6f2f79 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:29.173408 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905727b-b882-42cf-8dae-67ec4f6f2f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:29.173679 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905727b-b882-42cf-8dae-67ec4f6f2f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:29.174397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905727b-b882-42cf-8dae-67ec4f6f2f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:29.176048 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905727b-b882-42cf-8dae-67ec4f6f2f79 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:29.183586 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:29.187713 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 925/1850] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:54:29.191804 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905727b-b882-42cf-8dae-67ec4f6f2f79 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:29.201932 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905727b-b882-42cf-8dae-67ec4f6f2f79 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:29.206894 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdddfe-16a6-4833-ac1a-194012899b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:29.207577 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdddfe-16a6-4833-ac1a-194012899b0a admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:29.207856 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdddfe-16a6-4833-ac1a-194012899b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:29.208156 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdddfe-16a6-4833-ac1a-194012899b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:29.209466 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bdddfe-16a6-4833-ac1a-194012899b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:29.209586 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1df41-7d84-4349-b4bb-4c54dc3ef46a None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:29.211050 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bdddfe-16a6-4833-ac1a-194012899b0a admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:29.213124 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96cde98-ec41-42e2-8f34-39e03649f02f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:29.213782 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cde98-ec41-42e2-8f34-39e03649f02f service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:29.214067 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cde98-ec41-42e2-8f34-39e03649f02f service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:29.214352 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cde98-ec41-42e2-8f34-39e03649f02f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:29.221586 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 926/1851] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:54:29.225002 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96cde98-ec41-42e2-8f34-39e03649f02f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:29.225548 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96cde98-ec41-42e2-8f34-39e03649f02f service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:29.226050 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdddfe-16a6-4833-ac1a-194012899b0a admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:29.235681 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 926/1852] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:54:29 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:54:29.235823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdddfe-16a6-4833-ac1a-194012899b0a admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:29.240820 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a67517-0944-4970-81c8-778ea9952555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:29.241754 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a67517-0944-4970-81c8-778ea9952555 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:29.241974 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a67517-0944-4970-81c8-778ea9952555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:29.242247 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a67517-0944-4970-81c8-778ea9952555 admin admin] PATH_INFO: `/v3/projects/56339839a9834407b847d0e208b8fa10/users/7edb595eb3fb4027a593f78cc76dd462/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:29.257033 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a67517-0944-4970-81c8-778ea9952555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56339839a9834407b847d0e208b8fa10, user_id=7edb595eb3fb4027a593f78cc76dd462, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:29.259700 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a67517-0944-4970-81c8-778ea9952555 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:29.273845 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 927/1853] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:54:29 2022] PUT /identity/v3/projects/56339839a9834407b847d0e208b8fa10/users/7edb595eb3fb4027a593f78cc76dd462/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:54:29.284156 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbe62c-3ee7-4b43-b65e-813a6c6c1777 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:29.284427 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbe62c-3ee7-4b43-b65e-813a6c6c1777 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:29.284703 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbe62c-3ee7-4b43-b65e-813a6c6c1777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:29.312275 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-bffbe62c-3ee7-4b43-b65e-813a6c6c1777 None None] MFA Rules not processed for user `7edb595eb3fb4027a593f78cc76dd462`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:29.313476 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-bffbe62c-3ee7-4b43-b65e-813a6c6c1777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:29.404661 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 927/1854] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:54:29.408943 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a67517-0944-4970-81c8-778ea9952555 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:29.490994 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a67517-0944-4970-81c8-778ea9952555 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:29.496149 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ff58c-9404-4252-96be-19c9436263c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:29.496854 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ff58c-9404-4252-96be-19c9436263c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:29.497178 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ff58c-9404-4252-96be-19c9436263c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:29.497458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ff58c-9404-4252-96be-19c9436263c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:29.498354 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ff58c-9404-4252-96be-19c9436263c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:29.500597 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ff58c-9404-4252-96be-19c9436263c8 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:29.539759 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 928/1855] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:54:29 2022] POST /identity/v3/projects => generated 387 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:54:29.544396 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbe62c-3ee7-4b43-b65e-813a6c6c1777 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:29.560579 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbe62c-3ee7-4b43-b65e-813a6c6c1777 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:29.681916 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42a2bc-235f-4c13-a326-2fd5a8e993ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:29.682602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42a2bc-235f-4c13-a326-2fd5a8e993ed admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:29.682889 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42a2bc-235f-4c13-a326-2fd5a8e993ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:29.683194 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42a2bc-235f-4c13-a326-2fd5a8e993ed admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:29.683911 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42a2bc-235f-4c13-a326-2fd5a8e993ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:29.685817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42a2bc-235f-4c13-a326-2fd5a8e993ed admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:29.706356 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 928/1856] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:54:29 2022] POST /identity/v3/users => generated 300 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:54:29.710463 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ff58c-9404-4252-96be-19c9436263c8 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:29.721260 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ff58c-9404-4252-96be-19c9436263c8 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:29.726102 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab386c00-4d67-4859-aca8-e805cfeb273e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:29.726879 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab386c00-4d67-4859-aca8-e805cfeb273e admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:29.727257 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab386c00-4d67-4859-aca8-e805cfeb273e admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:29.727721 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab386c00-4d67-4859-aca8-e805cfeb273e admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:29.728526 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab386c00-4d67-4859-aca8-e805cfeb273e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:29.730191 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab386c00-4d67-4859-aca8-e805cfeb273e admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:29.740841 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 929/1857] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:54:29.745087 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42a2bc-235f-4c13-a326-2fd5a8e993ed admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:29.755414 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42a2bc-235f-4c13-a326-2fd5a8e993ed admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:29.760365 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e23ec-1f1e-4141-9646-8b62b0dd3199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:29.761274 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e23ec-1f1e-4141-9646-8b62b0dd3199 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:29.761553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e23ec-1f1e-4141-9646-8b62b0dd3199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:29.761818 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e23ec-1f1e-4141-9646-8b62b0dd3199 admin admin] PATH_INFO: `/v3/projects/1bafaec3fe024aac950765347cc57fa5/users/b38c5bc728224fbd9efe0b4472514582/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:29.783091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e23ec-1f1e-4141-9646-8b62b0dd3199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bafaec3fe024aac950765347cc57fa5, user_id=b38c5bc728224fbd9efe0b4472514582, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:29.785846 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e23ec-1f1e-4141-9646-8b62b0dd3199 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:29.811104 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 929/1858] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:54:29 2022] PUT /identity/v3/projects/1bafaec3fe024aac950765347cc57fa5/users/b38c5bc728224fbd9efe0b4472514582/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:29.815068 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab386c00-4d67-4859-aca8-e805cfeb273e admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:29.827694 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab386c00-4d67-4859-aca8-e805cfeb273e admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:29.906642 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8729bff-6571-4c8a-8ead-84172a770754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:29.907603 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8729bff-6571-4c8a-8ead-84172a770754 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:29.907984 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8729bff-6571-4c8a-8ead-84172a770754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:29.908357 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8729bff-6571-4c8a-8ead-84172a770754 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:29.909194 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8729bff-6571-4c8a-8ead-84172a770754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:29.910960 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8729bff-6571-4c8a-8ead-84172a770754 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:29.922239 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 930/1859] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:54:29.926108 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e23ec-1f1e-4141-9646-8b62b0dd3199 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:29.937105 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e23ec-1f1e-4141-9646-8b62b0dd3199 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:29.941914 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b33f5-5684-4705-b6f5-12b2ec884885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:29.942965 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b33f5-5684-4705-b6f5-12b2ec884885 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:29.943263 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b33f5-5684-4705-b6f5-12b2ec884885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:29.943543 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b33f5-5684-4705-b6f5-12b2ec884885 admin admin] PATH_INFO: `/v3/projects/1bafaec3fe024aac950765347cc57fa5/users/b38c5bc728224fbd9efe0b4472514582/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:29.945521 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b33f5-5684-4705-b6f5-12b2ec884885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bafaec3fe024aac950765347cc57fa5, user_id=b38c5bc728224fbd9efe0b4472514582, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:29.948282 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b33f5-5684-4705-b6f5-12b2ec884885 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:29.961674 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 930/1860] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:54:29 2022] PUT /identity/v3/projects/1bafaec3fe024aac950765347cc57fa5/users/b38c5bc728224fbd9efe0b4472514582/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:29.973506 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a836cc7-aec4-4023-bd43-a042462ec797 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:29.973931 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a836cc7-aec4-4023-bd43-a042462ec797 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:29.974848 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a836cc7-aec4-4023-bd43-a042462ec797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:29.994874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:30.002583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-0a836cc7-aec4-4023-bd43-a042462ec797 None None] MFA Rules not processed for user `b38c5bc728224fbd9efe0b4472514582`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:30.004603 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-0a836cc7-aec4-4023-bd43-a042462ec797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:30.077546 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 931/1861] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:54:30.089369 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b33f5-5684-4705-b6f5-12b2ec884885 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:30.108239 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:30.147216 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b33f5-5684-4705-b6f5-12b2ec884885 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:30.151126 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4948c-9fa8-4d9b-8f1e-352d46f84aca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:30.151775 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4948c-9fa8-4d9b-8f1e-352d46f84aca service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:30.152057 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4948c-9fa8-4d9b-8f1e-352d46f84aca service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:30.152328 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4948c-9fa8-4d9b-8f1e-352d46f84aca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:30.161554 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e4948c-9fa8-4d9b-8f1e-352d46f84aca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:30.163093 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e4948c-9fa8-4d9b-8f1e-352d46f84aca service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:30.172520 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 931/1862] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:54:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:54:30.770575 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a836cc7-aec4-4023-bd43-a042462ec797 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:30.780216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a836cc7-aec4-4023-bd43-a042462ec797 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:30.783760 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b5249-7153-40e8-a51e-4d8c0f4b420c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:30.784439 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b5249-7153-40e8-a51e-4d8c0f4b420c service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:30.784707 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b5249-7153-40e8-a51e-4d8c0f4b420c service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:30.784982 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b5249-7153-40e8-a51e-4d8c0f4b420c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:30.848206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b5249-7153-40e8-a51e-4d8c0f4b420c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:30.850255 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b5249-7153-40e8-a51e-4d8c0f4b420c service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:30.863301 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 932/1863] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:54:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:54:40.168274 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=19 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:40.466282 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4948c-9fa8-4d9b-8f1e-352d46f84aca service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:40.469629 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-d2e4948c-9fa8-4d9b-8f1e-352d46f84aca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:40.480234 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4948c-9fa8-4d9b-8f1e-352d46f84aca service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:40.483949 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e885ab-6a1e-44f8-9ed3-ff5dce8e103b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:40.484602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e885ab-6a1e-44f8-9ed3-ff5dce8e103b service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:40.484905 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e885ab-6a1e-44f8-9ed3-ff5dce8e103b service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:40.485179 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e885ab-6a1e-44f8-9ed3-ff5dce8e103b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:40.550014 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e885ab-6a1e-44f8-9ed3-ff5dce8e103b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:40.551505 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e885ab-6a1e-44f8-9ed3-ff5dce8e103b service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:40.564835 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b5249-7153-40e8-a51e-4d8c0f4b420c service cinder] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:40.567458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-242b5249-7153-40e8-a51e-4d8c0f4b420c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:40.568402 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 932/1864] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:54:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:54:40.662515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b5249-7153-40e8-a51e-4d8c0f4b420c service cinder] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:40.667592 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141939d-ecf0-406e-bf71-1cccaf7724a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:40.668699 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141939d-ecf0-406e-bf71-1cccaf7724a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:40.668947 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141939d-ecf0-406e-bf71-1cccaf7724a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:40.669227 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141939d-ecf0-406e-bf71-1cccaf7724a5 admin admin] PATH_INFO: `/v3/users/c554436dc7284656b1ffd0a086a480fd` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:40.670426 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141939d-ecf0-406e-bf71-1cccaf7724a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c554436dc7284656b1ffd0a086a480fd)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:40.672394 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141939d-ecf0-406e-bf71-1cccaf7724a5 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:40.715310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:40.733118 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-c141939d-ecf0-406e-bf71-1cccaf7724a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c554436dc7284656b1ffd0a086a480fd'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:40.741445 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-c141939d-ecf0-406e-bf71-1cccaf7724a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c554436dc7284656b1ffd0a086a480fd'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:40.751014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-c141939d-ecf0-406e-bf71-1cccaf7724a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c554436dc7284656b1ffd0a086a480fd'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:40.752368 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-c141939d-ecf0-406e-bf71-1cccaf7724a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c554436dc7284656b1ffd0a086a480fd'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:40.768150 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-c141939d-ecf0-406e-bf71-1cccaf7724a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c554436dc7284656b1ffd0a086a480fd'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:40.778576 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 933/1865] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:54:40 2022] DELETE /identity/v3/users/c554436dc7284656b1ffd0a086a480fd => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:40.780560 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb949f-7c2a-4094-88f0-9a9e75859e98 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:40.784915 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb949f-7c2a-4094-88f0-9a9e75859e98 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:40.785282 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb949f-7c2a-4094-88f0-9a9e75859e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:40.807815 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-71bb949f-7c2a-4094-88f0-9a9e75859e98 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:40.809049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-71bb949f-7c2a-4094-88f0-9a9e75859e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:40.876918 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 933/1866] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:54:40.887925 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141939d-ecf0-406e-bf71-1cccaf7724a5 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:40.890024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-c141939d-ecf0-406e-bf71-1cccaf7724a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:40.945257 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb949f-7c2a-4094-88f0-9a9e75859e98 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:40.946935 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-71bb949f-7c2a-4094-88f0-9a9e75859e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:40.959950 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb949f-7c2a-4094-88f0-9a9e75859e98 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:40.965075 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70140a28-a182-42df-8550-a6380f138557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:40.966251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70140a28-a182-42df-8550-a6380f138557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:40.966544 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70140a28-a182-42df-8550-a6380f138557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:40.966822 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70140a28-a182-42df-8550-a6380f138557 admin admin] PATH_INFO: `/v3/users/42b8dbe338754ef49c831635abad8d1c` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:40.968119 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70140a28-a182-42df-8550-a6380f138557 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42b8dbe338754ef49c831635abad8d1c)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:40.970087 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70140a28-a182-42df-8550-a6380f138557 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:40.986008 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141939d-ecf0-406e-bf71-1cccaf7724a5 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:40.991263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa02f06-8bc0-4cb5-beda-bd4a1a5d9306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:40.992189 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa02f06-8bc0-4cb5-beda-bd4a1a5d9306 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:40.992671 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa02f06-8bc0-4cb5-beda-bd4a1a5d9306 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:40.993124 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa02f06-8bc0-4cb5-beda-bd4a1a5d9306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:41.006205 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa02f06-8bc0-4cb5-beda-bd4a1a5d9306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:41.009262 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa02f06-8bc0-4cb5-beda-bd4a1a5d9306 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:41.038383 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-70140a28-a182-42df-8550-a6380f138557 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42b8dbe338754ef49c831635abad8d1c'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:41.039348 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 934/1867] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:54:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:54:41.047246 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-70140a28-a182-42df-8550-a6380f138557 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42b8dbe338754ef49c831635abad8d1c'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:41.058623 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-70140a28-a182-42df-8550-a6380f138557 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42b8dbe338754ef49c831635abad8d1c'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:41.059648 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-70140a28-a182-42df-8550-a6380f138557 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42b8dbe338754ef49c831635abad8d1c'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:41.077316 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-70140a28-a182-42df-8550-a6380f138557 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42b8dbe338754ef49c831635abad8d1c'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:41.085912 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 934/1868] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:54:40 2022] DELETE /identity/v3/users/42b8dbe338754ef49c831635abad8d1c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:41.091369 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cb0f8-8659-40f7-a599-1aaac0471ba0 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:41.091674 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cb0f8-8659-40f7-a599-1aaac0471ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:41.091933 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cb0f8-8659-40f7-a599-1aaac0471ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:41.124774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-ee7cb0f8-8659-40f7-a599-1aaac0471ba0 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:41.126185 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-ee7cb0f8-8659-40f7-a599-1aaac0471ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:41.216803 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 935/1869] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:54:41.236724 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70140a28-a182-42df-8550-a6380f138557 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:41.238360 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-70140a28-a182-42df-8550-a6380f138557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:41.269686 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:41.351745 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70140a28-a182-42df-8550-a6380f138557 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:41.359617 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a009fe0-8b69-40ca-87e1-63b8f795a862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:41.360501 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a009fe0-8b69-40ca-87e1-63b8f795a862 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:41.360889 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a009fe0-8b69-40ca-87e1-63b8f795a862 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:41.361271 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a009fe0-8b69-40ca-87e1-63b8f795a862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:41.384296 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a009fe0-8b69-40ca-87e1-63b8f795a862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:41.385949 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a009fe0-8b69-40ca-87e1-63b8f795a862 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:41.398415 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 935/1870] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:54:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:54:41.562378 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cb0f8-8659-40f7-a599-1aaac0471ba0 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:41.564530 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-ee7cb0f8-8659-40f7-a599-1aaac0471ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:41.577283 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cb0f8-8659-40f7-a599-1aaac0471ba0 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:41.582769 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a26018-ff74-4577-bdeb-e92238466459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:41.583768 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a26018-ff74-4577-bdeb-e92238466459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:41.584236 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a26018-ff74-4577-bdeb-e92238466459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:41.584520 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a26018-ff74-4577-bdeb-e92238466459 admin admin] PATH_INFO: `/v3/projects/7adcac785b54407a90a963881c27b491` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:41.585728 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a26018-ff74-4577-bdeb-e92238466459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7adcac785b54407a90a963881c27b491)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:41.587777 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a26018-ff74-4577-bdeb-e92238466459 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:41.654626 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a4a26018-ff74-4577-bdeb-e92238466459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7adcac785b54407a90a963881c27b491', 'request_id': 'req-a4a26018-ff74-4577-bdeb-e92238466459'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:41.657327 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:41.669503 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a4a26018-ff74-4577-bdeb-e92238466459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7adcac785b54407a90a963881c27b491', 'request_id': 'req-a4a26018-ff74-4577-bdeb-e92238466459'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:41.677078 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a4a26018-ff74-4577-bdeb-e92238466459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7adcac785b54407a90a963881c27b491', 'request_id': 'req-a4a26018-ff74-4577-bdeb-e92238466459'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:41.698624 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a4a26018-ff74-4577-bdeb-e92238466459 admin admin] The token cache is being invalidate because project 7adcac785b54407a90a963881c27b491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:54:41.698849 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a4a26018-ff74-4577-bdeb-e92238466459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:41.699568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a4a26018-ff74-4577-bdeb-e92238466459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:41.701416 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 936/1871] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:54:41 2022] DELETE /identity/v3/projects/7adcac785b54407a90a963881c27b491 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:41.705469 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a009fe0-8b69-40ca-87e1-63b8f795a862 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:41.719542 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a009fe0-8b69-40ca-87e1-63b8f795a862 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:41.799982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a445c-a7b5-4b30-9408-721db1787043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:41.802582 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a445c-a7b5-4b30-9408-721db1787043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:41.804129 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a445c-a7b5-4b30-9408-721db1787043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:41.804665 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a445c-a7b5-4b30-9408-721db1787043 admin admin] PATH_INFO: `/v3/users/76954589b9374ab1baee4027af8aca75` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:41.806749 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a445c-a7b5-4b30-9408-721db1787043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76954589b9374ab1baee4027af8aca75)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:41.809319 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a445c-a7b5-4b30-9408-721db1787043 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:41.830165 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a26018-ff74-4577-bdeb-e92238466459 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:41.832733 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-a4a26018-ff74-4577-bdeb-e92238466459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:41.854139 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a26018-ff74-4577-bdeb-e92238466459 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:41.859719 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286bec3-003c-4e54-bf36-aa7cbb8f4b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:41.861092 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286bec3-003c-4e54-bf36-aa7cbb8f4b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:41.861664 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286bec3-003c-4e54-bf36-aa7cbb8f4b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:41.862368 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286bec3-003c-4e54-bf36-aa7cbb8f4b40 admin admin] PATH_INFO: `/v3/projects/78b6b7d905f1408fb72f27c1794103eb` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:41.864538 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286bec3-003c-4e54-bf36-aa7cbb8f4b40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78b6b7d905f1408fb72f27c1794103eb)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:41.867459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286bec3-003c-4e54-bf36-aa7cbb8f4b40 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:41.885787 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-572a445c-a7b5-4b30-9408-721db1787043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76954589b9374ab1baee4027af8aca75'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:41.895134 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-572a445c-a7b5-4b30-9408-721db1787043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76954589b9374ab1baee4027af8aca75'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:41.910526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-572a445c-a7b5-4b30-9408-721db1787043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76954589b9374ab1baee4027af8aca75'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:41.911177 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-572a445c-a7b5-4b30-9408-721db1787043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76954589b9374ab1baee4027af8aca75'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:41.945313 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-7286bec3-003c-4e54-bf36-aa7cbb8f4b40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78b6b7d905f1408fb72f27c1794103eb', 'request_id': 'req-7286bec3-003c-4e54-bf36-aa7cbb8f4b40'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:41.950207 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-572a445c-a7b5-4b30-9408-721db1787043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76954589b9374ab1baee4027af8aca75'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:41.969159 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 936/1872] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:54:41 2022] DELETE /identity/v3/users/76954589b9374ab1baee4027af8aca75 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:41.973323 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-7286bec3-003c-4e54-bf36-aa7cbb8f4b40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78b6b7d905f1408fb72f27c1794103eb', 'request_id': 'req-7286bec3-003c-4e54-bf36-aa7cbb8f4b40'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:41.980244 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-7286bec3-003c-4e54-bf36-aa7cbb8f4b40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78b6b7d905f1408fb72f27c1794103eb', 'request_id': 'req-7286bec3-003c-4e54-bf36-aa7cbb8f4b40'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:41.993731 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-7286bec3-003c-4e54-bf36-aa7cbb8f4b40 admin admin] The token cache is being invalidate because project 78b6b7d905f1408fb72f27c1794103eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:54:41.994105 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-7286bec3-003c-4e54-bf36-aa7cbb8f4b40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:41.994891 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-7286bec3-003c-4e54-bf36-aa7cbb8f4b40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:42.000634 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a445c-a7b5-4b30-9408-721db1787043 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:42.001123 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 937/1873] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:54:41 2022] DELETE /identity/v3/projects/78b6b7d905f1408fb72f27c1794103eb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:42.002096 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-572a445c-a7b5-4b30-9408-721db1787043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:42.057938 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:42.108480 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a445c-a7b5-4b30-9408-721db1787043 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:42.114638 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6ca45-f47b-4a01-b1e5-5a61d9b696f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:42.116437 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6ca45-f47b-4a01-b1e5-5a61d9b696f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:42.116944 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6ca45-f47b-4a01-b1e5-5a61d9b696f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:42.117395 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6ca45-f47b-4a01-b1e5-5a61d9b696f9 admin admin] PATH_INFO: `/v3/users/47fe7c730e1743e1be9cd3cb53e891f0` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:42.119379 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6ca45-f47b-4a01-b1e5-5a61d9b696f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47fe7c730e1743e1be9cd3cb53e891f0)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:42.121904 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6ca45-f47b-4a01-b1e5-5a61d9b696f9 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:42.219347 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-72a6ca45-f47b-4a01-b1e5-5a61d9b696f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47fe7c730e1743e1be9cd3cb53e891f0'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:42.231112 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-72a6ca45-f47b-4a01-b1e5-5a61d9b696f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47fe7c730e1743e1be9cd3cb53e891f0'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:42.254839 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-72a6ca45-f47b-4a01-b1e5-5a61d9b696f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47fe7c730e1743e1be9cd3cb53e891f0'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:42.258519 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-72a6ca45-f47b-4a01-b1e5-5a61d9b696f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47fe7c730e1743e1be9cd3cb53e891f0'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:42.279296 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-72a6ca45-f47b-4a01-b1e5-5a61d9b696f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47fe7c730e1743e1be9cd3cb53e891f0'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:42.287274 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 937/1874] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:54:41 2022] DELETE /identity/v3/users/47fe7c730e1743e1be9cd3cb53e891f0 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:54:42.687408 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286bec3-003c-4e54-bf36-aa7cbb8f4b40 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:42.688785 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-7286bec3-003c-4e54-bf36-aa7cbb8f4b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:42.783995 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286bec3-003c-4e54-bf36-aa7cbb8f4b40 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:42.856270 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cdff6-6f1c-4322-91b8-d5c8ccff1057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:42.857190 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cdff6-6f1c-4322-91b8-d5c8ccff1057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:42.857458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cdff6-6f1c-4322-91b8-d5c8ccff1057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:42.857733 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cdff6-6f1c-4322-91b8-d5c8ccff1057 admin admin] PATH_INFO: `/v3/projects/4f7e52b655194c1d961c97bd365653ab` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:42.858941 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97cdff6-6f1c-4322-91b8-d5c8ccff1057 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f7e52b655194c1d961c97bd365653ab)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:42.861027 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97cdff6-6f1c-4322-91b8-d5c8ccff1057 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:42.878217 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:42.954356 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-c97cdff6-6f1c-4322-91b8-d5c8ccff1057 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f7e52b655194c1d961c97bd365653ab', 'request_id': 'req-c97cdff6-6f1c-4322-91b8-d5c8ccff1057'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:42.970739 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-c97cdff6-6f1c-4322-91b8-d5c8ccff1057 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f7e52b655194c1d961c97bd365653ab', 'request_id': 'req-c97cdff6-6f1c-4322-91b8-d5c8ccff1057'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:42.978110 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-c97cdff6-6f1c-4322-91b8-d5c8ccff1057 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f7e52b655194c1d961c97bd365653ab', 'request_id': 'req-c97cdff6-6f1c-4322-91b8-d5c8ccff1057'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:43.000241 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-c97cdff6-6f1c-4322-91b8-d5c8ccff1057 admin admin] The token cache is being invalidate because project 4f7e52b655194c1d961c97bd365653ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:54:43.000558 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-c97cdff6-6f1c-4322-91b8-d5c8ccff1057 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:43.001433 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-c97cdff6-6f1c-4322-91b8-d5c8ccff1057 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:43.011001 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 938/1875] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:54:42 2022] DELETE /identity/v3/projects/4f7e52b655194c1d961c97bd365653ab => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:43.011717 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a7a82-72d4-478e-b384-dd341d1280ae None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:43.012015 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a7a82-72d4-478e-b384-dd341d1280ae None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:43.012295 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a7a82-72d4-478e-b384-dd341d1280ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:43.031854 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cdff6-6f1c-4322-91b8-d5c8ccff1057 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:43.038269 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-c97cdff6-6f1c-4322-91b8-d5c8ccff1057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:43.051727 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-8a8a7a82-72d4-478e-b384-dd341d1280ae None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:43.055850 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-8a8a7a82-72d4-478e-b384-dd341d1280ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:43.161706 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cdff6-6f1c-4322-91b8-d5c8ccff1057 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:43.171748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 938/1876] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:54:43.174200 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428724c-f5e4-4fce-b965-206a136e0333 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:43.174615 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428724c-f5e4-4fce-b965-206a136e0333 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:43.174899 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428724c-f5e4-4fce-b965-206a136e0333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:43.175709 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5db33a-35da-407f-9939-7ff58e2d874b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:43.176802 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5db33a-35da-407f-9939-7ff58e2d874b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:43.177292 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5db33a-35da-407f-9939-7ff58e2d874b admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:43.177790 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5db33a-35da-407f-9939-7ff58e2d874b admin admin] PATH_INFO: `/v3/projects/7c512e1de2de499688d1126b14dd477e` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:43.179668 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5db33a-35da-407f-9939-7ff58e2d874b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c512e1de2de499688d1126b14dd477e)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:43.182394 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5db33a-35da-407f-9939-7ff58e2d874b admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:43.213348 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-6428724c-f5e4-4fce-b965-206a136e0333 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:43.214561 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6428724c-f5e4-4fce-b965-206a136e0333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:43.224216 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 939/1877] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:54:43.228609 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428724c-f5e4-4fce-b965-206a136e0333 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:43.239503 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428724c-f5e4-4fce-b965-206a136e0333 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:43.257949 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ac5db33a-35da-407f-9939-7ff58e2d874b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c512e1de2de499688d1126b14dd477e', 'request_id': 'req-ac5db33a-35da-407f-9939-7ff58e2d874b'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:43.268084 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ac5db33a-35da-407f-9939-7ff58e2d874b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c512e1de2de499688d1126b14dd477e', 'request_id': 'req-ac5db33a-35da-407f-9939-7ff58e2d874b'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:43.275236 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ac5db33a-35da-407f-9939-7ff58e2d874b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c512e1de2de499688d1126b14dd477e', 'request_id': 'req-ac5db33a-35da-407f-9939-7ff58e2d874b'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:43.289768 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ac5db33a-35da-407f-9939-7ff58e2d874b admin admin] The token cache is being invalidate because project 7c512e1de2de499688d1126b14dd477e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:54:43.289996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ac5db33a-35da-407f-9939-7ff58e2d874b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:43.290652 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ac5db33a-35da-407f-9939-7ff58e2d874b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:43.292955 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 939/1878] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:54:43 2022] DELETE /identity/v3/projects/7c512e1de2de499688d1126b14dd477e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:43.294853 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:43.297632 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2658a-2b6c-4eab-a4bd-0adc794f751e None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:43.297983 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2658a-2b6c-4eab-a4bd-0adc794f751e None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:43.298268 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2658a-2b6c-4eab-a4bd-0adc794f751e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:43.312815 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5be614-963a-4a6f-b7bb-dd6f670bcf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:43.313977 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5be614-963a-4a6f-b7bb-dd6f670bcf1d admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:43.314299 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5be614-963a-4a6f-b7bb-dd6f670bcf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:43.314762 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5be614-963a-4a6f-b7bb-dd6f670bcf1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:43.315633 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5be614-963a-4a6f-b7bb-dd6f670bcf1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:54:43.315989 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5be614-963a-4a6f-b7bb-dd6f670bcf1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:43.317960 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5be614-963a-4a6f-b7bb-dd6f670bcf1d admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:43.322621 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-12f2658a-2b6c-4eab-a4bd-0adc794f751e None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:43.324370 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-12f2658a-2b6c-4eab-a4bd-0adc794f751e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:43.330954 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 940/1879] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:54:43.333259 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 940/1880] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:54:43.336457 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5be614-963a-4a6f-b7bb-dd6f670bcf1d admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:43.338310 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6c5be614-963a-4a6f-b7bb-dd6f670bcf1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:43.340656 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e66d6-c12a-43d2-a248-98f4716a1edc None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:43.340951 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e66d6-c12a-43d2-a248-98f4716a1edc None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:43.341398 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e66d6-c12a-43d2-a248-98f4716a1edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:43.355137 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5be614-963a-4a6f-b7bb-dd6f670bcf1d admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:43.360088 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-ac4e66d6-c12a-43d2-a248-98f4716a1edc None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:43.361459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-ac4e66d6-c12a-43d2-a248-98f4716a1edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:43.361640 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9537324-8017-496f-a9f4-8ae043e59dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:43.362324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9537324-8017-496f-a9f4-8ae043e59dba admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:43.362611 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9537324-8017-496f-a9f4-8ae043e59dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:43.362886 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9537324-8017-496f-a9f4-8ae043e59dba admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:43.363657 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9537324-8017-496f-a9f4-8ae043e59dba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:43.365873 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9537324-8017-496f-a9f4-8ae043e59dba admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:43.378165 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 941/1881] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:54:43.379262 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e66d6-c12a-43d2-a248-98f4716a1edc None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:43.392192 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e66d6-c12a-43d2-a248-98f4716a1edc None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:43.397650 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f000b-9951-4668-a778-d91f7a28cfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:43.398989 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f000b-9951-4668-a778-d91f7a28cfe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:43.399354 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f000b-9951-4668-a778-d91f7a28cfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:43.401010 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f000b-9951-4668-a778-d91f7a28cfe6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:43.401826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f000b-9951-4668-a778-d91f7a28cfe6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:54:43.402144 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f000b-9951-4668-a778-d91f7a28cfe6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:43.403872 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f000b-9951-4668-a778-d91f7a28cfe6 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:43.406064 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 941/1882] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:54:43 2022] POST /identity/v3/projects => generated 369 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:54:43.410254 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9537324-8017-496f-a9f4-8ae043e59dba admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:43.419635 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 942/1883] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:54:43.419788 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f000b-9951-4668-a778-d91f7a28cfe6 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:43.423199 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-282f000b-9951-4668-a778-d91f7a28cfe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:43.433118 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:43.437138 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f000b-9951-4668-a778-d91f7a28cfe6 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:43.479238 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9537324-8017-496f-a9f4-8ae043e59dba admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:43.485642 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a8df9-bbbc-487c-ac06-8af591efacea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:43.486593 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a8df9-bbbc-487c-ac06-8af591efacea admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:43.486990 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a8df9-bbbc-487c-ac06-8af591efacea admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:43.487310 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a8df9-bbbc-487c-ac06-8af591efacea admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:43.488016 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a8df9-bbbc-487c-ac06-8af591efacea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:43.490015 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a8df9-bbbc-487c-ac06-8af591efacea admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:43.503214 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c8c97-260d-4800-a1d9-dfaf63cc90be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:43.504448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c8c97-260d-4800-a1d9-dfaf63cc90be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:43.504831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c8c97-260d-4800-a1d9-dfaf63cc90be admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:43.505176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c8c97-260d-4800-a1d9-dfaf63cc90be admin admin] PATH_INFO: `/v3/users/6b5b660d0c5b4ccc8ee61f82b32e13d0` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:43.506700 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c8c97-260d-4800-a1d9-dfaf63cc90be admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b5b660d0c5b4ccc8ee61f82b32e13d0)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:43.509130 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c8c97-260d-4800-a1d9-dfaf63cc90be admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:43.515780 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 942/1884] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:54:43 2022] POST /identity/v3/users => generated 285 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:54:43.516369 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a8df9-bbbc-487c-ac06-8af591efacea admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:43.527140 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a8df9-bbbc-487c-ac06-8af591efacea admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:43.535221 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f230851-afdb-4fd3-8fc6-ce2938bd1553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:43.535992 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f230851-afdb-4fd3-8fc6-ce2938bd1553 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:43.536278 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f230851-afdb-4fd3-8fc6-ce2938bd1553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:43.536552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f230851-afdb-4fd3-8fc6-ce2938bd1553 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:43.537962 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f230851-afdb-4fd3-8fc6-ce2938bd1553 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:43.540899 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f230851-afdb-4fd3-8fc6-ce2938bd1553 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:43.564677 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-829c8c97-260d-4800-a1d9-dfaf63cc90be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b5b660d0c5b4ccc8ee61f82b32e13d0'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:43.573573 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 943/1885] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:54:43 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:54:43.573573 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f230851-afdb-4fd3-8fc6-ce2938bd1553 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:43.573807 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-829c8c97-260d-4800-a1d9-dfaf63cc90be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b5b660d0c5b4ccc8ee61f82b32e13d0'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:43.580419 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-829c8c97-260d-4800-a1d9-dfaf63cc90be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b5b660d0c5b4ccc8ee61f82b32e13d0'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:43.581213 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-829c8c97-260d-4800-a1d9-dfaf63cc90be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b5b660d0c5b4ccc8ee61f82b32e13d0'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:43.594004 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-829c8c97-260d-4800-a1d9-dfaf63cc90be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b5b660d0c5b4ccc8ee61f82b32e13d0'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:43.600224 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 943/1886] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:54:43 2022] DELETE /identity/v3/users/6b5b660d0c5b4ccc8ee61f82b32e13d0 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:43.600791 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c8c97-260d-4800-a1d9-dfaf63cc90be admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:43.602202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-829c8c97-260d-4800-a1d9-dfaf63cc90be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:43.645806 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f230851-afdb-4fd3-8fc6-ce2938bd1553 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:43.678441 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c8c97-260d-4800-a1d9-dfaf63cc90be admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:43.679442 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:43.685070 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecddf2dd-6af4-4880-972c-220f44750e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:43.685775 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddf2dd-6af4-4880-972c-220f44750e80 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:43.686062 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddf2dd-6af4-4880-972c-220f44750e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:43.686342 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddf2dd-6af4-4880-972c-220f44750e80 admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:43.687115 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecddf2dd-6af4-4880-972c-220f44750e80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:43.689855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecddf2dd-6af4-4880-972c-220f44750e80 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:43.711701 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 944/1887] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:54:43 2022] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:54:43.712748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71fbf1-832a-42c6-9cdb-4083124f1f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:43.713427 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71fbf1-832a-42c6-9cdb-4083124f1f00 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:43.713709 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71fbf1-832a-42c6-9cdb-4083124f1f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:43.714124 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71fbf1-832a-42c6-9cdb-4083124f1f00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:43.714861 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71fbf1-832a-42c6-9cdb-4083124f1f00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:43.716452 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ecd39-82d5-4eeb-b837-bb87343d3f73 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:43.716615 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71fbf1-832a-42c6-9cdb-4083124f1f00 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:43.716894 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ecd39-82d5-4eeb-b837-bb87343d3f73 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:43.717230 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ecd39-82d5-4eeb-b837-bb87343d3f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:43.730658 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 944/1888] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:54:43.730658 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71fbf1-832a-42c6-9cdb-4083124f1f00 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:43.736614 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-7e4ecd39-82d5-4eeb-b837-bb87343d3f73 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:43.737821 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-7e4ecd39-82d5-4eeb-b837-bb87343d3f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:43.740254 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71fbf1-832a-42c6-9cdb-4083124f1f00 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:43.745417 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711f77b-c8f2-4efe-b36d-f651faac95f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:43.746092 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711f77b-c8f2-4efe-b36d-f651faac95f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:43.746380 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711f77b-c8f2-4efe-b36d-f651faac95f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:43.746489 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 945/1889] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:54:43.746674 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711f77b-c8f2-4efe-b36d-f651faac95f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:43.747466 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711f77b-c8f2-4efe-b36d-f651faac95f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:43.749068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711f77b-c8f2-4efe-b36d-f651faac95f8 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:43.750462 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ecd39-82d5-4eeb-b837-bb87343d3f73 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:43.751782 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-7e4ecd39-82d5-4eeb-b837-bb87343d3f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:43.764333 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ecd39-82d5-4eeb-b837-bb87343d3f73 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:43.771092 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 945/1890] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:54:43.771092 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711f77b-c8f2-4efe-b36d-f651faac95f8 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:43.773078 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49072e-3f15-4a4f-8cf9-f5e1e6b398fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:43.773237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9711f77b-c8f2-4efe-b36d-f651faac95f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:43.773823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49072e-3f15-4a4f-8cf9-f5e1e6b398fc admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:43.774552 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49072e-3f15-4a4f-8cf9-f5e1e6b398fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:43.774552 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49072e-3f15-4a4f-8cf9-f5e1e6b398fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:43.775098 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49072e-3f15-4a4f-8cf9-f5e1e6b398fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:43.781507 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49072e-3f15-4a4f-8cf9-f5e1e6b398fc admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:43.783274 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:43.795859 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 946/1891] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:54:43.797032 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49072e-3f15-4a4f-8cf9-f5e1e6b398fc admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:43.814224 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49072e-3f15-4a4f-8cf9-f5e1e6b398fc admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:43.821107 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafec4a6-6f57-4adb-b4c7-74d50434d92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:43.821911 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafec4a6-6f57-4adb-b4c7-74d50434d92c admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:43.822311 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafec4a6-6f57-4adb-b4c7-74d50434d92c admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:43.823256 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafec4a6-6f57-4adb-b4c7-74d50434d92c admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:43.823578 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafec4a6-6f57-4adb-b4c7-74d50434d92c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:43.825998 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafec4a6-6f57-4adb-b4c7-74d50434d92c admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:43.842458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 947/1892] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:54:43.848083 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafec4a6-6f57-4adb-b4c7-74d50434d92c admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:43.848709 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711f77b-c8f2-4efe-b36d-f651faac95f8 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:43.852790 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e6e3b-15c3-4f2e-95b8-7a933ac5869b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:43.853674 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e6e3b-15c3-4f2e-95b8-7a933ac5869b service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:43.853957 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e6e3b-15c3-4f2e-95b8-7a933ac5869b service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:43.854258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e6e3b-15c3-4f2e-95b8-7a933ac5869b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:43.858697 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafec4a6-6f57-4adb-b4c7-74d50434d92c admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:43.863402 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d592bd-ee29-4f5f-93dd-4e2e2290d0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:43.864362 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d592bd-ee29-4f5f-93dd-4e2e2290d0c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:43.864715 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d592bd-ee29-4f5f-93dd-4e2e2290d0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:43.865058 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d592bd-ee29-4f5f-93dd-4e2e2290d0c0 admin admin] PATH_INFO: `/v3/projects/1f2c9bc7fc4a41d8b49d1caf90388edf/users/fb20d8864c284408889ec0391a8bf36e/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:43.866480 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e6e3b-15c3-4f2e-95b8-7a933ac5869b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:43.867978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e6e3b-15c3-4f2e-95b8-7a933ac5869b service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:43.877586 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 946/1893] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:54:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:54:43.878368 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e6e3b-15c3-4f2e-95b8-7a933ac5869b service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:43.881058 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d592bd-ee29-4f5f-93dd-4e2e2290d0c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f2c9bc7fc4a41d8b49d1caf90388edf, user_id=fb20d8864c284408889ec0391a8bf36e, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:43.883848 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d592bd-ee29-4f5f-93dd-4e2e2290d0c0 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:43.887703 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e6e3b-15c3-4f2e-95b8-7a933ac5869b service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:43.893007 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73c8da-2b1d-43ba-9ecd-ef82871181e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:43.894005 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73c8da-2b1d-43ba-9ecd-ef82871181e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:43.894306 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73c8da-2b1d-43ba-9ecd-ef82871181e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:43.894779 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73c8da-2b1d-43ba-9ecd-ef82871181e2 admin admin] PATH_INFO: `/v3/projects/78f8102a6f7d444895eec3a128e8d4cd/users/a03cf946a5884f6587b9e587c1dd38c4/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:43.901397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 948/1894] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:54:43 2022] PUT /identity/v3/projects/1f2c9bc7fc4a41d8b49d1caf90388edf/users/fb20d8864c284408889ec0391a8bf36e/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:43.911447 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73c8da-2b1d-43ba-9ecd-ef82871181e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78f8102a6f7d444895eec3a128e8d4cd, user_id=a03cf946a5884f6587b9e587c1dd38c4, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:43.912440 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29259c-b70c-4fb7-934f-978e7d1dc990 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:43.913096 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29259c-b70c-4fb7-934f-978e7d1dc990 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:43.913096 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29259c-b70c-4fb7-934f-978e7d1dc990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:43.914162 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73c8da-2b1d-43ba-9ecd-ef82871181e2 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:43.933975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 947/1895] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:54:43 2022] PUT /identity/v3/projects/78f8102a6f7d444895eec3a128e8d4cd/users/a03cf946a5884f6587b9e587c1dd38c4/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:43.952990 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f80b62-5946-42cc-9885-edd6d07f1dcd None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:43.954037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-cf29259c-b70c-4fb7-934f-978e7d1dc990 None None] MFA Rules not processed for user `fb20d8864c284408889ec0391a8bf36e`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:43.955068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f80b62-5946-42cc-9885-edd6d07f1dcd None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:43.955284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-cf29259c-b70c-4fb7-934f-978e7d1dc990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:43.957385 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f80b62-5946-42cc-9885-edd6d07f1dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:43.994817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-e5f80b62-5946-42cc-9885-edd6d07f1dcd None None] MFA Rules not processed for user `a03cf946a5884f6587b9e587c1dd38c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:43.996425 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e5f80b62-5946-42cc-9885-edd6d07f1dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:44.056532 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 949/1896] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:54:44.062977 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29259c-b70c-4fb7-934f-978e7d1dc990 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:44.117829 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 948/1897] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:54:44.118928 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f80b62-5946-42cc-9885-edd6d07f1dcd None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:44.158064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29259c-b70c-4fb7-934f-978e7d1dc990 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:44.164337 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d87e4-1443-4124-8a77-4f9d69b2ad8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:44.165096 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d87e4-1443-4124-8a77-4f9d69b2ad8a admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:44.165528 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d87e4-1443-4124-8a77-4f9d69b2ad8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:44.166410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d87e4-1443-4124-8a77-4f9d69b2ad8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:44.167231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d87e4-1443-4124-8a77-4f9d69b2ad8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:44.169721 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d87e4-1443-4124-8a77-4f9d69b2ad8a admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:44.187943 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:44.214464 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 950/1898] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:54:44 2022] POST /identity/v3/projects => generated 367 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:54:44.215614 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d87e4-1443-4124-8a77-4f9d69b2ad8a admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:44.219702 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-316d87e4-1443-4124-8a77-4f9d69b2ad8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:44.230980 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f80b62-5946-42cc-9885-edd6d07f1dcd None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:44.282860 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:44.326189 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d87e4-1443-4124-8a77-4f9d69b2ad8a admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:44.330607 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5234e1-3920-432e-9790-1927b8f4b445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:44.331334 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468b85e-aadd-46b4-a4bb-4eea9c803fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:44.331660 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5234e1-3920-432e-9790-1927b8f4b445 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:44.332047 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5234e1-3920-432e-9790-1927b8f4b445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:44.332229 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468b85e-aadd-46b4-a4bb-4eea9c803fbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:44.332499 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5234e1-3920-432e-9790-1927b8f4b445 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:44.332604 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468b85e-aadd-46b4-a4bb-4eea9c803fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:44.332907 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468b85e-aadd-46b4-a4bb-4eea9c803fbc admin admin] PATH_INFO: `/v3/projects/1b287e2c13804003b46fd1a7c89c2222` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:44.334244 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468b85e-aadd-46b4-a4bb-4eea9c803fbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b287e2c13804003b46fd1a7c89c2222)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:44.334368 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5234e1-3920-432e-9790-1927b8f4b445 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:44.336451 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468b85e-aadd-46b4-a4bb-4eea9c803fbc admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:44.338066 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5234e1-3920-432e-9790-1927b8f4b445 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:44.373864 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 949/1899] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:54:44 2022] POST /identity/v3/projects => generated 385 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:54:44.376106 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5234e1-3920-432e-9790-1927b8f4b445 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:44.396858 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-9468b85e-aadd-46b4-a4bb-4eea9c803fbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b287e2c13804003b46fd1a7c89c2222', 'request_id': 'req-9468b85e-aadd-46b4-a4bb-4eea9c803fbc'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:44.411303 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-9468b85e-aadd-46b4-a4bb-4eea9c803fbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b287e2c13804003b46fd1a7c89c2222', 'request_id': 'req-9468b85e-aadd-46b4-a4bb-4eea9c803fbc'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:44.422953 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-9468b85e-aadd-46b4-a4bb-4eea9c803fbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b287e2c13804003b46fd1a7c89c2222', 'request_id': 'req-9468b85e-aadd-46b4-a4bb-4eea9c803fbc'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:44.441097 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-9468b85e-aadd-46b4-a4bb-4eea9c803fbc admin admin] The token cache is being invalidate because project 1b287e2c13804003b46fd1a7c89c2222 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:54:44.441392 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-9468b85e-aadd-46b4-a4bb-4eea9c803fbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:44.442113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-9468b85e-aadd-46b4-a4bb-4eea9c803fbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:44.443775 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 951/1900] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:54:44 2022] DELETE /identity/v3/projects/1b287e2c13804003b46fd1a7c89c2222 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:44.448035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468b85e-aadd-46b4-a4bb-4eea9c803fbc admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:44.449537 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-9468b85e-aadd-46b4-a4bb-4eea9c803fbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:44.457467 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5234e1-3920-432e-9790-1927b8f4b445 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:44.516774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468b85e-aadd-46b4-a4bb-4eea9c803fbc admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:44.518192 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74493db2-2a09-4d55-a5ea-2fa3eb76b62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:44.518899 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74493db2-2a09-4d55-a5ea-2fa3eb76b62e admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:44.519212 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74493db2-2a09-4d55-a5ea-2fa3eb76b62e admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:44.519489 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74493db2-2a09-4d55-a5ea-2fa3eb76b62e admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:44.520185 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74493db2-2a09-4d55-a5ea-2fa3eb76b62e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:44.522072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e276e44-3139-4773-8ddf-ded5ee5f1644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:44.522321 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e276e44-3139-4773-8ddf-ded5ee5f1644 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:44.522612 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e276e44-3139-4773-8ddf-ded5ee5f1644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:44.522891 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e276e44-3139-4773-8ddf-ded5ee5f1644 admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:44.523479 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74493db2-2a09-4d55-a5ea-2fa3eb76b62e admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:44.523624 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e276e44-3139-4773-8ddf-ded5ee5f1644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:44.525751 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e276e44-3139-4773-8ddf-ded5ee5f1644 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:44.534552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:44.548487 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 952/1901] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:54:44 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:54:44.549197 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 950/1902] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:54:44 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:54:44.549608 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e276e44-3139-4773-8ddf-ded5ee5f1644 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:44.551353 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-9e276e44-3139-4773-8ddf-ded5ee5f1644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:44.552222 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74493db2-2a09-4d55-a5ea-2fa3eb76b62e admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:44.564311 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74493db2-2a09-4d55-a5ea-2fa3eb76b62e admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:44.565122 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e276e44-3139-4773-8ddf-ded5ee5f1644 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:44.569496 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e72f6-3475-49ef-983a-e31a2335ad92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:44.569629 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e55c9-d1cc-4a8e-800b-c519b5c336f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:44.570413 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e72f6-3475-49ef-983a-e31a2335ad92 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:44.570542 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e55c9-d1cc-4a8e-800b-c519b5c336f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:44.570785 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e55c9-d1cc-4a8e-800b-c519b5c336f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:44.570889 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e72f6-3475-49ef-983a-e31a2335ad92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:44.571065 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e55c9-d1cc-4a8e-800b-c519b5c336f8 admin admin] PATH_INFO: `/v3/users/7edb595eb3fb4027a593f78cc76dd462` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:44.571246 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e72f6-3475-49ef-983a-e31a2335ad92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:44.572012 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e72f6-3475-49ef-983a-e31a2335ad92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:44.572427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e55c9-d1cc-4a8e-800b-c519b5c336f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7edb595eb3fb4027a593f78cc76dd462)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:44.573717 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e72f6-3475-49ef-983a-e31a2335ad92 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:44.574334 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e55c9-d1cc-4a8e-800b-c519b5c336f8 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:44.592269 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 951/1903] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:54:44.592269 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e72f6-3475-49ef-983a-e31a2335ad92 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:44.592269 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b32e72f6-3475-49ef-983a-e31a2335ad92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:44.604844 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e72f6-3475-49ef-983a-e31a2335ad92 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:44.610740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0cddb-2ccc-4bdf-aa1b-38e43674fe5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:44.611616 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0cddb-2ccc-4bdf-aa1b-38e43674fe5a admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:44.611928 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0cddb-2ccc-4bdf-aa1b-38e43674fe5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:44.612212 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0cddb-2ccc-4bdf-aa1b-38e43674fe5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:44.613243 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b0cddb-2ccc-4bdf-aa1b-38e43674fe5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:44.614840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b0cddb-2ccc-4bdf-aa1b-38e43674fe5a admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:44.625468 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-499e55c9-d1cc-4a8e-800b-c519b5c336f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7edb595eb3fb4027a593f78cc76dd462'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:44.627441 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 952/1904] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:54:44.628366 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0cddb-2ccc-4bdf-aa1b-38e43674fe5a admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:44.630493 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=82,keystone:DELETE=14,keystone:INSERT=4 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:44.633737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-499e55c9-d1cc-4a8e-800b-c519b5c336f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7edb595eb3fb4027a593f78cc76dd462'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:44.640334 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0cddb-2ccc-4bdf-aa1b-38e43674fe5a admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:44.642579 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-499e55c9-d1cc-4a8e-800b-c519b5c336f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7edb595eb3fb4027a593f78cc76dd462'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:44.643655 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-499e55c9-d1cc-4a8e-800b-c519b5c336f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7edb595eb3fb4027a593f78cc76dd462'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:44.645196 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8addb-b369-4def-96c1-a9e98d1f0212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:44.646089 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8addb-b369-4def-96c1-a9e98d1f0212 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:44.646378 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8addb-b369-4def-96c1-a9e98d1f0212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:44.646874 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8addb-b369-4def-96c1-a9e98d1f0212 admin admin] PATH_INFO: `/v3/projects/a644d1e899c54d49a94e653f2eba9010/users/efa8806c6d7748b5a82ea7b669e625e9/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:44.655854 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-499e55c9-d1cc-4a8e-800b-c519b5c336f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7edb595eb3fb4027a593f78cc76dd462'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:44.662846 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 953/1905] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:54:44 2022] DELETE /identity/v3/users/7edb595eb3fb4027a593f78cc76dd462 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:44.663059 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8addb-b369-4def-96c1-a9e98d1f0212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a644d1e899c54d49a94e653f2eba9010, user_id=efa8806c6d7748b5a82ea7b669e625e9, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:44.663863 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e55c9-d1cc-4a8e-800b-c519b5c336f8 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:44.665312 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-499e55c9-d1cc-4a8e-800b-c519b5c336f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:44.666388 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8addb-b369-4def-96c1-a9e98d1f0212 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:44.683177 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 953/1906] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:54:44 2022] PUT /identity/v3/projects/a644d1e899c54d49a94e653f2eba9010/users/efa8806c6d7748b5a82ea7b669e625e9/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:44.687249 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8addb-b369-4def-96c1-a9e98d1f0212 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:44.688896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-56e8addb-b369-4def-96c1-a9e98d1f0212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:44.735560 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e55c9-d1cc-4a8e-800b-c519b5c336f8 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:44.761711 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8addb-b369-4def-96c1-a9e98d1f0212 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:44.766551 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ade91-b602-430b-8324-876555ccbd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:44.767329 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ade91-b602-430b-8324-876555ccbd1a admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:44.767552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ade91-b602-430b-8324-876555ccbd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:44.767863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ade91-b602-430b-8324-876555ccbd1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:44.768601 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ade91-b602-430b-8324-876555ccbd1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:44.770224 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ade91-b602-430b-8324-876555ccbd1a admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:44.782405 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 954/1907] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:54:44.786438 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ade91-b602-430b-8324-876555ccbd1a admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:44.804714 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ade91-b602-430b-8324-876555ccbd1a admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:44.809978 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b2342-9d0d-46dd-95c9-8ab64f1dfea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:44.810292 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d708e-d27f-4470-ba55-6a5eeadddd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:44.811031 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b2342-9d0d-46dd-95c9-8ab64f1dfea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:44.811236 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d708e-d27f-4470-ba55-6a5eeadddd18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:44.811468 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b2342-9d0d-46dd-95c9-8ab64f1dfea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:44.811562 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d708e-d27f-4470-ba55-6a5eeadddd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:44.811822 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b2342-9d0d-46dd-95c9-8ab64f1dfea1 admin admin] PATH_INFO: `/v3/projects/f32156659ba840168e32dc2737d991e0/users/856b3890743647c7b9e4a93828b745b7/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:44.812060 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d708e-d27f-4470-ba55-6a5eeadddd18 admin admin] PATH_INFO: `/v3/projects/a644d1e899c54d49a94e653f2eba9010/users/efa8806c6d7748b5a82ea7b669e625e9/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:44.814283 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d708e-d27f-4470-ba55-6a5eeadddd18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a644d1e899c54d49a94e653f2eba9010, user_id=efa8806c6d7748b5a82ea7b669e625e9, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:44.818104 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d708e-d27f-4470-ba55-6a5eeadddd18 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:44.830837 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 955/1908] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:54:44 2022] PUT /identity/v3/projects/a644d1e899c54d49a94e653f2eba9010/users/efa8806c6d7748b5a82ea7b669e625e9/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:54:44.832936 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b2342-9d0d-46dd-95c9-8ab64f1dfea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f32156659ba840168e32dc2737d991e0, user_id=856b3890743647c7b9e4a93828b745b7, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:44.836094 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b2342-9d0d-46dd-95c9-8ab64f1dfea1 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:44.845758 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a87d9d-b1a2-491c-9431-fe053ea5d033 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:44.846468 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a87d9d-b1a2-491c-9431-fe053ea5d033 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:44.846857 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a87d9d-b1a2-491c-9431-fe053ea5d033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:44.851679 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 954/1909] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:54:44 2022] PUT /identity/v3/projects/f32156659ba840168e32dc2737d991e0/users/856b3890743647c7b9e4a93828b745b7/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:44.855719 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b2342-9d0d-46dd-95c9-8ab64f1dfea1 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:44.877661 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-76a87d9d-b1a2-491c-9431-fe053ea5d033 None None] MFA Rules not processed for user `efa8806c6d7748b5a82ea7b669e625e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:44.879085 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-76a87d9d-b1a2-491c-9431-fe053ea5d033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:44.931525 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:44.935581 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b2342-9d0d-46dd-95c9-8ab64f1dfea1 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:44.942871 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315161b4-2b79-4dd0-917c-f90e7d45931c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:44.943722 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315161b4-2b79-4dd0-917c-f90e7d45931c admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:44.944035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315161b4-2b79-4dd0-917c-f90e7d45931c admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:44.944288 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315161b4-2b79-4dd0-917c-f90e7d45931c admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:44.945088 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315161b4-2b79-4dd0-917c-f90e7d45931c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:44.947207 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315161b4-2b79-4dd0-917c-f90e7d45931c admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:44.958673 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 955/1910] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:54:44.959779 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 956/1911] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:54:44.964269 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315161b4-2b79-4dd0-917c-f90e7d45931c admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:44.972643 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a87d9d-b1a2-491c-9431-fe053ea5d033 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:44.974954 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-76a87d9d-b1a2-491c-9431-fe053ea5d033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:44.975427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315161b4-2b79-4dd0-917c-f90e7d45931c admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:44.980326 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff95df6-b979-4dc7-8c77-15b789dae5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:44.981243 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff95df6-b979-4dc7-8c77-15b789dae5da admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:44.981536 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff95df6-b979-4dc7-8c77-15b789dae5da admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:44.981954 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff95df6-b979-4dc7-8c77-15b789dae5da admin admin] PATH_INFO: `/v3/projects/f32156659ba840168e32dc2737d991e0/users/856b3890743647c7b9e4a93828b745b7/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:44.984009 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff95df6-b979-4dc7-8c77-15b789dae5da admin admin] RBAC: Authorizing `identity:create_grant(project_id=f32156659ba840168e32dc2737d991e0, user_id=856b3890743647c7b9e4a93828b745b7, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:44.986728 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff95df6-b979-4dc7-8c77-15b789dae5da admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:45.002924 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 956/1912] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:54:44 2022] PUT /identity/v3/projects/f32156659ba840168e32dc2737d991e0/users/856b3890743647c7b9e4a93828b745b7/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:45.010970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb8675-8ad6-49c0-a697-e22e9f6fb240 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:45.011308 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb8675-8ad6-49c0-a697-e22e9f6fb240 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:45.011419 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:45.017151 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb8675-8ad6-49c0-a697-e22e9f6fb240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:45.051573 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-8ffb8675-8ad6-49c0-a697-e22e9f6fb240 None None] MFA Rules not processed for user `856b3890743647c7b9e4a93828b745b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:45.052623 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-8ffb8675-8ad6-49c0-a697-e22e9f6fb240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:45.061975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a87d9d-b1a2-491c-9431-fe053ea5d033 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:45.121811 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788499b-ba0f-4ba7-80bc-692c00bbcb85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:45.124606 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788499b-ba0f-4ba7-80bc-692c00bbcb85 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:45.124895 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788499b-ba0f-4ba7-80bc-692c00bbcb85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:45.125171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788499b-ba0f-4ba7-80bc-692c00bbcb85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:45.156736 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 957/1913] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:45 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:54:45.160344 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb8675-8ad6-49c0-a697-e22e9f6fb240 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:45.160344 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-8ffb8675-8ad6-49c0-a697-e22e9f6fb240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:45.206499 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788499b-ba0f-4ba7-80bc-692c00bbcb85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:45.208135 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788499b-ba0f-4ba7-80bc-692c00bbcb85 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:45.221395 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 957/1914] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:54:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:54:45.222308 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788499b-ba0f-4ba7-80bc-692c00bbcb85 service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:45.223824 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e788499b-ba0f-4ba7-80bc-692c00bbcb85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:45.238884 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788499b-ba0f-4ba7-80bc-692c00bbcb85 service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:45.243676 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4e4ff-b860-4a7a-b709-aae20a09acc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:45.244278 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb8675-8ad6-49c0-a697-e22e9f6fb240 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:45.244401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4e4ff-b860-4a7a-b709-aae20a09acc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:45.245132 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4e4ff-b860-4a7a-b709-aae20a09acc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:45.245132 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4e4ff-b860-4a7a-b709-aae20a09acc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:45.254035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ce992-0355-4c63-8068-fb3adec46e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:45.254949 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ce992-0355-4c63-8068-fb3adec46e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:45.255262 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ce992-0355-4c63-8068-fb3adec46e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:45.255545 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ce992-0355-4c63-8068-fb3adec46e61 admin admin] PATH_INFO: `/v3/projects/56339839a9834407b847d0e208b8fa10` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:45.257532 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ce992-0355-4c63-8068-fb3adec46e61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56339839a9834407b847d0e208b8fa10)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:45.259706 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ce992-0355-4c63-8068-fb3adec46e61 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:45.263990 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b4e4ff-b860-4a7a-b709-aae20a09acc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:45.265432 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b4e4ff-b860-4a7a-b709-aae20a09acc1 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:45.287383 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 958/1915] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:54:45 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:54:45.300099 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4e4ff-b860-4a7a-b709-aae20a09acc1 service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:45.320491 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4e4ff-b860-4a7a-b709-aae20a09acc1 service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:45.333054 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e0db8-c0d9-4ec5-ab4a-adf7f317c1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:45.333951 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e0db8-c0d9-4ec5-ab4a-adf7f317c1bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:45.334431 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e0db8-c0d9-4ec5-ab4a-adf7f317c1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:45.336508 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e0db8-c0d9-4ec5-ab4a-adf7f317c1bc admin admin] PATH_INFO: `/v3/users/a03cf946a5884f6587b9e587c1dd38c4` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:45.338136 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e0db8-c0d9-4ec5-ab4a-adf7f317c1bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a03cf946a5884f6587b9e587c1dd38c4)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:45.340475 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e0db8-c0d9-4ec5-ab4a-adf7f317c1bc admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:45.349671 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-d13ce992-0355-4c63-8068-fb3adec46e61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56339839a9834407b847d0e208b8fa10', 'request_id': 'req-d13ce992-0355-4c63-8068-fb3adec46e61'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:45.375452 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-d13ce992-0355-4c63-8068-fb3adec46e61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56339839a9834407b847d0e208b8fa10', 'request_id': 'req-d13ce992-0355-4c63-8068-fb3adec46e61'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:45.386700 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-d13ce992-0355-4c63-8068-fb3adec46e61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56339839a9834407b847d0e208b8fa10', 'request_id': 'req-d13ce992-0355-4c63-8068-fb3adec46e61'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:45.388700 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:45.402801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-d13ce992-0355-4c63-8068-fb3adec46e61 admin admin] The token cache is being invalidate because project 56339839a9834407b847d0e208b8fa10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:54:45.403431 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-d13ce992-0355-4c63-8068-fb3adec46e61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:45.404143 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-d13ce992-0355-4c63-8068-fb3adec46e61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:45.405814 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 958/1916] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:54:45 2022] DELETE /identity/v3/projects/56339839a9834407b847d0e208b8fa10 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:45.409715 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ce992-0355-4c63-8068-fb3adec46e61 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:45.411133 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-d13ce992-0355-4c63-8068-fb3adec46e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:45.413186 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9c6e0db8-c0d9-4ec5-ab4a-adf7f317c1bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a03cf946a5884f6587b9e587c1dd38c4'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:45.421664 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9c6e0db8-c0d9-4ec5-ab4a-adf7f317c1bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a03cf946a5884f6587b9e587c1dd38c4'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:45.429732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9c6e0db8-c0d9-4ec5-ab4a-adf7f317c1bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a03cf946a5884f6587b9e587c1dd38c4'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:45.430813 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9c6e0db8-c0d9-4ec5-ab4a-adf7f317c1bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a03cf946a5884f6587b9e587c1dd38c4'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:45.432857 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:45.453099 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9c6e0db8-c0d9-4ec5-ab4a-adf7f317c1bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a03cf946a5884f6587b9e587c1dd38c4'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:45.461694 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 959/1917] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:54:45 2022] DELETE /identity/v3/users/a03cf946a5884f6587b9e587c1dd38c4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:54:45.466578 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216937e-5d8c-4944-bfc0-05c217383e0c None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:45.466869 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216937e-5d8c-4944-bfc0-05c217383e0c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:45.467169 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216937e-5d8c-4944-bfc0-05c217383e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:45.493064 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-d216937e-5d8c-4944-bfc0-05c217383e0c None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:45.495768 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-d216937e-5d8c-4944-bfc0-05c217383e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:45.515589 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ce992-0355-4c63-8068-fb3adec46e61 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:45.598800 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 960/1918] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:54:45.611697 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216937e-5d8c-4944-bfc0-05c217383e0c None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:45.613468 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-d216937e-5d8c-4944-bfc0-05c217383e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:45.616413 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80a4a9-f492-47c0-a6a6-8b852d67f903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:45.617515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80a4a9-f492-47c0-a6a6-8b852d67f903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:45.617744 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80a4a9-f492-47c0-a6a6-8b852d67f903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:45.618026 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80a4a9-f492-47c0-a6a6-8b852d67f903 admin admin] PATH_INFO: `/v3/users/b38c5bc728224fbd9efe0b4472514582` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:45.619916 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80a4a9-f492-47c0-a6a6-8b852d67f903 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b38c5bc728224fbd9efe0b4472514582)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:45.622056 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80a4a9-f492-47c0-a6a6-8b852d67f903 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:45.693298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-3c80a4a9-f492-47c0-a6a6-8b852d67f903 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b38c5bc728224fbd9efe0b4472514582'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:45.701719 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-3c80a4a9-f492-47c0-a6a6-8b852d67f903 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b38c5bc728224fbd9efe0b4472514582'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:45.712053 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-3c80a4a9-f492-47c0-a6a6-8b852d67f903 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b38c5bc728224fbd9efe0b4472514582'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:45.715364 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-3c80a4a9-f492-47c0-a6a6-8b852d67f903 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b38c5bc728224fbd9efe0b4472514582'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:45.715480 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216937e-5d8c-4944-bfc0-05c217383e0c None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:45.719064 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56595d36-0ce3-4f37-ad30-c14dfe915a74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:45.719778 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56595d36-0ce3-4f37-ad30-c14dfe915a74 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:45.720098 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56595d36-0ce3-4f37-ad30-c14dfe915a74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:45.720416 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56595d36-0ce3-4f37-ad30-c14dfe915a74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:45.728434 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-3c80a4a9-f492-47c0-a6a6-8b852d67f903 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b38c5bc728224fbd9efe0b4472514582'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:45.730991 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56595d36-0ce3-4f37-ad30-c14dfe915a74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:45.732459 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56595d36-0ce3-4f37-ad30-c14dfe915a74 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:45.738861 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 959/1919] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:54:45 2022] DELETE /identity/v3/users/b38c5bc728224fbd9efe0b4472514582 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:45.746650 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 961/1920] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:54:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:54:46.132262 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80a4a9-f492-47c0-a6a6-8b852d67f903 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:46.133998 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-3c80a4a9-f492-47c0-a6a6-8b852d67f903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:46.139364 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56595d36-0ce3-4f37-ad30-c14dfe915a74 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:46.142758 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-56595d36-0ce3-4f37-ad30-c14dfe915a74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:46.170732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56595d36-0ce3-4f37-ad30-c14dfe915a74 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:46.196317 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:46.246774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80a4a9-f492-47c0-a6a6-8b852d67f903 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:46.247092 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3ca36-8ed9-4c5c-9ff2-4295c1771c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:46.248480 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3ca36-8ed9-4c5c-9ff2-4295c1771c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:46.248700 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3ca36-8ed9-4c5c-9ff2-4295c1771c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:46.249082 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3ca36-8ed9-4c5c-9ff2-4295c1771c23 admin admin] PATH_INFO: `/v3/projects/1bafaec3fe024aac950765347cc57fa5` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:46.251018 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3ca36-8ed9-4c5c-9ff2-4295c1771c23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bafaec3fe024aac950765347cc57fa5)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:46.253179 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd333c4-91ac-43a2-bff6-397a1c26b017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:46.253825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3ca36-8ed9-4c5c-9ff2-4295c1771c23 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:46.254495 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd333c4-91ac-43a2-bff6-397a1c26b017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:46.255081 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd333c4-91ac-43a2-bff6-397a1c26b017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:46.255287 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd333c4-91ac-43a2-bff6-397a1c26b017 admin admin] PATH_INFO: `/v3/projects/78f8102a6f7d444895eec3a128e8d4cd` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:46.261539 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd333c4-91ac-43a2-bff6-397a1c26b017 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78f8102a6f7d444895eec3a128e8d4cd)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:46.261539 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd333c4-91ac-43a2-bff6-397a1c26b017 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:46.317286 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:46.345633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-cdd333c4-91ac-43a2-bff6-397a1c26b017 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78f8102a6f7d444895eec3a128e8d4cd', 'request_id': 'req-cdd333c4-91ac-43a2-bff6-397a1c26b017'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:46.353157 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-78b3ca36-8ed9-4c5c-9ff2-4295c1771c23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bafaec3fe024aac950765347cc57fa5', 'request_id': 'req-78b3ca36-8ed9-4c5c-9ff2-4295c1771c23'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:46.356217 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-cdd333c4-91ac-43a2-bff6-397a1c26b017 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78f8102a6f7d444895eec3a128e8d4cd', 'request_id': 'req-cdd333c4-91ac-43a2-bff6-397a1c26b017'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:46.362536 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-78b3ca36-8ed9-4c5c-9ff2-4295c1771c23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bafaec3fe024aac950765347cc57fa5', 'request_id': 'req-78b3ca36-8ed9-4c5c-9ff2-4295c1771c23'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:46.363318 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-cdd333c4-91ac-43a2-bff6-397a1c26b017 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78f8102a6f7d444895eec3a128e8d4cd', 'request_id': 'req-cdd333c4-91ac-43a2-bff6-397a1c26b017'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:46.375618 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-cdd333c4-91ac-43a2-bff6-397a1c26b017 admin admin] The token cache is being invalidate because project 78f8102a6f7d444895eec3a128e8d4cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:54:46.375916 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-cdd333c4-91ac-43a2-bff6-397a1c26b017 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:46.376179 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-78b3ca36-8ed9-4c5c-9ff2-4295c1771c23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bafaec3fe024aac950765347cc57fa5', 'request_id': 'req-78b3ca36-8ed9-4c5c-9ff2-4295c1771c23'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:46.376593 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-cdd333c4-91ac-43a2-bff6-397a1c26b017 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:46.378502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 960/1921] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:54:46 2022] DELETE /identity/v3/projects/78f8102a6f7d444895eec3a128e8d4cd => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:46.382169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd333c4-91ac-43a2-bff6-397a1c26b017 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:46.385225 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-cdd333c4-91ac-43a2-bff6-397a1c26b017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:46.397615 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-78b3ca36-8ed9-4c5c-9ff2-4295c1771c23 admin admin] The token cache is being invalidate because project 1bafaec3fe024aac950765347cc57fa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:54:46.398000 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-78b3ca36-8ed9-4c5c-9ff2-4295c1771c23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:46.399433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-78b3ca36-8ed9-4c5c-9ff2-4295c1771c23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:46.401504 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 962/1922] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:54:46 2022] DELETE /identity/v3/projects/1bafaec3fe024aac950765347cc57fa5 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:54:46.407400 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ce669-9c4a-440f-9b0e-3503b9d90b21 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:46.407762 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ce669-9c4a-440f-9b0e-3503b9d90b21 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:46.408156 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ce669-9c4a-440f-9b0e-3503b9d90b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:46.434970 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-ff8ce669-9c4a-440f-9b0e-3503b9d90b21 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:46.436773 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-ff8ce669-9c4a-440f-9b0e-3503b9d90b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:46.497513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd333c4-91ac-43a2-bff6-397a1c26b017 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:46.531538 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 963/1923] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:54:46.540230 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c82563-0fef-4558-bc8d-944e38b9d09c None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:46.540525 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c82563-0fef-4558-bc8d-944e38b9d09c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:46.540807 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c82563-0fef-4558-bc8d-944e38b9d09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:46.575373 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e46899-1093-4037-9112-3c52422942b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:46.576340 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e46899-1093-4037-9112-3c52422942b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:46.576629 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e46899-1093-4037-9112-3c52422942b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:46.576909 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e46899-1093-4037-9112-3c52422942b2 admin admin] PATH_INFO: `/v3/users/efa8806c6d7748b5a82ea7b669e625e9` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:46.578274 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e46899-1093-4037-9112-3c52422942b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efa8806c6d7748b5a82ea7b669e625e9)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:46.580306 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e46899-1093-4037-9112-3c52422942b2 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:46.580460 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-f3c82563-0fef-4558-bc8d-944e38b9d09c None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:46.581711 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-f3c82563-0fef-4558-bc8d-944e38b9d09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:46.582632 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:46.593815 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 964/1924] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:54:46.597487 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c82563-0fef-4558-bc8d-944e38b9d09c None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:46.609699 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c82563-0fef-4558-bc8d-944e38b9d09c None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:46.629679 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11d2c5-99c6-4ef1-b508-c55a0d67abbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:46.630373 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11d2c5-99c6-4ef1-b508-c55a0d67abbe admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:46.630779 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11d2c5-99c6-4ef1-b508-c55a0d67abbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:46.630967 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11d2c5-99c6-4ef1-b508-c55a0d67abbe admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:46.632041 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11d2c5-99c6-4ef1-b508-c55a0d67abbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:54:46.632222 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11d2c5-99c6-4ef1-b508-c55a0d67abbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:46.633931 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11d2c5-99c6-4ef1-b508-c55a0d67abbe admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:46.651470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 965/1925] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:54:46.655077 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11d2c5-99c6-4ef1-b508-c55a0d67abbe admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:46.663492 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a1e46899-1093-4037-9112-3c52422942b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efa8806c6d7748b5a82ea7b669e625e9'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:46.665899 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11d2c5-99c6-4ef1-b508-c55a0d67abbe admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:46.671000 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a1e46899-1093-4037-9112-3c52422942b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efa8806c6d7748b5a82ea7b669e625e9'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:46.673263 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31089e85-59cb-4442-89c3-18cab169fae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:46.674016 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31089e85-59cb-4442-89c3-18cab169fae0 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:46.674366 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31089e85-59cb-4442-89c3-18cab169fae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:46.674716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31089e85-59cb-4442-89c3-18cab169fae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:46.675520 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31089e85-59cb-4442-89c3-18cab169fae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:46.678001 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31089e85-59cb-4442-89c3-18cab169fae0 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:46.681260 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a1e46899-1093-4037-9112-3c52422942b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efa8806c6d7748b5a82ea7b669e625e9'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:46.682813 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a1e46899-1093-4037-9112-3c52422942b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efa8806c6d7748b5a82ea7b669e625e9'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:46.729604 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 966/1926] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:54:46 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:54:46.729992 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a1e46899-1093-4037-9112-3c52422942b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efa8806c6d7748b5a82ea7b669e625e9'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:46.732209 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31089e85-59cb-4442-89c3-18cab169fae0 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:46.733710 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-31089e85-59cb-4442-89c3-18cab169fae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:46.746475 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 961/1927] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:54:46 2022] DELETE /identity/v3/users/efa8806c6d7748b5a82ea7b669e625e9 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:46.849893 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31089e85-59cb-4442-89c3-18cab169fae0 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:46.880849 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:46.927107 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25991e38-a36e-4c6b-a35e-23320c29a000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:46.927907 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25991e38-a36e-4c6b-a35e-23320c29a000 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:46.928204 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25991e38-a36e-4c6b-a35e-23320c29a000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:46.928488 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25991e38-a36e-4c6b-a35e-23320c29a000 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:46.929329 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25991e38-a36e-4c6b-a35e-23320c29a000 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:46.931652 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25991e38-a36e-4c6b-a35e-23320c29a000 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:46.962204 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 967/1928] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:54:46 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:54:46.962793 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e46899-1093-4037-9112-3c52422942b2 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:46.973170 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e46899-1093-4037-9112-3c52422942b2 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:46.979265 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000f9ce-bafe-445a-b649-1a5603c6a311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:46.979930 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000f9ce-bafe-445a-b649-1a5603c6a311 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:46.980308 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000f9ce-bafe-445a-b649-1a5603c6a311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:46.980604 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000f9ce-bafe-445a-b649-1a5603c6a311 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:46.981327 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000f9ce-bafe-445a-b649-1a5603c6a311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:46.983032 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000f9ce-bafe-445a-b649-1a5603c6a311 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:46.993988 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 962/1929] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:54:46.998398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25991e38-a36e-4c6b-a35e-23320c29a000 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:47.007404 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000f9ce-bafe-445a-b649-1a5603c6a311 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:47.009290 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-a000f9ce-bafe-445a-b649-1a5603c6a311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:47.010144 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25991e38-a36e-4c6b-a35e-23320c29a000 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:47.014834 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e4b25-70c4-4893-b928-3bf0e744245d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:47.015542 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e4b25-70c4-4893-b928-3bf0e744245d admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:47.015827 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e4b25-70c4-4893-b928-3bf0e744245d admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:47.016106 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e4b25-70c4-4893-b928-3bf0e744245d admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:47.016838 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e4b25-70c4-4893-b928-3bf0e744245d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:47.018565 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e4b25-70c4-4893-b928-3bf0e744245d admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:47.023198 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000f9ce-bafe-445a-b649-1a5603c6a311 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:47.028357 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d00cb-de01-4711-83eb-bdf12c43aea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:47.029257 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d00cb-de01-4711-83eb-bdf12c43aea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:47.029370 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 968/1930] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:54:47.029537 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d00cb-de01-4711-83eb-bdf12c43aea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:47.029818 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d00cb-de01-4711-83eb-bdf12c43aea7 admin admin] PATH_INFO: `/v3/users/fb20d8864c284408889ec0391a8bf36e` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:47.031033 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d00cb-de01-4711-83eb-bdf12c43aea7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb20d8864c284408889ec0391a8bf36e)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:47.033477 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e4b25-70c4-4893-b928-3bf0e744245d admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:47.033631 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d00cb-de01-4711-83eb-bdf12c43aea7 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:47.044336 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e4b25-70c4-4893-b928-3bf0e744245d admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:47.049131 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37cf84-595a-49ec-a504-df5ebe821373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:47.050062 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37cf84-595a-49ec-a504-df5ebe821373 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:47.050323 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37cf84-595a-49ec-a504-df5ebe821373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:47.050621 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37cf84-595a-49ec-a504-df5ebe821373 admin admin] PATH_INFO: `/v3/projects/4334dd1c4b754d90b5c5e47df3503af0/users/9febb52c6a7c44e48a6ebab7ecbffff4/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:47.067711 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37cf84-595a-49ec-a504-df5ebe821373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4334dd1c4b754d90b5c5e47df3503af0, user_id=9febb52c6a7c44e48a6ebab7ecbffff4, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:47.070521 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37cf84-595a-49ec-a504-df5ebe821373 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:47.084903 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 969/1931] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:54:47 2022] PUT /identity/v3/projects/4334dd1c4b754d90b5c5e47df3503af0/users/9febb52c6a7c44e48a6ebab7ecbffff4/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:54:47.088266 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-b31d00cb-de01-4711-83eb-bdf12c43aea7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb20d8864c284408889ec0391a8bf36e'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:47.096624 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820c50b-29ee-4a3f-ac4c-3b84d0bf89cc None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:47.096865 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-b31d00cb-de01-4711-83eb-bdf12c43aea7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb20d8864c284408889ec0391a8bf36e'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:47.097067 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820c50b-29ee-4a3f-ac4c-3b84d0bf89cc None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:47.097360 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820c50b-29ee-4a3f-ac4c-3b84d0bf89cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:47.106625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-b31d00cb-de01-4711-83eb-bdf12c43aea7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb20d8864c284408889ec0391a8bf36e'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:47.108074 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-b31d00cb-de01-4711-83eb-bdf12c43aea7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb20d8864c284408889ec0391a8bf36e'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:47.125161 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-f820c50b-29ee-4a3f-ac4c-3b84d0bf89cc None None] MFA Rules not processed for user `9febb52c6a7c44e48a6ebab7ecbffff4`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:47.126089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-b31d00cb-de01-4711-83eb-bdf12c43aea7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb20d8864c284408889ec0391a8bf36e'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:47.126375 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-f820c50b-29ee-4a3f-ac4c-3b84d0bf89cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:47.134096 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 963/1932] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:54:47 2022] DELETE /identity/v3/users/fb20d8864c284408889ec0391a8bf36e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:47.135372 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d00cb-de01-4711-83eb-bdf12c43aea7 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:47.136434 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-b31d00cb-de01-4711-83eb-bdf12c43aea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:47.181357 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:47.193672 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 970/1933] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:54:47.197509 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b8dc7-872f-4e34-a16a-6209cddd7b6c None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:47.197509 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b8dc7-872f-4e34-a16a-6209cddd7b6c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:47.197509 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b8dc7-872f-4e34-a16a-6209cddd7b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:47.207691 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d00cb-de01-4711-83eb-bdf12c43aea7 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:47.212730 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-286b8dc7-872f-4e34-a16a-6209cddd7b6c None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:47.212851 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab50ca-6682-4212-84fb-88131fe6e9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:47.213759 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab50ca-6682-4212-84fb-88131fe6e9b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:47.213939 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-286b8dc7-872f-4e34-a16a-6209cddd7b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:47.214047 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab50ca-6682-4212-84fb-88131fe6e9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:47.214307 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab50ca-6682-4212-84fb-88131fe6e9b8 admin admin] PATH_INFO: `/v3/projects/a644d1e899c54d49a94e653f2eba9010` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:47.215545 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab50ca-6682-4212-84fb-88131fe6e9b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a644d1e899c54d49a94e653f2eba9010)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:47.217479 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab50ca-6682-4212-84fb-88131fe6e9b8 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:47.221504 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 971/1934] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:54:47.222263 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b8dc7-872f-4e34-a16a-6209cddd7b6c None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:47.223566 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-286b8dc7-872f-4e34-a16a-6209cddd7b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:47.235395 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b8dc7-872f-4e34-a16a-6209cddd7b6c None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:47.240110 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63616846-f80c-44ae-8e2e-7ff3a3fde1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:47.240833 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63616846-f80c-44ae-8e2e-7ff3a3fde1bd admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:47.241118 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63616846-f80c-44ae-8e2e-7ff3a3fde1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:47.241395 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63616846-f80c-44ae-8e2e-7ff3a3fde1bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:47.242096 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63616846-f80c-44ae-8e2e-7ff3a3fde1bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:47.244079 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63616846-f80c-44ae-8e2e-7ff3a3fde1bd admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:47.273770 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 972/1935] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:54:47 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:54:47.273964 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-83ab50ca-6682-4212-84fb-88131fe6e9b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a644d1e899c54d49a94e653f2eba9010', 'request_id': 'req-83ab50ca-6682-4212-84fb-88131fe6e9b8'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:47.274062 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63616846-f80c-44ae-8e2e-7ff3a3fde1bd admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:47.275607 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-63616846-f80c-44ae-8e2e-7ff3a3fde1bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:47.281216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-83ab50ca-6682-4212-84fb-88131fe6e9b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a644d1e899c54d49a94e653f2eba9010', 'request_id': 'req-83ab50ca-6682-4212-84fb-88131fe6e9b8'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:47.286979 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-83ab50ca-6682-4212-84fb-88131fe6e9b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a644d1e899c54d49a94e653f2eba9010', 'request_id': 'req-83ab50ca-6682-4212-84fb-88131fe6e9b8'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:47.299477 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-83ab50ca-6682-4212-84fb-88131fe6e9b8 admin admin] The token cache is being invalidate because project a644d1e899c54d49a94e653f2eba9010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:54:47.299878 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-83ab50ca-6682-4212-84fb-88131fe6e9b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:47.300543 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-83ab50ca-6682-4212-84fb-88131fe6e9b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:47.302191 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 964/1936] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:54:47 2022] DELETE /identity/v3/projects/a644d1e899c54d49a94e653f2eba9010 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:47.303446 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab50ca-6682-4212-84fb-88131fe6e9b8 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:47.304782 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-83ab50ca-6682-4212-84fb-88131fe6e9b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:47.318527 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:47.337656 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63616846-f80c-44ae-8e2e-7ff3a3fde1bd admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:47.341419 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24380e-1cf0-427f-93ad-40303acb450f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:47.342085 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24380e-1cf0-427f-93ad-40303acb450f service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:47.342370 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24380e-1cf0-427f-93ad-40303acb450f service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:47.342653 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24380e-1cf0-427f-93ad-40303acb450f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:47.344766 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1a24380e-1cf0-427f-93ad-40303acb450f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:47.377130 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab50ca-6682-4212-84fb-88131fe6e9b8 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:47.419126 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24380e-1cf0-427f-93ad-40303acb450f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:47.420671 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24380e-1cf0-427f-93ad-40303acb450f service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:47.434114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 973/1937] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:54:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:54:47.436023 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5baa90-1f7c-4aed-a4dd-6e8167bae7f2 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:47.436023 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5baa90-1f7c-4aed-a4dd-6e8167bae7f2 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:47.436023 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5baa90-1f7c-4aed-a4dd-6e8167bae7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:47.454763 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-0d5baa90-1f7c-4aed-a4dd-6e8167bae7f2 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:47.456149 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-0d5baa90-1f7c-4aed-a4dd-6e8167bae7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:47.462752 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eeca51-7188-4d28-8512-c7d639484cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:47.464380 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eeca51-7188-4d28-8512-c7d639484cb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:47.464659 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 974/1938] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:54:47.464929 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eeca51-7188-4d28-8512-c7d639484cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:47.465308 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eeca51-7188-4d28-8512-c7d639484cb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:47.466581 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eeca51-7188-4d28-8512-c7d639484cb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:47.468937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eeca51-7188-4d28-8512-c7d639484cb0 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:47.471870 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f779631-054e-4756-99a7-3ba8213a55d6 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:47.472270 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f779631-054e-4756-99a7-3ba8213a55d6 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:47.472736 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f779631-054e-4756-99a7-3ba8213a55d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:47.497986 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-0f779631-054e-4756-99a7-3ba8213a55d6 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:47.499431 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-0f779631-054e-4756-99a7-3ba8213a55d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:47.503288 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 965/1939] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:54:47 2022] POST /identity/v3/users => generated 298 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:54:47.507391 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eeca51-7188-4d28-8512-c7d639484cb0 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:47.512322 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 975/1940] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:54:47.516181 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f779631-054e-4756-99a7-3ba8213a55d6 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:47.517648 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eeca51-7188-4d28-8512-c7d639484cb0 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:47.524699 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba561205-a56c-4fab-8bef-5a6384bf0bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:47.525537 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba561205-a56c-4fab-8bef-5a6384bf0bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:47.525830 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba561205-a56c-4fab-8bef-5a6384bf0bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:47.526187 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba561205-a56c-4fab-8bef-5a6384bf0bd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:47.526899 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f779631-054e-4756-99a7-3ba8213a55d6 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:47.527015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba561205-a56c-4fab-8bef-5a6384bf0bd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:47.528753 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba561205-a56c-4fab-8bef-5a6384bf0bd7 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:47.530685 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:47.533110 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d04c8-5c4f-419b-835b-ed00e150766f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:47.533785 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d04c8-5c4f-419b-835b-ed00e150766f admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:47.534070 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d04c8-5c4f-419b-835b-ed00e150766f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:47.534581 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d04c8-5c4f-419b-835b-ed00e150766f admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:47.535092 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d04c8-5c4f-419b-835b-ed00e150766f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:54:47.535549 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d04c8-5c4f-419b-835b-ed00e150766f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:47.537196 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d04c8-5c4f-419b-835b-ed00e150766f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:47.551223 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 966/1941] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:54:47.556091 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba561205-a56c-4fab-8bef-5a6384bf0bd7 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:47.566202 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 976/1942] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:54:47.570882 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d04c8-5c4f-419b-835b-ed00e150766f admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:47.579533 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba561205-a56c-4fab-8bef-5a6384bf0bd7 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:47.581942 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d04c8-5c4f-419b-835b-ed00e150766f admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:47.584894 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d00e3-f610-4c80-9557-baaee9454340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:47.585979 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d00e3-f610-4c80-9557-baaee9454340 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:47.586348 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d00e3-f610-4c80-9557-baaee9454340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:47.586727 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d00e3-f610-4c80-9557-baaee9454340 admin admin] PATH_INFO: `/v3/projects/d672238de47d4c99bb29ad2632b6ca16/users/15a1e67b54444eba92c98879fee3bdb3/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:47.587787 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b89d59-6867-4dc0-9d4f-94f59b010995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:47.588532 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b89d59-6867-4dc0-9d4f-94f59b010995 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:47.588788 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b89d59-6867-4dc0-9d4f-94f59b010995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:47.589067 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b89d59-6867-4dc0-9d4f-94f59b010995 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:47.589765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b89d59-6867-4dc0-9d4f-94f59b010995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:47.591767 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b89d59-6867-4dc0-9d4f-94f59b010995 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:47.603740 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d00e3-f610-4c80-9557-baaee9454340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d672238de47d4c99bb29ad2632b6ca16, user_id=15a1e67b54444eba92c98879fee3bdb3, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:47.606804 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d00e3-f610-4c80-9557-baaee9454340 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:47.624400 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 977/1943] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:54:47 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:54:47.631466 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 967/1944] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:54:47 2022] PUT /identity/v3/projects/d672238de47d4c99bb29ad2632b6ca16/users/15a1e67b54444eba92c98879fee3bdb3/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:47.632076 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b89d59-6867-4dc0-9d4f-94f59b010995 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:47.635262 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d00e3-f610-4c80-9557-baaee9454340 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:47.727516 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d00e3-f610-4c80-9557-baaee9454340 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:47.733951 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b89d59-6867-4dc0-9d4f-94f59b010995 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:47.734125 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575cb6d7-ba8b-4892-b44c-14df5b837624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:47.735604 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cb6d7-ba8b-4892-b44c-14df5b837624 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:47.735965 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cb6d7-ba8b-4892-b44c-14df5b837624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:47.736401 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cb6d7-ba8b-4892-b44c-14df5b837624 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:47.737216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575cb6d7-ba8b-4892-b44c-14df5b837624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:47.739183 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7e9ba-d18a-408f-82ee-7f858307629b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:47.739645 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575cb6d7-ba8b-4892-b44c-14df5b837624 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:47.740058 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7e9ba-d18a-408f-82ee-7f858307629b admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:47.740416 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7e9ba-d18a-408f-82ee-7f858307629b admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:47.740710 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7e9ba-d18a-408f-82ee-7f858307629b admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:47.741539 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e7e9ba-d18a-408f-82ee-7f858307629b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:47.743623 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e7e9ba-d18a-408f-82ee-7f858307629b admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:47.754435 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 968/1945] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:54:47.757415 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575cb6d7-ba8b-4892-b44c-14df5b837624 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:47.770107 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575cb6d7-ba8b-4892-b44c-14df5b837624 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:47.781729 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 978/1946] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:54:47 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:54:47.782998 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7e9ba-d18a-408f-82ee-7f858307629b admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:47.785431 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce676fc-89d7-4ef7-8c0b-7fed31f20134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:47.786344 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce676fc-89d7-4ef7-8c0b-7fed31f20134 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:47.787130 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce676fc-89d7-4ef7-8c0b-7fed31f20134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:47.787588 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce676fc-89d7-4ef7-8c0b-7fed31f20134 admin admin] PATH_INFO: `/v3/projects/d672238de47d4c99bb29ad2632b6ca16/users/15a1e67b54444eba92c98879fee3bdb3/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:47.790191 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce676fc-89d7-4ef7-8c0b-7fed31f20134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d672238de47d4c99bb29ad2632b6ca16, user_id=15a1e67b54444eba92c98879fee3bdb3, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:47.792888 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce676fc-89d7-4ef7-8c0b-7fed31f20134 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:47.806701 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7e9ba-d18a-408f-82ee-7f858307629b admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:47.816979 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 969/1947] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:54:47 2022] PUT /identity/v3/projects/d672238de47d4c99bb29ad2632b6ca16/users/15a1e67b54444eba92c98879fee3bdb3/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:54:47.831091 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce676fc-89d7-4ef7-8c0b-7fed31f20134 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:47.835802 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-7ce676fc-89d7-4ef7-8c0b-7fed31f20134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:47.872377 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:47.908238 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95b67d-d902-4951-b480-b263f35aeacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:47.908634 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce676fc-89d7-4ef7-8c0b-7fed31f20134 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:47.909065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95b67d-d902-4951-b480-b263f35aeacb admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:47.909444 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95b67d-d902-4951-b480-b263f35aeacb admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:47.909792 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95b67d-d902-4951-b480-b263f35aeacb admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:47.910603 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95b67d-d902-4951-b480-b263f35aeacb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:47.912385 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95b67d-d902-4951-b480-b263f35aeacb admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:47.913404 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba69cb-3956-40b3-9b28-68c7ec2994a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:47.914284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba69cb-3956-40b3-9b28-68c7ec2994a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:47.914578 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba69cb-3956-40b3-9b28-68c7ec2994a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:47.914846 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba69cb-3956-40b3-9b28-68c7ec2994a1 admin admin] PATH_INFO: `/v3/projects/1f2c9bc7fc4a41d8b49d1caf90388edf` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:47.916085 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba69cb-3956-40b3-9b28-68c7ec2994a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f2c9bc7fc4a41d8b49d1caf90388edf)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:47.917985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba69cb-3956-40b3-9b28-68c7ec2994a1 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:47.923255 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 979/1948] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:54:47.924734 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4cf59-278d-450b-9a8d-4a9643ec5956 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:47.925173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4cf59-278d-450b-9a8d-4a9643ec5956 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:47.925566 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4cf59-278d-450b-9a8d-4a9643ec5956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:47.955065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-efd4cf59-278d-450b-9a8d-4a9643ec5956 None None] MFA Rules not processed for user `15a1e67b54444eba92c98879fee3bdb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:47.956320 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-efd4cf59-278d-450b-9a8d-4a9643ec5956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:47.969202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a7ba69cb-3956-40b3-9b28-68c7ec2994a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f2c9bc7fc4a41d8b49d1caf90388edf', 'request_id': 'req-a7ba69cb-3956-40b3-9b28-68c7ec2994a1'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:47.980494 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a7ba69cb-3956-40b3-9b28-68c7ec2994a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f2c9bc7fc4a41d8b49d1caf90388edf', 'request_id': 'req-a7ba69cb-3956-40b3-9b28-68c7ec2994a1'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:47.981890 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:47.987218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a7ba69cb-3956-40b3-9b28-68c7ec2994a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f2c9bc7fc4a41d8b49d1caf90388edf', 'request_id': 'req-a7ba69cb-3956-40b3-9b28-68c7ec2994a1'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:48.001643 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a7ba69cb-3956-40b3-9b28-68c7ec2994a1 admin admin] The token cache is being invalidate because project 1f2c9bc7fc4a41d8b49d1caf90388edf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:54:48.001643 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a7ba69cb-3956-40b3-9b28-68c7ec2994a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:48.002407 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a7ba69cb-3956-40b3-9b28-68c7ec2994a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:48.004243 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 970/1949] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:54:47 2022] DELETE /identity/v3/projects/1f2c9bc7fc4a41d8b49d1caf90388edf => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:48.007995 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba69cb-3956-40b3-9b28-68c7ec2994a1 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:48.009420 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-a7ba69cb-3956-40b3-9b28-68c7ec2994a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:48.041013 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 980/1950] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:54:48.042163 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4cf59-278d-450b-9a8d-4a9643ec5956 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:48.043797 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-efd4cf59-278d-450b-9a8d-4a9643ec5956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:48.081717 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba69cb-3956-40b3-9b28-68c7ec2994a1 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:48.087131 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cc909-deaf-42d8-865c-654214a362fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:48.087851 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cc909-deaf-42d8-865c-654214a362fb admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:48.088179 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cc909-deaf-42d8-865c-654214a362fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:48.088459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cc909-deaf-42d8-865c-654214a362fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:48.089261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cc909-deaf-42d8-865c-654214a362fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:48.090818 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cc909-deaf-42d8-865c-654214a362fb admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:48.101213 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 971/1951] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:54:48.102103 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cc909-deaf-42d8-865c-654214a362fb admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:48.105967 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-b14cc909-deaf-42d8-865c-654214a362fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:48.114385 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4cf59-278d-450b-9a8d-4a9643ec5956 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:48.119325 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86631eb-096a-4a52-9172-5f66567f7260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:48.120212 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86631eb-096a-4a52-9172-5f66567f7260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:48.120492 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86631eb-096a-4a52-9172-5f66567f7260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:48.120766 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86631eb-096a-4a52-9172-5f66567f7260 admin admin] PATH_INFO: `/v3/users/856b3890743647c7b9e4a93828b745b7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:48.121961 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86631eb-096a-4a52-9172-5f66567f7260 admin admin] RBAC: Authorizing `identity:delete_user(user_id=856b3890743647c7b9e4a93828b745b7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:48.123992 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86631eb-096a-4a52-9172-5f66567f7260 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:48.164729 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cc909-deaf-42d8-865c-654214a362fb admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:48.168518 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eeb81a-498c-4198-8a3c-577227a94458 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:48.169180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eeb81a-498c-4198-8a3c-577227a94458 service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:48.169467 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eeb81a-498c-4198-8a3c-577227a94458 service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:48.169743 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eeb81a-498c-4198-8a3c-577227a94458 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:48.171627 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-c6eeb81a-498c-4198-8a3c-577227a94458 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:48.172803 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a86631eb-096a-4a52-9172-5f66567f7260 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '856b3890743647c7b9e4a93828b745b7'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:48.177522 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:48.180962 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a86631eb-096a-4a52-9172-5f66567f7260 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '856b3890743647c7b9e4a93828b745b7'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:48.189288 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a86631eb-096a-4a52-9172-5f66567f7260 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '856b3890743647c7b9e4a93828b745b7'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:48.190023 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a86631eb-096a-4a52-9172-5f66567f7260 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '856b3890743647c7b9e4a93828b745b7'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:48.202580 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a86631eb-096a-4a52-9172-5f66567f7260 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '856b3890743647c7b9e4a93828b745b7'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:48.208743 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 981/1952] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:54:48 2022] DELETE /identity/v3/users/856b3890743647c7b9e4a93828b745b7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:48.209882 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86631eb-096a-4a52-9172-5f66567f7260 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:48.211359 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a86631eb-096a-4a52-9172-5f66567f7260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:48.234281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eeb81a-498c-4198-8a3c-577227a94458 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:48.235755 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eeb81a-498c-4198-8a3c-577227a94458 service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:48.245344 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 972/1953] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:54:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:54:48.293452 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86631eb-096a-4a52-9172-5f66567f7260 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:48.298486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131b692-7275-4953-8ac9-6ef9d6c45981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:48.299444 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131b692-7275-4953-8ac9-6ef9d6c45981 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:48.299732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131b692-7275-4953-8ac9-6ef9d6c45981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:48.300019 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131b692-7275-4953-8ac9-6ef9d6c45981 admin admin] PATH_INFO: `/v3/projects/7c7d7fa494bd4a0bab64a3afd3d0c27c/users/2499c7e4d2bc4a8d9e9f34459bfda6c3/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:48.316190 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131b692-7275-4953-8ac9-6ef9d6c45981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c7d7fa494bd4a0bab64a3afd3d0c27c, user_id=2499c7e4d2bc4a8d9e9f34459bfda6c3, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:48.319043 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131b692-7275-4953-8ac9-6ef9d6c45981 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:48.335074 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 982/1954] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:54:48 2022] PUT /identity/v3/projects/7c7d7fa494bd4a0bab64a3afd3d0c27c/users/2499c7e4d2bc4a8d9e9f34459bfda6c3/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:48.340588 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559d1c6-3b90-462d-b849-bc7abddaee27 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:48.340987 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559d1c6-3b90-462d-b849-bc7abddaee27 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:48.341293 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559d1c6-3b90-462d-b849-bc7abddaee27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:48.359843 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-d559d1c6-3b90-462d-b849-bc7abddaee27 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:48.361078 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-d559d1c6-3b90-462d-b849-bc7abddaee27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:48.398409 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:48.434505 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 973/1955] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:54:48.441488 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131b692-7275-4953-8ac9-6ef9d6c45981 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:48.443879 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9131b692-7275-4953-8ac9-6ef9d6c45981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:48.525976 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131b692-7275-4953-8ac9-6ef9d6c45981 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:48.533050 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24486c-e969-4506-91aa-95a4f32a4c80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:48.533050 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24486c-e969-4506-91aa-95a4f32a4c80 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:48.533050 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24486c-e969-4506-91aa-95a4f32a4c80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:48.533050 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24486c-e969-4506-91aa-95a4f32a4c80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:48.534921 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559d1c6-3b90-462d-b849-bc7abddaee27 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:48.536883 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-d559d1c6-3b90-462d-b849-bc7abddaee27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:48.561815 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe24486c-e969-4506-91aa-95a4f32a4c80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:48.563466 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe24486c-e969-4506-91aa-95a4f32a4c80 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:48.572072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559d1c6-3b90-462d-b849-bc7abddaee27 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:48.579870 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 983/1956] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:54:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:54:48.591798 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453cec9b-ba4b-49b5-a9c1-60ed2544cdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:48.592677 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453cec9b-ba4b-49b5-a9c1-60ed2544cdec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:48.592945 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453cec9b-ba4b-49b5-a9c1-60ed2544cdec admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:48.594101 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453cec9b-ba4b-49b5-a9c1-60ed2544cdec admin admin] PATH_INFO: `/v3/projects/f32156659ba840168e32dc2737d991e0` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:48.596049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453cec9b-ba4b-49b5-a9c1-60ed2544cdec admin admin] RBAC: Authorizing `identity:delete_project(project_id=f32156659ba840168e32dc2737d991e0)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:48.598110 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453cec9b-ba4b-49b5-a9c1-60ed2544cdec admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:48.678213 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-453cec9b-ba4b-49b5-a9c1-60ed2544cdec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f32156659ba840168e32dc2737d991e0', 'request_id': 'req-453cec9b-ba4b-49b5-a9c1-60ed2544cdec'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:48.691772 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-453cec9b-ba4b-49b5-a9c1-60ed2544cdec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f32156659ba840168e32dc2737d991e0', 'request_id': 'req-453cec9b-ba4b-49b5-a9c1-60ed2544cdec'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:48.701945 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-453cec9b-ba4b-49b5-a9c1-60ed2544cdec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f32156659ba840168e32dc2737d991e0', 'request_id': 'req-453cec9b-ba4b-49b5-a9c1-60ed2544cdec'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:48.739304 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-453cec9b-ba4b-49b5-a9c1-60ed2544cdec admin admin] The token cache is being invalidate because project f32156659ba840168e32dc2737d991e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:54:48.739667 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-453cec9b-ba4b-49b5-a9c1-60ed2544cdec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:48.743860 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-453cec9b-ba4b-49b5-a9c1-60ed2544cdec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:48.747187 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 974/1957] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:54:48 2022] DELETE /identity/v3/projects/f32156659ba840168e32dc2737d991e0 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:48.752649 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c868617-f567-4e96-80e5-957fae39f7ed None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:48.753078 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c868617-f567-4e96-80e5-957fae39f7ed None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:48.753351 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c868617-f567-4e96-80e5-957fae39f7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:48.784722 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-3c868617-f567-4e96-80e5-957fae39f7ed None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:48.786036 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-3c868617-f567-4e96-80e5-957fae39f7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:48.863248 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:48.891447 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 984/1958] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:54:48.896989 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d84996-5fb3-46f2-85b4-bf7604130ed5 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:48.896989 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d84996-5fb3-46f2-85b4-bf7604130ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:48.897542 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d84996-5fb3-46f2-85b4-bf7604130ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:48.927431 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-54d84996-5fb3-46f2-85b4-bf7604130ed5 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:48.929525 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-54d84996-5fb3-46f2-85b4-bf7604130ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:48.940335 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 975/1959] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:54:48.944783 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c868617-f567-4e96-80e5-957fae39f7ed None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:48.956359 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c868617-f567-4e96-80e5-957fae39f7ed None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:48.961037 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b8339-a49b-4cc6-91b4-6c78ab06c37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:48.961721 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b8339-a49b-4cc6-91b4-6c78ab06c37c admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:48.962011 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b8339-a49b-4cc6-91b4-6c78ab06c37c admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:48.962292 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b8339-a49b-4cc6-91b4-6c78ab06c37c admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:48.963037 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b8339-a49b-4cc6-91b4-6c78ab06c37c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:54:48.963381 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b8339-a49b-4cc6-91b4-6c78ab06c37c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:48.964980 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b8339-a49b-4cc6-91b4-6c78ab06c37c admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:48.977531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 985/1960] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:54:48.982046 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d84996-5fb3-46f2-85b4-bf7604130ed5 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:48.991936 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d84996-5fb3-46f2-85b4-bf7604130ed5 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:48.996676 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef0d48-483b-4dc8-a651-ed754a966cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:48.997353 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef0d48-483b-4dc8-a651-ed754a966cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:48.997640 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef0d48-483b-4dc8-a651-ed754a966cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:48.997920 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef0d48-483b-4dc8-a651-ed754a966cd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:48.998636 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef0d48-483b-4dc8-a651-ed754a966cd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:49.000587 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef0d48-483b-4dc8-a651-ed754a966cd6 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:49.033942 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 976/1961] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:54:48 2022] POST /identity/v3/projects => generated 401 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:54:49.035356 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b8339-a49b-4cc6-91b4-6c78ab06c37c admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:49.046640 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b8339-a49b-4cc6-91b4-6c78ab06c37c admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:49.119131 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f981bc-cc1d-4a31-94d1-3f021a9ef4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:49.119766 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f981bc-cc1d-4a31-94d1-3f021a9ef4d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:49.120051 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f981bc-cc1d-4a31-94d1-3f021a9ef4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:49.120331 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f981bc-cc1d-4a31-94d1-3f021a9ef4d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:49.121065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f981bc-cc1d-4a31-94d1-3f021a9ef4d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:49.122984 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f981bc-cc1d-4a31-94d1-3f021a9ef4d9 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:49.151272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 986/1962] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:54:49 2022] POST /identity/v3/users => generated 301 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:54:49.156263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef0d48-483b-4dc8-a651-ed754a966cd6 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:49.168808 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef0d48-483b-4dc8-a651-ed754a966cd6 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:49.173957 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be65bee-eea9-491c-b61a-e9e476d05c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:49.174657 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be65bee-eea9-491c-b61a-e9e476d05c4e admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:49.174944 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be65bee-eea9-491c-b61a-e9e476d05c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:49.175255 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be65bee-eea9-491c-b61a-e9e476d05c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:49.176010 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be65bee-eea9-491c-b61a-e9e476d05c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:49.177638 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be65bee-eea9-491c-b61a-e9e476d05c4e admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:49.194844 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 977/1963] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:54:49.207757 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f981bc-cc1d-4a31-94d1-3f021a9ef4d9 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:49.232711 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f981bc-cc1d-4a31-94d1-3f021a9ef4d9 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:49.238075 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71c0d0-019d-46cc-8e97-5bf090e6fe65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:49.238819 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71c0d0-019d-46cc-8e97-5bf090e6fe65 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:49.239101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71c0d0-019d-46cc-8e97-5bf090e6fe65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:49.239448 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71c0d0-019d-46cc-8e97-5bf090e6fe65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:49.240186 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71c0d0-019d-46cc-8e97-5bf090e6fe65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:49.242108 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71c0d0-019d-46cc-8e97-5bf090e6fe65 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:49.254338 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 987/1964] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:54:49.258889 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be65bee-eea9-491c-b61a-e9e476d05c4e admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:49.281253 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be65bee-eea9-491c-b61a-e9e476d05c4e admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:49.286802 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00ae1d-441a-4b22-bae0-9bd531628787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:49.287987 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00ae1d-441a-4b22-bae0-9bd531628787 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:49.288299 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00ae1d-441a-4b22-bae0-9bd531628787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:49.288552 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00ae1d-441a-4b22-bae0-9bd531628787 admin admin] PATH_INFO: `/v3/projects/23aa596e7b0e458b8b4d34a9f7103eed/users/1850aa2b8b574624b512f7018dcf7e15/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:49.313254 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00ae1d-441a-4b22-bae0-9bd531628787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23aa596e7b0e458b8b4d34a9f7103eed, user_id=1850aa2b8b574624b512f7018dcf7e15, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:49.313254 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00ae1d-441a-4b22-bae0-9bd531628787 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:49.323074 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 978/1965] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:54:49 2022] PUT /identity/v3/projects/23aa596e7b0e458b8b4d34a9f7103eed/users/1850aa2b8b574624b512f7018dcf7e15/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:49.334073 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800cf4f-a19b-4dd3-98a1-bc59cfeda5c7 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:49.334608 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800cf4f-a19b-4dd3-98a1-bc59cfeda5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:49.334899 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800cf4f-a19b-4dd3-98a1-bc59cfeda5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:49.362406 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-d800cf4f-a19b-4dd3-98a1-bc59cfeda5c7 None None] MFA Rules not processed for user `1850aa2b8b574624b512f7018dcf7e15`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:49.363725 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-d800cf4f-a19b-4dd3-98a1-bc59cfeda5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:49.437187 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 988/1966] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:54:49.441995 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00ae1d-441a-4b22-bae0-9bd531628787 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:49.495627 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466a61d-9948-48e7-90dd-8abcfef45aca None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:49.496202 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466a61d-9948-48e7-90dd-8abcfef45aca None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:49.496530 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466a61d-9948-48e7-90dd-8abcfef45aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:49.521617 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:49.529513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00ae1d-441a-4b22-bae0-9bd531628787 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:49.534693 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-c466a61d-9948-48e7-90dd-8abcfef45aca None None] MFA Rules not processed for user `2499c7e4d2bc4a8d9e9f34459bfda6c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:49.536083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c466a61d-9948-48e7-90dd-8abcfef45aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:49.538936 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ce8e7-8a2b-46ee-9249-2fcd3bbba402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:49.539666 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ce8e7-8a2b-46ee-9249-2fcd3bbba402 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:49.539949 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ce8e7-8a2b-46ee-9249-2fcd3bbba402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:49.540223 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ce8e7-8a2b-46ee-9249-2fcd3bbba402 admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:49.541250 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ce8e7-8a2b-46ee-9249-2fcd3bbba402 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:49.544645 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ce8e7-8a2b-46ee-9249-2fcd3bbba402 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:49.590016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 979/1967] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:54:49 2022] POST /identity/v3/projects => generated 401 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:54:49.590952 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:49.594912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ce8e7-8a2b-46ee-9249-2fcd3bbba402 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:49.627624 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 989/1968] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:54:49.632826 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466a61d-9948-48e7-90dd-8abcfef45aca None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:49.637188 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c466a61d-9948-48e7-90dd-8abcfef45aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:49.673347 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466a61d-9948-48e7-90dd-8abcfef45aca None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:49.706836 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ce8e7-8a2b-46ee-9249-2fcd3bbba402 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:49.713853 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d08980-d2d3-433a-9959-dd79dc5d6d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:49.714861 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d08980-d2d3-433a-9959-dd79dc5d6d97 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:49.715241 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d08980-d2d3-433a-9959-dd79dc5d6d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:49.715641 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d08980-d2d3-433a-9959-dd79dc5d6d97 admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:49.717023 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d08980-d2d3-433a-9959-dd79dc5d6d97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:49.734097 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d08980-d2d3-433a-9959-dd79dc5d6d97 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:49.759459 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133001c-fc64-4576-ae00-66815a31bf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:49.760171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133001c-fc64-4576-ae00-66815a31bf83 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:49.760459 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133001c-fc64-4576-ae00-66815a31bf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:49.761503 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133001c-fc64-4576-ae00-66815a31bf83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:49.763973 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8133001c-fc64-4576-ae00-66815a31bf83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:49.769309 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8133001c-fc64-4576-ae00-66815a31bf83 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:49.772283 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 980/1969] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:54:49 2022] POST /identity/v3/users => generated 307 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:54:49.776183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d08980-d2d3-433a-9959-dd79dc5d6d97 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:49.794992 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d08980-d2d3-433a-9959-dd79dc5d6d97 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:49.805628 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a9c37-d308-4369-bb3d-539d0e692961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:49.806344 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a9c37-d308-4369-bb3d-539d0e692961 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:49.806658 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a9c37-d308-4369-bb3d-539d0e692961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:49.806937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a9c37-d308-4369-bb3d-539d0e692961 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:49.807738 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a9c37-d308-4369-bb3d-539d0e692961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:49.810662 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a9c37-d308-4369-bb3d-539d0e692961 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:49.824924 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 990/1970] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:54:49 2022] POST /identity/v3/projects => generated 371 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:54:49.828967 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133001c-fc64-4576-ae00-66815a31bf83 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:49.829724 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 981/1971] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:54:49.833933 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a9c37-d308-4369-bb3d-539d0e692961 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:49.849338 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a9c37-d308-4369-bb3d-539d0e692961 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:49.948540 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133001c-fc64-4576-ae00-66815a31bf83 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:49.950050 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b6406-1a28-48eb-87b2-48265073b4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:49.951008 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b6406-1a28-48eb-87b2-48265073b4b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:49.955411 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b6406-1a28-48eb-87b2-48265073b4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:49.955411 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b6406-1a28-48eb-87b2-48265073b4b3 admin admin] PATH_INFO: `/v3/projects/0306c180bbbf485ab5894ea02cd18e41/users/f5add59a638a4c0087f59f8d2345a82e/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:49.965200 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17adf4e7-1bbc-4904-ac2e-1f5edd459c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:49.965980 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17adf4e7-1bbc-4904-ac2e-1f5edd459c4a admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:49.967350 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17adf4e7-1bbc-4904-ac2e-1f5edd459c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:49.968177 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17adf4e7-1bbc-4904-ac2e-1f5edd459c4a admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:49.969868 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17adf4e7-1bbc-4904-ac2e-1f5edd459c4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:49.977465 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17adf4e7-1bbc-4904-ac2e-1f5edd459c4a admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:49.981496 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b6406-1a28-48eb-87b2-48265073b4b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0306c180bbbf485ab5894ea02cd18e41, user_id=f5add59a638a4c0087f59f8d2345a82e, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:49.984530 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b6406-1a28-48eb-87b2-48265073b4b3 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:50.011013 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 982/1972] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:54:49 2022] PUT /identity/v3/projects/0306c180bbbf485ab5894ea02cd18e41/users/f5add59a638a4c0087f59f8d2345a82e/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:50.012029 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b6406-1a28-48eb-87b2-48265073b4b3 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:50.023702 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 991/1973] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:54:49 2022] POST /identity/v3/users => generated 292 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:54:50.027323 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17adf4e7-1bbc-4904-ac2e-1f5edd459c4a admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:50.048895 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17adf4e7-1bbc-4904-ac2e-1f5edd459c4a admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:50.078662 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:50.123919 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b6406-1a28-48eb-87b2-48265073b4b3 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:50.126424 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:50.144500 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e81306-15c1-495d-812d-2f3682d26e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:50.145398 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e81306-15c1-495d-812d-2f3682d26e81 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:50.145839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e81306-15c1-495d-812d-2f3682d26e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:50.146135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e81306-15c1-495d-812d-2f3682d26e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:50.146496 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91686af-4729-46b2-b22a-aba966d15679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:50.147795 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91686af-4729-46b2-b22a-aba966d15679 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:50.148086 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91686af-4729-46b2-b22a-aba966d15679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:50.148415 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91686af-4729-46b2-b22a-aba966d15679 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:50.149488 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91686af-4729-46b2-b22a-aba966d15679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:50.151893 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e81306-15c1-495d-812d-2f3682d26e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:50.152017 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91686af-4729-46b2-b22a-aba966d15679 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:50.154632 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e81306-15c1-495d-812d-2f3682d26e81 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:50.166242 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 992/1974] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:54:50.172845 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91686af-4729-46b2-b22a-aba966d15679 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:50.173376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 983/1975] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:54:50.174447 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e81306-15c1-495d-812d-2f3682d26e81 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:50.183295 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91686af-4729-46b2-b22a-aba966d15679 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:50.189072 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10744ba4-100a-419d-bae6-b6bfe1a69008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:50.190157 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10744ba4-100a-419d-bae6-b6bfe1a69008 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:50.190445 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10744ba4-100a-419d-bae6-b6bfe1a69008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:50.190726 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10744ba4-100a-419d-bae6-b6bfe1a69008 admin admin] PATH_INFO: `/v3/projects/48e1424b52d44c539758eb68bcbc0d4f/users/2a04a2272c344b32aa20505ae9be912a/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:50.190920 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e81306-15c1-495d-812d-2f3682d26e81 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:50.196472 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38186e66-b7ef-433a-90cd-f0c8e93f6a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:50.197511 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38186e66-b7ef-433a-90cd-f0c8e93f6a22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:50.197978 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38186e66-b7ef-433a-90cd-f0c8e93f6a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:50.198309 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38186e66-b7ef-433a-90cd-f0c8e93f6a22 admin admin] PATH_INFO: `/v3/projects/0306c180bbbf485ab5894ea02cd18e41/users/f5add59a638a4c0087f59f8d2345a82e/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:50.200548 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38186e66-b7ef-433a-90cd-f0c8e93f6a22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0306c180bbbf485ab5894ea02cd18e41, user_id=f5add59a638a4c0087f59f8d2345a82e, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:50.212263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38186e66-b7ef-433a-90cd-f0c8e93f6a22 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:50.218388 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10744ba4-100a-419d-bae6-b6bfe1a69008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48e1424b52d44c539758eb68bcbc0d4f, user_id=2a04a2272c344b32aa20505ae9be912a, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:50.221119 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10744ba4-100a-419d-bae6-b6bfe1a69008 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:50.244688 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 993/1976] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:54:50 2022] PUT /identity/v3/projects/48e1424b52d44c539758eb68bcbc0d4f/users/2a04a2272c344b32aa20505ae9be912a/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:54:50.248744 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10744ba4-100a-419d-bae6-b6bfe1a69008 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:50.253123 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 984/1977] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:54:50 2022] PUT /identity/v3/projects/0306c180bbbf485ab5894ea02cd18e41/users/f5add59a638a4c0087f59f8d2345a82e/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:50.266508 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813e6ee-bbb7-478e-902a-fba50e39817d None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:50.267106 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813e6ee-bbb7-478e-902a-fba50e39817d None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:50.267439 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813e6ee-bbb7-478e-902a-fba50e39817d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:50.343861 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-4813e6ee-bbb7-478e-902a-fba50e39817d None None] MFA Rules not processed for user `f5add59a638a4c0087f59f8d2345a82e`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:50.345068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10744ba4-100a-419d-bae6-b6bfe1a69008 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:50.345226 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-4813e6ee-bbb7-478e-902a-fba50e39817d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:50.437099 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52cd5b-6f13-4e3e-bb14-b52532690047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:50.437783 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52cd5b-6f13-4e3e-bb14-b52532690047 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:50.438402 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52cd5b-6f13-4e3e-bb14-b52532690047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:50.438517 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52cd5b-6f13-4e3e-bb14-b52532690047 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:50.439552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52cd5b-6f13-4e3e-bb14-b52532690047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:50.441802 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52cd5b-6f13-4e3e-bb14-b52532690047 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:50.461120 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 994/1978] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:54:50.466637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52cd5b-6f13-4e3e-bb14-b52532690047 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:50.481485 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52cd5b-6f13-4e3e-bb14-b52532690047 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:50.488618 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93d918-2208-4bfd-9bed-5a43a28d6123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:50.490939 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93d918-2208-4bfd-9bed-5a43a28d6123 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:50.491638 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93d918-2208-4bfd-9bed-5a43a28d6123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:50.492067 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93d918-2208-4bfd-9bed-5a43a28d6123 admin admin] PATH_INFO: `/v3/projects/48e1424b52d44c539758eb68bcbc0d4f/users/2a04a2272c344b32aa20505ae9be912a/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:50.494576 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93d918-2208-4bfd-9bed-5a43a28d6123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48e1424b52d44c539758eb68bcbc0d4f, user_id=2a04a2272c344b32aa20505ae9be912a, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:50.497658 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93d918-2208-4bfd-9bed-5a43a28d6123 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:50.513235 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 995/1979] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:54:50 2022] PUT /identity/v3/projects/48e1424b52d44c539758eb68bcbc0d4f/users/2a04a2272c344b32aa20505ae9be912a/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:50.524252 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 985/1980] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:50 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:54:50.536939 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93d918-2208-4bfd-9bed-5a43a28d6123 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:50.541132 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-ed93d918-2208-4bfd-9bed-5a43a28d6123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:50.645286 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93d918-2208-4bfd-9bed-5a43a28d6123 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:50.651640 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5e243-088f-42aa-ac8f-b0e9ddd34d8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:50.655189 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5e243-088f-42aa-ac8f-b0e9ddd34d8a service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:50.655189 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5e243-088f-42aa-ac8f-b0e9ddd34d8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:50.655189 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5e243-088f-42aa-ac8f-b0e9ddd34d8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:50.667697 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:50.812718 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f5e243-088f-42aa-ac8f-b0e9ddd34d8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:50.822154 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f5e243-088f-42aa-ac8f-b0e9ddd34d8a service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:50.847076 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 996/1981] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:54:50 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:54:50.982524 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813e6ee-bbb7-478e-902a-fba50e39817d None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:51.047689 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813e6ee-bbb7-478e-902a-fba50e39817d None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:51.056648 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71fb97-89c5-463a-8948-3e875f2786ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:51.057464 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71fb97-89c5-463a-8948-3e875f2786ca service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:51.057749 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71fb97-89c5-463a-8948-3e875f2786ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:51.058037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71fb97-89c5-463a-8948-3e875f2786ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:51.160424 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf71fb97-89c5-463a-8948-3e875f2786ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:51.169184 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf71fb97-89c5-463a-8948-3e875f2786ca service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:51.187091 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 986/1982] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:54:50 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:54:51.760609 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8216dc-8cde-4bd7-9f30-e14c186cc683 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:51.761129 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8216dc-8cde-4bd7-9f30-e14c186cc683 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:51.761221 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8216dc-8cde-4bd7-9f30-e14c186cc683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:51.822103 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-8e8216dc-8cde-4bd7-9f30-e14c186cc683 None None] MFA Rules not processed for user `2a04a2272c344b32aa20505ae9be912a`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:51.823426 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-8e8216dc-8cde-4bd7-9f30-e14c186cc683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:52.007336 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 997/1983] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:51 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:54:52.028108 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71fb97-89c5-463a-8948-3e875f2786ca service cinder] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:52.034779 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-cf71fb97-89c5-463a-8948-3e875f2786ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:52.057287 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:52.063351 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71fb97-89c5-463a-8948-3e875f2786ca service cinder] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:52.074535 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d173ea-5d54-4565-966b-b7cbd5e0e6a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:52.075885 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d173ea-5d54-4565-966b-b7cbd5e0e6a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:52.077347 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d173ea-5d54-4565-966b-b7cbd5e0e6a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:52.078019 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d173ea-5d54-4565-966b-b7cbd5e0e6a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:52.158546 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d173ea-5d54-4565-966b-b7cbd5e0e6a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:52.160578 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d173ea-5d54-4565-966b-b7cbd5e0e6a1 service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:52.175298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 987/1984] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:54:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:54:53.567738 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8216dc-8cde-4bd7-9f30-e14c186cc683 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:53.577648 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8216dc-8cde-4bd7-9f30-e14c186cc683 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:53.583051 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff35dda-4c88-46d9-9a21-53bb3463a218 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:53.583729 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff35dda-4c88-46d9-9a21-53bb3463a218 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:53.584098 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff35dda-4c88-46d9-9a21-53bb3463a218 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:53.584493 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff35dda-4c88-46d9-9a21-53bb3463a218 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:53.595172 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff35dda-4c88-46d9-9a21-53bb3463a218 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:53.596801 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff35dda-4c88-46d9-9a21-53bb3463a218 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:53.607865 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 998/1985] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:54:53 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:54:54.104785 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d173ea-5d54-4565-966b-b7cbd5e0e6a1 service cinder] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:54.126273 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d173ea-5d54-4565-966b-b7cbd5e0e6a1 service cinder] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:54.141820 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb858401-3d75-4ebe-b55c-e7cf785301b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:54.142573 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb858401-3d75-4ebe-b55c-e7cf785301b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:54.142878 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb858401-3d75-4ebe-b55c-e7cf785301b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:54.143252 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb858401-3d75-4ebe-b55c-e7cf785301b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:54.145900 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-fb858401-3d75-4ebe-b55c-e7cf785301b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:54.246041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb858401-3d75-4ebe-b55c-e7cf785301b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:54.247797 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb858401-3d75-4ebe-b55c-e7cf785301b2 service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:54.265905 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 988/1986] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:54:54 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:54:55.617365 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff35dda-4c88-46d9-9a21-53bb3463a218 service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:55.690220 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff35dda-4c88-46d9-9a21-53bb3463a218 service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:55.695487 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49557a5-8963-41d0-bc7e-6d28340342e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:55.696393 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49557a5-8963-41d0-bc7e-6d28340342e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:55.696677 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49557a5-8963-41d0-bc7e-6d28340342e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:55.696953 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49557a5-8963-41d0-bc7e-6d28340342e1 admin admin] PATH_INFO: `/v3/users/1850aa2b8b574624b512f7018dcf7e15` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:55.698261 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49557a5-8963-41d0-bc7e-6d28340342e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1850aa2b8b574624b512f7018dcf7e15)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:55.700250 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49557a5-8963-41d0-bc7e-6d28340342e1 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:55.726248 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:55.756422 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b49557a5-8963-41d0-bc7e-6d28340342e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1850aa2b8b574624b512f7018dcf7e15'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:55.765523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b49557a5-8963-41d0-bc7e-6d28340342e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1850aa2b8b574624b512f7018dcf7e15'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:55.776739 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b49557a5-8963-41d0-bc7e-6d28340342e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1850aa2b8b574624b512f7018dcf7e15'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:55.777380 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b49557a5-8963-41d0-bc7e-6d28340342e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1850aa2b8b574624b512f7018dcf7e15'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:55.789823 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b49557a5-8963-41d0-bc7e-6d28340342e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1850aa2b8b574624b512f7018dcf7e15'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:55.795772 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 999/1987] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:54:55 2022] DELETE /identity/v3/users/1850aa2b8b574624b512f7018dcf7e15 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:55.800517 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a04e9-88bf-4a39-9b89-c0bfe01fc7d0 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:55.801024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a04e9-88bf-4a39-9b89-c0bfe01fc7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:55.801133 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a04e9-88bf-4a39-9b89-c0bfe01fc7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:55.818296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-109a04e9-88bf-4a39-9b89-c0bfe01fc7d0 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:55.823737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-109a04e9-88bf-4a39-9b89-c0bfe01fc7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:55.887273 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 989/1988] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:54:55.897226 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49557a5-8963-41d0-bc7e-6d28340342e1 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:55.898840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b49557a5-8963-41d0-bc7e-6d28340342e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:55.958416 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49557a5-8963-41d0-bc7e-6d28340342e1 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:55.962484 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86580421-8b0b-43b5-88e5-c098f51deee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:55.963161 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86580421-8b0b-43b5-88e5-c098f51deee7 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:55.963464 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86580421-8b0b-43b5-88e5-c098f51deee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:55.963741 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86580421-8b0b-43b5-88e5-c098f51deee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:55.980780 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86580421-8b0b-43b5-88e5-c098f51deee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:55.982206 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86580421-8b0b-43b5-88e5-c098f51deee7 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:55.993668 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1000/1989] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:54:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:54:56.410200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a04e9-88bf-4a39-9b89-c0bfe01fc7d0 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:56.414802 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-109a04e9-88bf-4a39-9b89-c0bfe01fc7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:56.450220 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a04e9-88bf-4a39-9b89-c0bfe01fc7d0 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:56.463208 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c218ca-1b84-4650-8d4e-1147e2f3ea1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:56.464554 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c218ca-1b84-4650-8d4e-1147e2f3ea1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:56.465051 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c218ca-1b84-4650-8d4e-1147e2f3ea1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:56.465523 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c218ca-1b84-4650-8d4e-1147e2f3ea1c admin admin] PATH_INFO: `/v3/projects/23aa596e7b0e458b8b4d34a9f7103eed` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:56.468904 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c218ca-1b84-4650-8d4e-1147e2f3ea1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=23aa596e7b0e458b8b4d34a9f7103eed)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:56.472708 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c218ca-1b84-4650-8d4e-1147e2f3ea1c admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:56.518521 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:56.544518 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-d6c218ca-1b84-4650-8d4e-1147e2f3ea1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23aa596e7b0e458b8b4d34a9f7103eed', 'request_id': 'req-d6c218ca-1b84-4650-8d4e-1147e2f3ea1c'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:56.556401 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-d6c218ca-1b84-4650-8d4e-1147e2f3ea1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23aa596e7b0e458b8b4d34a9f7103eed', 'request_id': 'req-d6c218ca-1b84-4650-8d4e-1147e2f3ea1c'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:56.565393 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-d6c218ca-1b84-4650-8d4e-1147e2f3ea1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23aa596e7b0e458b8b4d34a9f7103eed', 'request_id': 'req-d6c218ca-1b84-4650-8d4e-1147e2f3ea1c'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:56.589051 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-d6c218ca-1b84-4650-8d4e-1147e2f3ea1c admin admin] The token cache is being invalidate because project 23aa596e7b0e458b8b4d34a9f7103eed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:54:56.589051 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-d6c218ca-1b84-4650-8d4e-1147e2f3ea1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:56.589051 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-d6c218ca-1b84-4650-8d4e-1147e2f3ea1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:56.589051 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 990/1990] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:54:56 2022] DELETE /identity/v3/projects/23aa596e7b0e458b8b4d34a9f7103eed => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:56.592685 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86580421-8b0b-43b5-88e5-c098f51deee7 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:56.612598 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86580421-8b0b-43b5-88e5-c098f51deee7 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:56.702666 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364dbc90-3f32-443f-96e1-29b9e83ad8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:56.703655 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dbc90-3f32-443f-96e1-29b9e83ad8f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:56.703942 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dbc90-3f32-443f-96e1-29b9e83ad8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:56.704210 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dbc90-3f32-443f-96e1-29b9e83ad8f5 admin admin] PATH_INFO: `/v3/users/f5add59a638a4c0087f59f8d2345a82e` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:56.705808 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364dbc90-3f32-443f-96e1-29b9e83ad8f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5add59a638a4c0087f59f8d2345a82e)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:56.708581 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364dbc90-3f32-443f-96e1-29b9e83ad8f5 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:56.769200 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:56.773402 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-364dbc90-3f32-443f-96e1-29b9e83ad8f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5add59a638a4c0087f59f8d2345a82e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:56.782052 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-364dbc90-3f32-443f-96e1-29b9e83ad8f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5add59a638a4c0087f59f8d2345a82e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:56.790567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-364dbc90-3f32-443f-96e1-29b9e83ad8f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5add59a638a4c0087f59f8d2345a82e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:56.791213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-364dbc90-3f32-443f-96e1-29b9e83ad8f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5add59a638a4c0087f59f8d2345a82e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:56.803239 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-364dbc90-3f32-443f-96e1-29b9e83ad8f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5add59a638a4c0087f59f8d2345a82e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:56.809521 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1001/1991] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:54:56 2022] DELETE /identity/v3/users/f5add59a638a4c0087f59f8d2345a82e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:57.116137 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c218ca-1b84-4650-8d4e-1147e2f3ea1c admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:57.117670 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-d6c218ca-1b84-4650-8d4e-1147e2f3ea1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:57.131754 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c218ca-1b84-4650-8d4e-1147e2f3ea1c admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:57.202560 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1969d02-c5fd-4bb7-844d-315a55e28e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:57.203494 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1969d02-c5fd-4bb7-844d-315a55e28e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:57.203779 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1969d02-c5fd-4bb7-844d-315a55e28e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:57.204055 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1969d02-c5fd-4bb7-844d-315a55e28e4f admin admin] PATH_INFO: `/v3/projects/0306c180bbbf485ab5894ea02cd18e41` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:57.205253 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1969d02-c5fd-4bb7-844d-315a55e28e4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0306c180bbbf485ab5894ea02cd18e41)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:57.207207 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1969d02-c5fd-4bb7-844d-315a55e28e4f admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:57.262516 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-b1969d02-c5fd-4bb7-844d-315a55e28e4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0306c180bbbf485ab5894ea02cd18e41', 'request_id': 'req-b1969d02-c5fd-4bb7-844d-315a55e28e4f'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:57.275317 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-b1969d02-c5fd-4bb7-844d-315a55e28e4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0306c180bbbf485ab5894ea02cd18e41', 'request_id': 'req-b1969d02-c5fd-4bb7-844d-315a55e28e4f'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:57.294906 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-b1969d02-c5fd-4bb7-844d-315a55e28e4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0306c180bbbf485ab5894ea02cd18e41', 'request_id': 'req-b1969d02-c5fd-4bb7-844d-315a55e28e4f'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:57.310245 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-b1969d02-c5fd-4bb7-844d-315a55e28e4f admin admin] The token cache is being invalidate because project 0306c180bbbf485ab5894ea02cd18e41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:54:57.310550 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-b1969d02-c5fd-4bb7-844d-315a55e28e4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:57.311240 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-b1969d02-c5fd-4bb7-844d-315a55e28e4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:57.313129 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 991/1992] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:54:57 2022] DELETE /identity/v3/projects/0306c180bbbf485ab5894ea02cd18e41 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:57.319293 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed00861-78de-49d3-b283-41c42f5dbe2e None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:57.320054 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed00861-78de-49d3-b283-41c42f5dbe2e None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:57.320496 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed00861-78de-49d3-b283-41c42f5dbe2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:57.353318 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-6ed00861-78de-49d3-b283-41c42f5dbe2e None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:57.354606 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6ed00861-78de-49d3-b283-41c42f5dbe2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:57.433350 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1002/1993] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:54:57.442278 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86145ffc-0c48-47ea-8da5-0ff8ce639df1 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:57.442464 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86145ffc-0c48-47ea-8da5-0ff8ce639df1 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:57.442690 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86145ffc-0c48-47ea-8da5-0ff8ce639df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:57.462397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-86145ffc-0c48-47ea-8da5-0ff8ce639df1 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:57.463641 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-86145ffc-0c48-47ea-8da5-0ff8ce639df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:57.476504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 992/1994] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:54:57.481077 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed00861-78de-49d3-b283-41c42f5dbe2e None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:57.492010 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed00861-78de-49d3-b283-41c42f5dbe2e None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:57.497344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33935552-6ccb-479e-8e9d-ede0587bec6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:57.498008 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33935552-6ccb-479e-8e9d-ede0587bec6c admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:57.498294 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33935552-6ccb-479e-8e9d-ede0587bec6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:57.498564 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33935552-6ccb-479e-8e9d-ede0587bec6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:57.499338 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33935552-6ccb-479e-8e9d-ede0587bec6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:54:57.499653 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33935552-6ccb-479e-8e9d-ede0587bec6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:57.501259 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33935552-6ccb-479e-8e9d-ede0587bec6c admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:57.513958 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1003/1995] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:54:57.518428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86145ffc-0c48-47ea-8da5-0ff8ce639df1 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:57.529120 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86145ffc-0c48-47ea-8da5-0ff8ce639df1 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:57.534352 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936d98d-26ce-4b3d-ab57-2aa91e7d8815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:57.535168 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936d98d-26ce-4b3d-ab57-2aa91e7d8815 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:57.535539 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936d98d-26ce-4b3d-ab57-2aa91e7d8815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:57.535811 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936d98d-26ce-4b3d-ab57-2aa91e7d8815 admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:57.536508 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936d98d-26ce-4b3d-ab57-2aa91e7d8815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:57.538553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936d98d-26ce-4b3d-ab57-2aa91e7d8815 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:57.570794 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 993/1996] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:54:57 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:54:57.574978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33935552-6ccb-479e-8e9d-ede0587bec6c admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:57.585321 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33935552-6ccb-479e-8e9d-ede0587bec6c admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:57.664993 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574560c-f29b-4b30-96e8-b8ccce45f7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:57.666142 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574560c-f29b-4b30-96e8-b8ccce45f7db admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:57.666302 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574560c-f29b-4b30-96e8-b8ccce45f7db admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:57.666638 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574560c-f29b-4b30-96e8-b8ccce45f7db admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:57.667477 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574560c-f29b-4b30-96e8-b8ccce45f7db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:57.669971 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574560c-f29b-4b30-96e8-b8ccce45f7db admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:57.700824 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1004/1997] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:54:57 2022] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:54:57.705102 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936d98d-26ce-4b3d-ab57-2aa91e7d8815 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:57.717898 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936d98d-26ce-4b3d-ab57-2aa91e7d8815 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:57.725603 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ff1c2-1d30-43c6-bc9c-7755a9974ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:57.726292 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ff1c2-1d30-43c6-bc9c-7755a9974ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:57.726575 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ff1c2-1d30-43c6-bc9c-7755a9974ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:57.726853 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ff1c2-1d30-43c6-bc9c-7755a9974ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:57.727757 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ff1c2-1d30-43c6-bc9c-7755a9974ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:57.730021 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ff1c2-1d30-43c6-bc9c-7755a9974ff3 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:57.760992 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 994/1998] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:54:57.762737 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574560c-f29b-4b30-96e8-b8ccce45f7db admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:57.775272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574560c-f29b-4b30-96e8-b8ccce45f7db admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:57.787094 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2317b7-5daa-4365-a3bc-c1deb0ef4ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:57.789051 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2317b7-5daa-4365-a3bc-c1deb0ef4ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:57.789627 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2317b7-5daa-4365-a3bc-c1deb0ef4ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:57.790312 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2317b7-5daa-4365-a3bc-c1deb0ef4ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:57.792176 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2317b7-5daa-4365-a3bc-c1deb0ef4ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:57.797555 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2317b7-5daa-4365-a3bc-c1deb0ef4ae3 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:57.809817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1005/1999] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:54:57.814313 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ff1c2-1d30-43c6-bc9c-7755a9974ff3 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:57.825838 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ff1c2-1d30-43c6-bc9c-7755a9974ff3 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:57.843517 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389023e-24f9-4b52-b04f-7e7725011685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:57.844455 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389023e-24f9-4b52-b04f-7e7725011685 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:57.844743 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389023e-24f9-4b52-b04f-7e7725011685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:57.845021 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389023e-24f9-4b52-b04f-7e7725011685 admin admin] PATH_INFO: `/v3/projects/03ba1239143f4219abb08a5f2e6bdacc/users/91701b1164744a628e30d6afedb07fc5/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:57.856610 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:57.868477 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6389023e-24f9-4b52-b04f-7e7725011685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03ba1239143f4219abb08a5f2e6bdacc, user_id=91701b1164744a628e30d6afedb07fc5, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:57.871616 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6389023e-24f9-4b52-b04f-7e7725011685 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:57.887959 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 995/2000] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:54:57 2022] PUT /identity/v3/projects/03ba1239143f4219abb08a5f2e6bdacc/users/91701b1164744a628e30d6afedb07fc5/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:57.899386 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bb7eb-f5db-4dd9-8803-390378b3bae6 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:57.900505 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bb7eb-f5db-4dd9-8803-390378b3bae6 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:57.900891 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bb7eb-f5db-4dd9-8803-390378b3bae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:57.940084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-f80bb7eb-f5db-4dd9-8803-390378b3bae6 None None] MFA Rules not processed for user `91701b1164744a628e30d6afedb07fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:57.941680 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-f80bb7eb-f5db-4dd9-8803-390378b3bae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:57.957688 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:58.039353 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1006/2001] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:54:58.052145 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389023e-24f9-4b52-b04f-7e7725011685 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:58.057778 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-6389023e-24f9-4b52-b04f-7e7725011685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:58.130285 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389023e-24f9-4b52-b04f-7e7725011685 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:58.139357 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72679b9a-574a-4c57-a0f3-6675ddc180fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:58.139357 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72679b9a-574a-4c57-a0f3-6675ddc180fa service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:58.139357 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72679b9a-574a-4c57-a0f3-6675ddc180fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:58.139357 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72679b9a-574a-4c57-a0f3-6675ddc180fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:58.148956 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72679b9a-574a-4c57-a0f3-6675ddc180fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:58.150490 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72679b9a-574a-4c57-a0f3-6675ddc180fa service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:58.160473 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 996/2002] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:54:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:54:58.181371 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80bb7eb-f5db-4dd9-8803-390378b3bae6 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:58.250052 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80bb7eb-f5db-4dd9-8803-390378b3bae6 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:58.255889 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c3f41-7432-4042-8004-cf815afcef0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:58.255889 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c3f41-7432-4042-8004-cf815afcef0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:58.256186 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c3f41-7432-4042-8004-cf815afcef0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:58.256846 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c3f41-7432-4042-8004-cf815afcef0c admin admin] PATH_INFO: `/v3/users/91701b1164744a628e30d6afedb07fc5` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:58.258123 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c3f41-7432-4042-8004-cf815afcef0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=91701b1164744a628e30d6afedb07fc5)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:58.260119 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c3f41-7432-4042-8004-cf815afcef0c admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:58.309949 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-619c3f41-7432-4042-8004-cf815afcef0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91701b1164744a628e30d6afedb07fc5'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:58.316775 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-619c3f41-7432-4042-8004-cf815afcef0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91701b1164744a628e30d6afedb07fc5'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:58.325772 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-619c3f41-7432-4042-8004-cf815afcef0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91701b1164744a628e30d6afedb07fc5'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:58.326510 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-619c3f41-7432-4042-8004-cf815afcef0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91701b1164744a628e30d6afedb07fc5'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:58.339858 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-619c3f41-7432-4042-8004-cf815afcef0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91701b1164744a628e30d6afedb07fc5'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:58.346314 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1007/2003] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:54:58 2022] DELETE /identity/v3/users/91701b1164744a628e30d6afedb07fc5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:58.351925 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda2150-e83d-497c-bcee-a63aac5c7927 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:58.352295 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda2150-e83d-497c-bcee-a63aac5c7927 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:58.352676 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda2150-e83d-497c-bcee-a63aac5c7927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:58.374012 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-1dda2150-e83d-497c-bcee-a63aac5c7927 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:58.375683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-1dda2150-e83d-497c-bcee-a63aac5c7927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:58.484251 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 997/2004] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:54:58.502171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c3f41-7432-4042-8004-cf815afcef0c admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:58.503737 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-619c3f41-7432-4042-8004-cf815afcef0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:58.556368 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:58.585066 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c3f41-7432-4042-8004-cf815afcef0c admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:58.588660 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3d3a7-e753-41ed-827b-f7c259829ec5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:58.589331 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3d3a7-e753-41ed-827b-f7c259829ec5 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:58.589612 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3d3a7-e753-41ed-827b-f7c259829ec5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:58.589888 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3d3a7-e753-41ed-827b-f7c259829ec5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:58.599350 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3d3a7-e753-41ed-827b-f7c259829ec5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:58.601039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3d3a7-e753-41ed-827b-f7c259829ec5 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:58.616765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1008/2005] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:54:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:54:59.491570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda2150-e83d-497c-bcee-a63aac5c7927 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:59.495358 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-1dda2150-e83d-497c-bcee-a63aac5c7927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:59.511338 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda2150-e83d-497c-bcee-a63aac5c7927 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:59.517964 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c87d3b-9173-45d0-9bb8-419b63308c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:59.535964 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c87d3b-9173-45d0-9bb8-419b63308c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:59.537506 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c87d3b-9173-45d0-9bb8-419b63308c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:59.538607 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c87d3b-9173-45d0-9bb8-419b63308c08 admin admin] PATH_INFO: `/v3/projects/03ba1239143f4219abb08a5f2e6bdacc` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:59.540620 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c87d3b-9173-45d0-9bb8-419b63308c08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03ba1239143f4219abb08a5f2e6bdacc)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:59.549427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c87d3b-9173-45d0-9bb8-419b63308c08 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:59.639754 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3d3a7-e753-41ed-827b-f7c259829ec5 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:59.641292 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-82c3d3a7-e753-41ed-827b-f7c259829ec5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:59.652449 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-80c87d3b-9173-45d0-9bb8-419b63308c08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03ba1239143f4219abb08a5f2e6bdacc', 'request_id': 'req-80c87d3b-9173-45d0-9bb8-419b63308c08'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:59.662706 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3d3a7-e753-41ed-827b-f7c259829ec5 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:59.670337 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-80c87d3b-9173-45d0-9bb8-419b63308c08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03ba1239143f4219abb08a5f2e6bdacc', 'request_id': 'req-80c87d3b-9173-45d0-9bb8-419b63308c08'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:59.686110 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-80c87d3b-9173-45d0-9bb8-419b63308c08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03ba1239143f4219abb08a5f2e6bdacc', 'request_id': 'req-80c87d3b-9173-45d0-9bb8-419b63308c08'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:59.700970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-80c87d3b-9173-45d0-9bb8-419b63308c08 admin admin] The token cache is being invalidate because project 03ba1239143f4219abb08a5f2e6bdacc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:54:59.702110 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-80c87d3b-9173-45d0-9bb8-419b63308c08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:59.705333 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-80c87d3b-9173-45d0-9bb8-419b63308c08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:59.712749 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 998/2006] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:54:59 2022] DELETE /identity/v3/projects/03ba1239143f4219abb08a5f2e6bdacc => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:54:59.715569 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75322172-db0f-40d2-a715-58e01c5543ad None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:59.716306 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75322172-db0f-40d2-a715-58e01c5543ad None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:59.717849 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75322172-db0f-40d2-a715-58e01c5543ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:59.749750 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-75322172-db0f-40d2-a715-58e01c5543ad None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:59.751093 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-75322172-db0f-40d2-a715-58e01c5543ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:59.762624 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:59.767001 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6177b8f-b93f-4f1a-aa03-c59e506f9d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:59.768093 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6177b8f-b93f-4f1a-aa03-c59e506f9d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:59.768375 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6177b8f-b93f-4f1a-aa03-c59e506f9d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:59.768647 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6177b8f-b93f-4f1a-aa03-c59e506f9d2e admin admin] PATH_INFO: `/v3/users/9febb52c6a7c44e48a6ebab7ecbffff4` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:59.770036 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6177b8f-b93f-4f1a-aa03-c59e506f9d2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9febb52c6a7c44e48a6ebab7ecbffff4)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:59.772528 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6177b8f-b93f-4f1a-aa03-c59e506f9d2e admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:59.836791 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e6177b8f-b93f-4f1a-aa03-c59e506f9d2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9febb52c6a7c44e48a6ebab7ecbffff4'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:59.841981 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 999/2007] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:54:59.843483 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78844633-fc37-461b-b57c-8d28ec67575c None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:59.843779 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78844633-fc37-461b-b57c-8d28ec67575c None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:59.844063 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78844633-fc37-461b-b57c-8d28ec67575c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:59.846418 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e6177b8f-b93f-4f1a-aa03-c59e506f9d2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9febb52c6a7c44e48a6ebab7ecbffff4'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:59.857090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e6177b8f-b93f-4f1a-aa03-c59e506f9d2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9febb52c6a7c44e48a6ebab7ecbffff4'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:59.858126 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e6177b8f-b93f-4f1a-aa03-c59e506f9d2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9febb52c6a7c44e48a6ebab7ecbffff4'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:59.863632 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-78844633-fc37-461b-b57c-8d28ec67575c None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:59.864860 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-78844633-fc37-461b-b57c-8d28ec67575c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:59.872364 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e6177b8f-b93f-4f1a-aa03-c59e506f9d2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9febb52c6a7c44e48a6ebab7ecbffff4'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:54:59.873759 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1000/2008] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:54:59.878107 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78844633-fc37-461b-b57c-8d28ec67575c None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:59.879508 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1009/2009] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:54:59 2022] DELETE /identity/v3/users/9febb52c6a7c44e48a6ebab7ecbffff4 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:54:59.883951 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271e2cd-d4fb-4363-bbf7-c5f87fcca722 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:59.884245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271e2cd-d4fb-4363-bbf7-c5f87fcca722 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:59.884523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271e2cd-d4fb-4363-bbf7-c5f87fcca722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:59.888397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78844633-fc37-461b-b57c-8d28ec67575c None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:54:59.911359 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-c271e2cd-d4fb-4363-bbf7-c5f87fcca722 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:54:59.913860 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c271e2cd-d4fb-4363-bbf7-c5f87fcca722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:59.951885 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0144b4-c76c-4fc8-8d19-39e25f0912ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:54:59.952591 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0144b4-c76c-4fc8-8d19-39e25f0912ea admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:54:59.953067 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0144b4-c76c-4fc8-8d19-39e25f0912ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:54:59.953356 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0144b4-c76c-4fc8-8d19-39e25f0912ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:54:59.954130 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0144b4-c76c-4fc8-8d19-39e25f0912ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:54:59.954442 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0144b4-c76c-4fc8-8d19-39e25f0912ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:54:59.956134 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0144b4-c76c-4fc8-8d19-39e25f0912ea admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:54:59.970586 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1001/2010] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:54:59.975547 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0144b4-c76c-4fc8-8d19-39e25f0912ea admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:54:59.977691 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-3f0144b4-c76c-4fc8-8d19-39e25f0912ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:54:59.982039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:54:59.992414 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0144b4-c76c-4fc8-8d19-39e25f0912ea admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:00.003683 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1010/2011] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:54:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:00.005247 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd729603-5ff2-41df-af1f-77dba4eedc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:00.006938 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd729603-5ff2-41df-af1f-77dba4eedc4f admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:00.006938 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd729603-5ff2-41df-af1f-77dba4eedc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:00.006938 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd729603-5ff2-41df-af1f-77dba4eedc4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:00.007397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd729603-5ff2-41df-af1f-77dba4eedc4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:00.009312 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd729603-5ff2-41df-af1f-77dba4eedc4f admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:00.012935 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271e2cd-d4fb-4363-bbf7-c5f87fcca722 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:00.014397 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c271e2cd-d4fb-4363-bbf7-c5f87fcca722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:00.046683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1002/2012] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:54:59 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:55:00.050713 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd729603-5ff2-41df-af1f-77dba4eedc4f admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:00.109364 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271e2cd-d4fb-4363-bbf7-c5f87fcca722 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:00.155815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd729603-5ff2-41df-af1f-77dba4eedc4f admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:00.163850 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a85601-17d6-4436-a862-c7e337cc6ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:00.164738 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a85601-17d6-4436-a862-c7e337cc6ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:00.165076 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a85601-17d6-4436-a862-c7e337cc6ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:00.165357 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a85601-17d6-4436-a862-c7e337cc6ea6 admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:00.166084 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a85601-17d6-4436-a862-c7e337cc6ea6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:00.168278 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a85601-17d6-4436-a862-c7e337cc6ea6 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:00.171263 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5a09b-c932-4524-996f-1e0e94d590be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:00.172237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5a09b-c932-4524-996f-1e0e94d590be service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:00.172747 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5a09b-c932-4524-996f-1e0e94d590be service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:00.173387 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5a09b-c932-4524-996f-1e0e94d590be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:00.202873 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add5a09b-c932-4524-996f-1e0e94d590be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:00.204909 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add5a09b-c932-4524-996f-1e0e94d590be service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:00.222771 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1003/2013] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:55:00 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:55:00.224068 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a85601-17d6-4436-a862-c7e337cc6ea6 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:00.225090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1011/2014] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:55:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:55:00.245586 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a85601-17d6-4436-a862-c7e337cc6ea6 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:00.252762 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa8ef6-7a19-4441-814f-6c9860fd02e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:00.255309 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa8ef6-7a19-4441-814f-6c9860fd02e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:00.255615 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa8ef6-7a19-4441-814f-6c9860fd02e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:00.255950 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa8ef6-7a19-4441-814f-6c9860fd02e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:00.257534 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa8ef6-7a19-4441-814f-6c9860fd02e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:00.259496 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa8ef6-7a19-4441-814f-6c9860fd02e2 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:00.262615 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:00.278051 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5a09b-c932-4524-996f-1e0e94d590be service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:00.279224 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1004/2015] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:55:00.295599 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5a09b-c932-4524-996f-1e0e94d590be service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:00.301170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872037a1-37d2-4658-8e4f-bb4a454ebb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:00.301974 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872037a1-37d2-4658-8e4f-bb4a454ebb79 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:00.302325 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872037a1-37d2-4658-8e4f-bb4a454ebb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:00.302747 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872037a1-37d2-4658-8e4f-bb4a454ebb79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:00.303655 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872037a1-37d2-4658-8e4f-bb4a454ebb79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:00.305810 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872037a1-37d2-4658-8e4f-bb4a454ebb79 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:00.319257 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1012/2016] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:55:00.321913 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa8ef6-7a19-4441-814f-6c9860fd02e2 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:00.342241 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa8ef6-7a19-4441-814f-6c9860fd02e2 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:00.342241 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6d8ac-cae9-4a72-b78a-c6e2bd416bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:00.342241 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6d8ac-cae9-4a72-b78a-c6e2bd416bcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:00.342241 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6d8ac-cae9-4a72-b78a-c6e2bd416bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:00.342750 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6d8ac-cae9-4a72-b78a-c6e2bd416bcf admin admin] PATH_INFO: `/v3/projects/d8cff6160f4e4cb29c379cd6aff79ca3/users/f1886b841d414af899542700c486953e/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:00.365300 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6d8ac-cae9-4a72-b78a-c6e2bd416bcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8cff6160f4e4cb29c379cd6aff79ca3, user_id=f1886b841d414af899542700c486953e, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:00.367334 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6d8ac-cae9-4a72-b78a-c6e2bd416bcf admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:00.399573 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1005/2017] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:55:00 2022] PUT /identity/v3/projects/d8cff6160f4e4cb29c379cd6aff79ca3/users/f1886b841d414af899542700c486953e/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:00.411116 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae1bf8-5849-4643-a989-7863e47276a2 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:00.411577 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae1bf8-5849-4643-a989-7863e47276a2 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:00.411930 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae1bf8-5849-4643-a989-7863e47276a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:00.463825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-0cae1bf8-5849-4643-a989-7863e47276a2 None None] MFA Rules not processed for user `f1886b841d414af899542700c486953e`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:00.466181 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-0cae1bf8-5849-4643-a989-7863e47276a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:00.626113 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1013/2018] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:55:00.637700 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6d8ac-cae9-4a72-b78a-c6e2bd416bcf admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:00.640382 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-73d6d8ac-cae9-4a72-b78a-c6e2bd416bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:00.684507 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae1bf8-5849-4643-a989-7863e47276a2 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:00.689753 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-0cae1bf8-5849-4643-a989-7863e47276a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:00.782514 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:00.815892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae1bf8-5849-4643-a989-7863e47276a2 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:00.819769 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6d8ac-cae9-4a72-b78a-c6e2bd416bcf admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:00.822746 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade5ab6d-1fbd-45a6-988b-b2df54994b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:00.823675 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5ab6d-1fbd-45a6-988b-b2df54994b9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:00.823964 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5ab6d-1fbd-45a6-988b-b2df54994b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:00.824243 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5ab6d-1fbd-45a6-988b-b2df54994b9b admin admin] PATH_INFO: `/v3/projects/4334dd1c4b754d90b5c5e47df3503af0` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:00.825462 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade5ab6d-1fbd-45a6-988b-b2df54994b9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4334dd1c4b754d90b5c5e47df3503af0)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:00.827502 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade5ab6d-1fbd-45a6-988b-b2df54994b9b admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:00.828679 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945a0d9-0171-4c32-a2d2-32bc0349e833 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:00.829369 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945a0d9-0171-4c32-a2d2-32bc0349e833 service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:00.830302 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945a0d9-0171-4c32-a2d2-32bc0349e833 service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:00.830660 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945a0d9-0171-4c32-a2d2-32bc0349e833 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:00.858847 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6945a0d9-0171-4c32-a2d2-32bc0349e833 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:00.860644 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6945a0d9-0171-4c32-a2d2-32bc0349e833 service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:00.883312 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1006/2019] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:55:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:55:00.939062 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-ade5ab6d-1fbd-45a6-988b-b2df54994b9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4334dd1c4b754d90b5c5e47df3503af0', 'request_id': 'req-ade5ab6d-1fbd-45a6-988b-b2df54994b9b'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:00.953579 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-ade5ab6d-1fbd-45a6-988b-b2df54994b9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4334dd1c4b754d90b5c5e47df3503af0', 'request_id': 'req-ade5ab6d-1fbd-45a6-988b-b2df54994b9b'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:00.966969 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-ade5ab6d-1fbd-45a6-988b-b2df54994b9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4334dd1c4b754d90b5c5e47df3503af0', 'request_id': 'req-ade5ab6d-1fbd-45a6-988b-b2df54994b9b'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:00.986548 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-ade5ab6d-1fbd-45a6-988b-b2df54994b9b admin admin] The token cache is being invalidate because project 4334dd1c4b754d90b5c5e47df3503af0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:55:00.987334 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-ade5ab6d-1fbd-45a6-988b-b2df54994b9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:00.989658 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-ade5ab6d-1fbd-45a6-988b-b2df54994b9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:00.994226 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1014/2020] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:55:00 2022] DELETE /identity/v3/projects/4334dd1c4b754d90b5c5e47df3503af0 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:00.998338 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945a0d9-0171-4c32-a2d2-32bc0349e833 service cinder] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:01.013919 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945a0d9-0171-4c32-a2d2-32bc0349e833 service cinder] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:01.173301 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db2c86-e85f-42ec-b811-15c83b22c48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:01.174685 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db2c86-e85f-42ec-b811-15c83b22c48b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:01.175194 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db2c86-e85f-42ec-b811-15c83b22c48b admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:01.175593 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db2c86-e85f-42ec-b811-15c83b22c48b admin admin] PATH_INFO: `/v3/users/15a1e67b54444eba92c98879fee3bdb3` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:01.177081 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db2c86-e85f-42ec-b811-15c83b22c48b admin admin] RBAC: Authorizing `identity:delete_user(user_id=15a1e67b54444eba92c98879fee3bdb3)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:01.179481 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db2c86-e85f-42ec-b811-15c83b22c48b admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:01.250643 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-42db2c86-e85f-42ec-b811-15c83b22c48b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15a1e67b54444eba92c98879fee3bdb3'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:01.263603 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-42db2c86-e85f-42ec-b811-15c83b22c48b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15a1e67b54444eba92c98879fee3bdb3'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:01.286237 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-42db2c86-e85f-42ec-b811-15c83b22c48b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15a1e67b54444eba92c98879fee3bdb3'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:01.287814 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-42db2c86-e85f-42ec-b811-15c83b22c48b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15a1e67b54444eba92c98879fee3bdb3'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:01.311549 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:01.313608 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-42db2c86-e85f-42ec-b811-15c83b22c48b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15a1e67b54444eba92c98879fee3bdb3'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:01.347168 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1007/2021] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:55:00 2022] DELETE /identity/v3/users/15a1e67b54444eba92c98879fee3bdb3 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:01.780469 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade5ab6d-1fbd-45a6-988b-b2df54994b9b admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:01.782542 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-ade5ab6d-1fbd-45a6-988b-b2df54994b9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:01.801896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade5ab6d-1fbd-45a6-988b-b2df54994b9b admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:01.874646 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81f11e-4212-4bfd-add1-0b080392572c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:01.875813 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81f11e-4212-4bfd-add1-0b080392572c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:01.876227 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81f11e-4212-4bfd-add1-0b080392572c admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:01.876704 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81f11e-4212-4bfd-add1-0b080392572c admin admin] PATH_INFO: `/v3/projects/d672238de47d4c99bb29ad2632b6ca16` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:01.878099 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81f11e-4212-4bfd-add1-0b080392572c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d672238de47d4c99bb29ad2632b6ca16)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:01.881584 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81f11e-4212-4bfd-add1-0b080392572c admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:01.938483 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-5e81f11e-4212-4bfd-add1-0b080392572c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd672238de47d4c99bb29ad2632b6ca16', 'request_id': 'req-5e81f11e-4212-4bfd-add1-0b080392572c'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:01.946907 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-5e81f11e-4212-4bfd-add1-0b080392572c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd672238de47d4c99bb29ad2632b6ca16', 'request_id': 'req-5e81f11e-4212-4bfd-add1-0b080392572c'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:01.953155 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-5e81f11e-4212-4bfd-add1-0b080392572c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd672238de47d4c99bb29ad2632b6ca16', 'request_id': 'req-5e81f11e-4212-4bfd-add1-0b080392572c'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:01.955248 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:01.967040 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-5e81f11e-4212-4bfd-add1-0b080392572c admin admin] The token cache is being invalidate because project d672238de47d4c99bb29ad2632b6ca16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:55:01.967510 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-5e81f11e-4212-4bfd-add1-0b080392572c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:01.968906 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-5e81f11e-4212-4bfd-add1-0b080392572c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:01.971366 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1015/2022] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:55:01 2022] DELETE /identity/v3/projects/d672238de47d4c99bb29ad2632b6ca16 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:01.978943 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928c55a-b067-4e16-ba25-139ccf572520 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:01.979527 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928c55a-b067-4e16-ba25-139ccf572520 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:01.980014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928c55a-b067-4e16-ba25-139ccf572520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:02.000499 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-8928c55a-b067-4e16-ba25-139ccf572520 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:02.001866 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-8928c55a-b067-4e16-ba25-139ccf572520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:02.066903 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1008/2023] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:02.075625 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a8ba2-83e9-450a-8389-fe0084627bb8 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:02.075989 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a8ba2-83e9-450a-8389-fe0084627bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:02.076298 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a8ba2-83e9-450a-8389-fe0084627bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:02.096410 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-3f2a8ba2-83e9-450a-8389-fe0084627bb8 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:02.097623 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-3f2a8ba2-83e9-450a-8389-fe0084627bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:02.111186 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1016/2024] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:02.112988 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928c55a-b067-4e16-ba25-139ccf572520 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:02.123437 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928c55a-b067-4e16-ba25-139ccf572520 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:02.128066 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91233663-34fc-4a89-868e-fa565fa087cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:02.128734 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91233663-34fc-4a89-868e-fa565fa087cd admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:02.129020 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91233663-34fc-4a89-868e-fa565fa087cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:02.129296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91233663-34fc-4a89-868e-fa565fa087cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:02.130034 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91233663-34fc-4a89-868e-fa565fa087cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:55:02.130343 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91233663-34fc-4a89-868e-fa565fa087cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:02.132167 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91233663-34fc-4a89-868e-fa565fa087cd admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:02.145400 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1009/2025] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:55:02.148529 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a8ba2-83e9-450a-8389-fe0084627bb8 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:02.157726 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a8ba2-83e9-450a-8389-fe0084627bb8 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:02.162471 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac95a1-f5c5-48fe-a4b5-e5f7c4a7a9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:02.163251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac95a1-f5c5-48fe-a4b5-e5f7c4a7a9b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:02.163539 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac95a1-f5c5-48fe-a4b5-e5f7c4a7a9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:02.163921 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac95a1-f5c5-48fe-a4b5-e5f7c4a7a9b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:02.164501 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac95a1-f5c5-48fe-a4b5-e5f7c4a7a9b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:02.166413 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac95a1-f5c5-48fe-a4b5-e5f7c4a7a9b5 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:02.195009 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1017/2026] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:55:02 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:55:02.199201 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91233663-34fc-4a89-868e-fa565fa087cd admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:02.210150 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91233663-34fc-4a89-868e-fa565fa087cd admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:02.272553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43e1b1-ff01-4cbb-a9f4-906aed57c425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:02.273314 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43e1b1-ff01-4cbb-a9f4-906aed57c425 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:02.273605 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43e1b1-ff01-4cbb-a9f4-906aed57c425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:02.273891 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43e1b1-ff01-4cbb-a9f4-906aed57c425 admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:02.274603 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43e1b1-ff01-4cbb-a9f4-906aed57c425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:02.276698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43e1b1-ff01-4cbb-a9f4-906aed57c425 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:02.307000 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1010/2027] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:55:02 2022] POST /identity/v3/users => generated 291 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:55:02.311498 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac95a1-f5c5-48fe-a4b5-e5f7c4a7a9b5 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:02.322757 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac95a1-f5c5-48fe-a4b5-e5f7c4a7a9b5 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:02.327353 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43abb3-b3e0-4ec5-9ac7-7a6e898318f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:02.328010 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43abb3-b3e0-4ec5-9ac7-7a6e898318f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:02.328288 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43abb3-b3e0-4ec5-9ac7-7a6e898318f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:02.328563 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43abb3-b3e0-4ec5-9ac7-7a6e898318f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:02.329294 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43abb3-b3e0-4ec5-9ac7-7a6e898318f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:02.330873 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43abb3-b3e0-4ec5-9ac7-7a6e898318f1 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:02.342217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1018/2028] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:55:02.346313 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43e1b1-ff01-4cbb-a9f4-906aed57c425 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:02.357269 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43e1b1-ff01-4cbb-a9f4-906aed57c425 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:02.362519 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911bf19-9b12-4ff1-9656-b0915eb48650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:02.363229 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911bf19-9b12-4ff1-9656-b0915eb48650 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:02.363523 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911bf19-9b12-4ff1-9656-b0915eb48650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:02.363802 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911bf19-9b12-4ff1-9656-b0915eb48650 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:02.364542 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911bf19-9b12-4ff1-9656-b0915eb48650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:02.366278 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911bf19-9b12-4ff1-9656-b0915eb48650 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:02.381047 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1011/2029] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:55:02.383585 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43abb3-b3e0-4ec5-9ac7-7a6e898318f1 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:02.395625 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43abb3-b3e0-4ec5-9ac7-7a6e898318f1 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:02.401040 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7b4aa-127e-49f6-9b7e-4775234173ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:02.401939 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7b4aa-127e-49f6-9b7e-4775234173ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:02.402221 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7b4aa-127e-49f6-9b7e-4775234173ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:02.402495 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7b4aa-127e-49f6-9b7e-4775234173ec admin admin] PATH_INFO: `/v3/projects/613d7f4ba18740ada35c34dcba8ee80f/users/8c9cc959876f4878b5273e5be22bc9dd/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:02.418452 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7b4aa-127e-49f6-9b7e-4775234173ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=613d7f4ba18740ada35c34dcba8ee80f, user_id=8c9cc959876f4878b5273e5be22bc9dd, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:02.421298 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7b4aa-127e-49f6-9b7e-4775234173ec admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:02.437104 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1019/2030] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:55:02 2022] PUT /identity/v3/projects/613d7f4ba18740ada35c34dcba8ee80f/users/8c9cc959876f4878b5273e5be22bc9dd/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:55:02.449830 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a42eb6-ba6b-429b-8371-60e985a67e64 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:02.450095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a42eb6-ba6b-429b-8371-60e985a67e64 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:02.450390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a42eb6-ba6b-429b-8371-60e985a67e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:02.479197 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-23a42eb6-ba6b-429b-8371-60e985a67e64 None None] MFA Rules not processed for user `8c9cc959876f4878b5273e5be22bc9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:02.480295 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-23a42eb6-ba6b-429b-8371-60e985a67e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:02.540370 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:02.559509 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1012/2031] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:55:02.571030 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7b4aa-127e-49f6-9b7e-4775234173ec admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:02.572883 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-58b7b4aa-127e-49f6-9b7e-4775234173ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:02.642238 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7b4aa-127e-49f6-9b7e-4775234173ec admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:02.647699 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cdb077-c6e2-4fe8-9bf1-9770fa210e25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:02.648366 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdb077-c6e2-4fe8-9bf1-9770fa210e25 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:02.648651 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdb077-c6e2-4fe8-9bf1-9770fa210e25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:02.648959 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdb077-c6e2-4fe8-9bf1-9770fa210e25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:02.658573 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cdb077-c6e2-4fe8-9bf1-9770fa210e25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:02.660490 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cdb077-c6e2-4fe8-9bf1-9770fa210e25 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:02.674253 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1020/2032] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:55:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:55:02.702231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a42eb6-ba6b-429b-8371-60e985a67e64 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:02.778992 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a42eb6-ba6b-429b-8371-60e985a67e64 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:02.783741 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20157332-14ec-4d13-aa31-09ead2392018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:02.784639 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20157332-14ec-4d13-aa31-09ead2392018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:02.784953 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20157332-14ec-4d13-aa31-09ead2392018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:02.785231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20157332-14ec-4d13-aa31-09ead2392018 admin admin] PATH_INFO: `/v3/users/8c9cc959876f4878b5273e5be22bc9dd` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:02.786424 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20157332-14ec-4d13-aa31-09ead2392018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c9cc959876f4878b5273e5be22bc9dd)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:02.788484 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20157332-14ec-4d13-aa31-09ead2392018 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:02.838391 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-20157332-14ec-4d13-aa31-09ead2392018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c9cc959876f4878b5273e5be22bc9dd'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:02.846481 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-20157332-14ec-4d13-aa31-09ead2392018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c9cc959876f4878b5273e5be22bc9dd'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:02.856279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-20157332-14ec-4d13-aa31-09ead2392018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c9cc959876f4878b5273e5be22bc9dd'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:02.857006 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-20157332-14ec-4d13-aa31-09ead2392018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c9cc959876f4878b5273e5be22bc9dd'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:02.870077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-20157332-14ec-4d13-aa31-09ead2392018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c9cc959876f4878b5273e5be22bc9dd'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:02.876220 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1013/2033] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:55:02 2022] DELETE /identity/v3/users/8c9cc959876f4878b5273e5be22bc9dd => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:02.880755 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c944863-fa81-452d-be51-241c3ef797be None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:02.881281 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c944863-fa81-452d-be51-241c3ef797be None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:02.881385 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c944863-fa81-452d-be51-241c3ef797be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:02.902453 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-8c944863-fa81-452d-be51-241c3ef797be None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:02.904164 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-8c944863-fa81-452d-be51-241c3ef797be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:02.974632 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1021/2034] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:55:02.985853 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20157332-14ec-4d13-aa31-09ead2392018 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:02.987365 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-20157332-14ec-4d13-aa31-09ead2392018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:03.045154 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20157332-14ec-4d13-aa31-09ead2392018 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:03.048814 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5525d1-5096-4cbe-9ea0-01701d5496f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:03.049481 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5525d1-5096-4cbe-9ea0-01701d5496f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:03.049767 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5525d1-5096-4cbe-9ea0-01701d5496f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:03.050046 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5525d1-5096-4cbe-9ea0-01701d5496f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:03.060060 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5525d1-5096-4cbe-9ea0-01701d5496f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:03.061512 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5525d1-5096-4cbe-9ea0-01701d5496f6 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:03.071504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1014/2035] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:55:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:55:03.644841 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c944863-fa81-452d-be51-241c3ef797be None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:03.646984 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-8c944863-fa81-452d-be51-241c3ef797be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:03.661742 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c944863-fa81-452d-be51-241c3ef797be None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:03.666856 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062f2a9-6aa5-4a6e-8b47-3075c26e73fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:03.667890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062f2a9-6aa5-4a6e-8b47-3075c26e73fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:03.668236 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062f2a9-6aa5-4a6e-8b47-3075c26e73fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:03.668583 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062f2a9-6aa5-4a6e-8b47-3075c26e73fa admin admin] PATH_INFO: `/v3/projects/613d7f4ba18740ada35c34dcba8ee80f` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:03.669874 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062f2a9-6aa5-4a6e-8b47-3075c26e73fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=613d7f4ba18740ada35c34dcba8ee80f)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:03.672193 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062f2a9-6aa5-4a6e-8b47-3075c26e73fa admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:03.718803 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:03.744507 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-5062f2a9-6aa5-4a6e-8b47-3075c26e73fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '613d7f4ba18740ada35c34dcba8ee80f', 'request_id': 'req-5062f2a9-6aa5-4a6e-8b47-3075c26e73fa'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:03.755620 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-5062f2a9-6aa5-4a6e-8b47-3075c26e73fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '613d7f4ba18740ada35c34dcba8ee80f', 'request_id': 'req-5062f2a9-6aa5-4a6e-8b47-3075c26e73fa'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:03.763418 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-5062f2a9-6aa5-4a6e-8b47-3075c26e73fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '613d7f4ba18740ada35c34dcba8ee80f', 'request_id': 'req-5062f2a9-6aa5-4a6e-8b47-3075c26e73fa'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:03.779882 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-5062f2a9-6aa5-4a6e-8b47-3075c26e73fa admin admin] The token cache is being invalidate because project 613d7f4ba18740ada35c34dcba8ee80f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:55:03.780183 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-5062f2a9-6aa5-4a6e-8b47-3075c26e73fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:03.781503 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-5062f2a9-6aa5-4a6e-8b47-3075c26e73fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:03.786263 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1022/2036] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:55:03 2022] DELETE /identity/v3/projects/613d7f4ba18740ada35c34dcba8ee80f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:03.788575 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a59807-60a8-488b-9868-421414d50244 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:03.788850 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a59807-60a8-488b-9868-421414d50244 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:03.789139 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a59807-60a8-488b-9868-421414d50244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:03.815306 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-b8a59807-60a8-488b-9868-421414d50244 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:03.817574 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-b8a59807-60a8-488b-9868-421414d50244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:03.830921 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:03.905805 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1015/2037] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:55:03.913971 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea4a33-0df0-4d2a-a16d-2e47cb6578fa None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:03.914481 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea4a33-0df0-4d2a-a16d-2e47cb6578fa None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:03.914581 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea4a33-0df0-4d2a-a16d-2e47cb6578fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:03.935277 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-9cea4a33-0df0-4d2a-a16d-2e47cb6578fa None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:03.936594 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9cea4a33-0df0-4d2a-a16d-2e47cb6578fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:03.945163 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1023/2038] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:03.950328 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a59807-60a8-488b-9868-421414d50244 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:03.964386 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a59807-60a8-488b-9868-421414d50244 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:03.969952 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b4e45-7ced-4cc9-97fa-d76648400ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:03.970596 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b4e45-7ced-4cc9-97fa-d76648400ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:03.970887 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b4e45-7ced-4cc9-97fa-d76648400ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:03.971199 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b4e45-7ced-4cc9-97fa-d76648400ca5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:03.972098 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b4e45-7ced-4cc9-97fa-d76648400ca5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:55:03.972410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b4e45-7ced-4cc9-97fa-d76648400ca5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:03.974034 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b4e45-7ced-4cc9-97fa-d76648400ca5 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:03.986815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1016/2039] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:55:03.991416 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea4a33-0df0-4d2a-a16d-2e47cb6578fa None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:04.001490 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea4a33-0df0-4d2a-a16d-2e47cb6578fa None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:04.007565 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48e827-9ed4-48a2-a742-d677a36524a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:04.008348 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48e827-9ed4-48a2-a742-d677a36524a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:04.008617 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48e827-9ed4-48a2-a742-d677a36524a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:04.008890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48e827-9ed4-48a2-a742-d677a36524a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:04.009603 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48e827-9ed4-48a2-a742-d677a36524a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:04.011545 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48e827-9ed4-48a2-a742-d677a36524a1 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:04.040333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1024/2040] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:55:03 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:55:04.044530 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b4e45-7ced-4cc9-97fa-d76648400ca5 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:04.056779 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b4e45-7ced-4cc9-97fa-d76648400ca5 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:04.116602 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abd6c1-e7f6-4b44-afc5-0a419b66660a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:04.117300 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abd6c1-e7f6-4b44-afc5-0a419b66660a admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:04.117586 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abd6c1-e7f6-4b44-afc5-0a419b66660a admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:04.117865 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abd6c1-e7f6-4b44-afc5-0a419b66660a admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:04.118566 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64abd6c1-e7f6-4b44-afc5-0a419b66660a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:04.120538 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64abd6c1-e7f6-4b44-afc5-0a419b66660a admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:04.144634 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1017/2041] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:55:04 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:55:04.146180 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48e827-9ed4-48a2-a742-d677a36524a1 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:04.157236 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48e827-9ed4-48a2-a742-d677a36524a1 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:04.161879 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d2f7e-0e19-4fa9-9d31-a6320ead62b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:04.162587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d2f7e-0e19-4fa9-9d31-a6320ead62b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:04.163166 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d2f7e-0e19-4fa9-9d31-a6320ead62b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:04.163500 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d2f7e-0e19-4fa9-9d31-a6320ead62b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:04.164252 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d2f7e-0e19-4fa9-9d31-a6320ead62b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:04.165880 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d2f7e-0e19-4fa9-9d31-a6320ead62b0 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:04.177355 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1025/2042] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:55:04.181945 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abd6c1-e7f6-4b44-afc5-0a419b66660a admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:04.193182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abd6c1-e7f6-4b44-afc5-0a419b66660a admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:04.198683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150481ad-0b78-4c8f-b383-1fc5be9102ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:04.199494 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150481ad-0b78-4c8f-b383-1fc5be9102ae admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:04.199772 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150481ad-0b78-4c8f-b383-1fc5be9102ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:04.200109 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150481ad-0b78-4c8f-b383-1fc5be9102ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:04.200822 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150481ad-0b78-4c8f-b383-1fc5be9102ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:04.202608 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150481ad-0b78-4c8f-b383-1fc5be9102ae admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:04.213952 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1018/2043] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:55:04.217938 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d2f7e-0e19-4fa9-9d31-a6320ead62b0 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:04.228948 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d2f7e-0e19-4fa9-9d31-a6320ead62b0 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:04.235265 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2691065-6f55-49b8-880b-6731d54c6964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:04.236293 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2691065-6f55-49b8-880b-6731d54c6964 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:04.236646 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2691065-6f55-49b8-880b-6731d54c6964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:04.237001 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2691065-6f55-49b8-880b-6731d54c6964 admin admin] PATH_INFO: `/v3/projects/effe42953f78475fb85e3916e1bb96cb/users/55a9a77ef09940e7beed281cd2672667/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:04.259457 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2691065-6f55-49b8-880b-6731d54c6964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=effe42953f78475fb85e3916e1bb96cb, user_id=55a9a77ef09940e7beed281cd2672667, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:04.262402 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2691065-6f55-49b8-880b-6731d54c6964 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:04.288785 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1026/2044] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:55:04 2022] PUT /identity/v3/projects/effe42953f78475fb85e3916e1bb96cb/users/55a9a77ef09940e7beed281cd2672667/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:04.292883 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4eae61-7731-4423-ab3f-d69b290f7883 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:04.293177 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4eae61-7731-4423-ab3f-d69b290f7883 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:04.293479 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4eae61-7731-4423-ab3f-d69b290f7883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:04.331907 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-9e4eae61-7731-4423-ab3f-d69b290f7883 None None] MFA Rules not processed for user `55a9a77ef09940e7beed281cd2672667`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:04.333391 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-9e4eae61-7731-4423-ab3f-d69b290f7883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:04.413050 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1019/2045] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:04.426583 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2691065-6f55-49b8-880b-6731d54c6964 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:04.429138 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c2691065-6f55-49b8-880b-6731d54c6964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:04.490812 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2691065-6f55-49b8-880b-6731d54c6964 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:04.495247 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99210b9-9f1f-4f08-9098-1958b5f6f0da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:04.495913 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99210b9-9f1f-4f08-9098-1958b5f6f0da service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:04.496190 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99210b9-9f1f-4f08-9098-1958b5f6f0da service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:04.496463 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99210b9-9f1f-4f08-9098-1958b5f6f0da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:04.505408 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99210b9-9f1f-4f08-9098-1958b5f6f0da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:04.506850 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99210b9-9f1f-4f08-9098-1958b5f6f0da service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:04.515742 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1027/2046] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:55:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:55:06.807708 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3577a-1ad7-41dc-8f5c-e8d90970fe0b None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:06.808327 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3577a-1ad7-41dc-8f5c-e8d90970fe0b None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:06.808327 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3577a-1ad7-41dc-8f5c-e8d90970fe0b None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:06.809677 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1020/2047] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jun 24 10:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:55:06.821925 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f19dbf-39b3-44b1-a29e-799c4888a0e3 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:06.822451 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f19dbf-39b3-44b1-a29e-799c4888a0e3 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:06.822542 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f19dbf-39b3-44b1-a29e-799c4888a0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:06.841616 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-21f19dbf-39b3-44b1-a29e-799c4888a0e3 None None] MFA Rules not processed for user `b365d9dd635e4518a41181649c323062`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:06.842837 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-21f19dbf-39b3-44b1-a29e-799c4888a0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:06.897652 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3577a-1ad7-41dc-8f5c-e8d90970fe0b None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:06.899563 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-fbc3577a-1ad7-41dc-8f5c-e8d90970fe0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:06.908607 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:06.911182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:06.925841 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1028/2048] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jun 24 10:55:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:55:06.937749 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f19dbf-39b3-44b1-a29e-799c4888a0e3 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:06.939172 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-21f19dbf-39b3-44b1-a29e-799c4888a0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:06.951954 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f19dbf-39b3-44b1-a29e-799c4888a0e3 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:06.957141 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeaa3e3-7be4-4d57-ac4d-b5127bae8d8c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b365d9dd635e4518a41181649c323062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:06.957783 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaa3e3-7be4-4d57-ac4d-b5127bae8d8c service placement] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:06.958060 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaa3e3-7be4-4d57-ac4d-b5127bae8d8c service placement] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:06.958333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaa3e3-7be4-4d57-ac4d-b5127bae8d8c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:06.968589 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeaa3e3-7be4-4d57-ac4d-b5127bae8d8c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:06.970170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeaa3e3-7be4-4d57-ac4d-b5127bae8d8c service placement] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:06.970678 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3577a-1ad7-41dc-8f5c-e8d90970fe0b None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:06.975415 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caff8ad-ee22-4e1f-a78a-dafdecee4b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:06.976808 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caff8ad-ee22-4e1f-a78a-dafdecee4b38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:06.977093 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caff8ad-ee22-4e1f-a78a-dafdecee4b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:06.977368 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caff8ad-ee22-4e1f-a78a-dafdecee4b38 admin admin] PATH_INFO: `/v3/users/924040e7b5cf435fa78ed20e1c3e0b02` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:06.978882 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caff8ad-ee22-4e1f-a78a-dafdecee4b38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=924040e7b5cf435fa78ed20e1c3e0b02)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:06.980998 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caff8ad-ee22-4e1f-a78a-dafdecee4b38 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:06.983031 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1029/2049] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:55:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:55:07.042882 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-5caff8ad-ee22-4e1f-a78a-dafdecee4b38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '924040e7b5cf435fa78ed20e1c3e0b02'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:07.058067 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-5caff8ad-ee22-4e1f-a78a-dafdecee4b38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '924040e7b5cf435fa78ed20e1c3e0b02'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:07.067332 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-5caff8ad-ee22-4e1f-a78a-dafdecee4b38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '924040e7b5cf435fa78ed20e1c3e0b02'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:07.068334 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-5caff8ad-ee22-4e1f-a78a-dafdecee4b38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '924040e7b5cf435fa78ed20e1c3e0b02'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:07.087806 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-5caff8ad-ee22-4e1f-a78a-dafdecee4b38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '924040e7b5cf435fa78ed20e1c3e0b02'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:07.094229 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1021/2050] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:55:06 2022] DELETE /identity/v3/users/924040e7b5cf435fa78ed20e1c3e0b02 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:55:07.306720 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeaa3e3-7be4-4d57-ac4d-b5127bae8d8c service placement] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:07.319519 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeaa3e3-7be4-4d57-ac4d-b5127bae8d8c service placement] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:07.378360 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a80f1-f027-4dbe-9ed1-766d46ceb34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:07.379285 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a80f1-f027-4dbe-9ed1-766d46ceb34e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:07.379572 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a80f1-f027-4dbe-9ed1-766d46ceb34e admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:07.379853 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a80f1-f027-4dbe-9ed1-766d46ceb34e admin admin] PATH_INFO: `/v3/projects/dea77fbf8e2b486f91de4b88695098a2` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:07.381364 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a80f1-f027-4dbe-9ed1-766d46ceb34e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dea77fbf8e2b486f91de4b88695098a2)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:07.383402 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a80f1-f027-4dbe-9ed1-766d46ceb34e admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:07.440345 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9b4a80f1-f027-4dbe-9ed1-766d46ceb34e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dea77fbf8e2b486f91de4b88695098a2', 'request_id': 'req-9b4a80f1-f027-4dbe-9ed1-766d46ceb34e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:07.452801 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9b4a80f1-f027-4dbe-9ed1-766d46ceb34e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dea77fbf8e2b486f91de4b88695098a2', 'request_id': 'req-9b4a80f1-f027-4dbe-9ed1-766d46ceb34e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:07.458627 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9b4a80f1-f027-4dbe-9ed1-766d46ceb34e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dea77fbf8e2b486f91de4b88695098a2', 'request_id': 'req-9b4a80f1-f027-4dbe-9ed1-766d46ceb34e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:07.470352 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9b4a80f1-f027-4dbe-9ed1-766d46ceb34e admin admin] The token cache is being invalidate because project dea77fbf8e2b486f91de4b88695098a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:55:07.470645 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9b4a80f1-f027-4dbe-9ed1-766d46ceb34e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:07.471333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9b4a80f1-f027-4dbe-9ed1-766d46ceb34e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:07.473007 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1030/2051] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:55:07 2022] DELETE /identity/v3/projects/dea77fbf8e2b486f91de4b88695098a2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:07.479216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e535a-6852-4d3e-9e87-f6781ee4eed9 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:07.479513 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e535a-6852-4d3e-9e87-f6781ee4eed9 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:07.479791 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e535a-6852-4d3e-9e87-f6781ee4eed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:07.499275 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-fb0e535a-6852-4d3e-9e87-f6781ee4eed9 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:07.500501 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-fb0e535a-6852-4d3e-9e87-f6781ee4eed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:07.562779 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1022/2052] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:07.571403 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc52c3e-6ffa-4494-8fe0-cc0d0abb556d None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:07.571694 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc52c3e-6ffa-4494-8fe0-cc0d0abb556d None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:07.571972 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc52c3e-6ffa-4494-8fe0-cc0d0abb556d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:07.594207 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-4cc52c3e-6ffa-4494-8fe0-cc0d0abb556d None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:07.596156 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-4cc52c3e-6ffa-4494-8fe0-cc0d0abb556d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:07.608838 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1031/2053] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:07.613375 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e535a-6852-4d3e-9e87-f6781ee4eed9 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:07.624718 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e535a-6852-4d3e-9e87-f6781ee4eed9 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:07.631278 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556224d-4a0c-446d-8085-6618e6a19694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:07.631959 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556224d-4a0c-446d-8085-6618e6a19694 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:07.632241 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556224d-4a0c-446d-8085-6618e6a19694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:07.632519 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556224d-4a0c-446d-8085-6618e6a19694 admin admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:07.633254 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556224d-4a0c-446d-8085-6618e6a19694 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:55:07.633559 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556224d-4a0c-446d-8085-6618e6a19694 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:07.635165 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556224d-4a0c-446d-8085-6618e6a19694 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:07.647854 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1023/2054] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:55:07.652430 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc52c3e-6ffa-4494-8fe0-cc0d0abb556d None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:07.663438 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc52c3e-6ffa-4494-8fe0-cc0d0abb556d None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:07.669073 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434cedd-a50e-4679-9f13-33a9d3213cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:07.669729 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434cedd-a50e-4679-9f13-33a9d3213cf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:07.670010 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434cedd-a50e-4679-9f13-33a9d3213cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:07.670267 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434cedd-a50e-4679-9f13-33a9d3213cf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:07.670956 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434cedd-a50e-4679-9f13-33a9d3213cf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:07.672900 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434cedd-a50e-4679-9f13-33a9d3213cf6 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:07.704667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1032/2055] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:55:07 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:55:07.709254 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556224d-4a0c-446d-8085-6618e6a19694 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:07.719640 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556224d-4a0c-446d-8085-6618e6a19694 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:07.731519 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:07.790032 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62a72c-9b9b-402a-87f1-071d6a7841b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:07.790722 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62a72c-9b9b-402a-87f1-071d6a7841b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:07.791005 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62a72c-9b9b-402a-87f1-071d6a7841b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:07.791298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62a72c-9b9b-402a-87f1-071d6a7841b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:07.791988 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62a72c-9b9b-402a-87f1-071d6a7841b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:07.793916 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62a72c-9b9b-402a-87f1-071d6a7841b2 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:07.818396 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1024/2056] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:55:07 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:55:07.822899 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434cedd-a50e-4679-9f13-33a9d3213cf6 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:07.833455 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434cedd-a50e-4679-9f13-33a9d3213cf6 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:07.838196 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a80a04-7748-418f-8d3b-2e3376628832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:07.838857 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a80a04-7748-418f-8d3b-2e3376628832 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:07.839135 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a80a04-7748-418f-8d3b-2e3376628832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:07.839433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a80a04-7748-418f-8d3b-2e3376628832 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:07.840149 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a80a04-7748-418f-8d3b-2e3376628832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:07.841748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a80a04-7748-418f-8d3b-2e3376628832 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:07.852473 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1033/2057] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:55:07.856370 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62a72c-9b9b-402a-87f1-071d6a7841b2 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:07.866888 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62a72c-9b9b-402a-87f1-071d6a7841b2 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:07.872577 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b7a48-bfc9-4fc2-af31-a7d2f05e05cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:07.873240 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b7a48-bfc9-4fc2-af31-a7d2f05e05cf admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:07.873526 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b7a48-bfc9-4fc2-af31-a7d2f05e05cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:07.873805 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b7a48-bfc9-4fc2-af31-a7d2f05e05cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:07.874550 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b7a48-bfc9-4fc2-af31-a7d2f05e05cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:07.876205 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b7a48-bfc9-4fc2-af31-a7d2f05e05cf admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:07.886717 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1025/2058] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:55:07.891039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a80a04-7748-418f-8d3b-2e3376628832 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:07.904406 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a80a04-7748-418f-8d3b-2e3376628832 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:07.909428 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c01151-cec9-4643-a80c-b8c9fc12061d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:07.910320 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c01151-cec9-4643-a80c-b8c9fc12061d admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:07.910605 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c01151-cec9-4643-a80c-b8c9fc12061d admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:07.910879 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c01151-cec9-4643-a80c-b8c9fc12061d admin admin] PATH_INFO: `/v3/projects/5068389aaa2c4f658d133aaf1aa7a979/users/60706c22f0374cef85d9a7ae5c1a07a1/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:07.925631 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c01151-cec9-4643-a80c-b8c9fc12061d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5068389aaa2c4f658d133aaf1aa7a979, user_id=60706c22f0374cef85d9a7ae5c1a07a1, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:07.928667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c01151-cec9-4643-a80c-b8c9fc12061d admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:07.945649 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1034/2059] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:55:07 2022] PUT /identity/v3/projects/5068389aaa2c4f658d133aaf1aa7a979/users/60706c22f0374cef85d9a7ae5c1a07a1/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:55:07.956991 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197304f1-bf1c-4185-baa2-ea8b3512e9a3 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:07.957287 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197304f1-bf1c-4185-baa2-ea8b3512e9a3 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:07.957565 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197304f1-bf1c-4185-baa2-ea8b3512e9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:07.991960 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-197304f1-bf1c-4185-baa2-ea8b3512e9a3 None None] MFA Rules not processed for user `60706c22f0374cef85d9a7ae5c1a07a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:07.993757 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-197304f1-bf1c-4185-baa2-ea8b3512e9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:08.064333 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1026/2060] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:08.069645 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c01151-cec9-4643-a80c-b8c9fc12061d admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:08.078443 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:08.136351 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c01151-cec9-4643-a80c-b8c9fc12061d admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:08.140851 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aec60b-5667-42e4-8b0b-661b0f45a01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:08.141518 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aec60b-5667-42e4-8b0b-661b0f45a01a admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:08.141798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aec60b-5667-42e4-8b0b-661b0f45a01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:08.142076 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aec60b-5667-42e4-8b0b-661b0f45a01a admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:08.142775 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aec60b-5667-42e4-8b0b-661b0f45a01a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:08.144696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aec60b-5667-42e4-8b0b-661b0f45a01a admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:08.171802 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1035/2061] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:55:08 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:55:08.178057 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197304f1-bf1c-4185-baa2-ea8b3512e9a3 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:08.191012 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197304f1-bf1c-4185-baa2-ea8b3512e9a3 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:08.256138 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247290e-60e8-4dda-b439-2848706ca459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:08.256857 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247290e-60e8-4dda-b439-2848706ca459 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:08.257144 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247290e-60e8-4dda-b439-2848706ca459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:08.257417 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247290e-60e8-4dda-b439-2848706ca459 admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:08.258118 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247290e-60e8-4dda-b439-2848706ca459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:08.260156 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247290e-60e8-4dda-b439-2848706ca459 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:08.288387 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1027/2062] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:55:08 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:55:08.289780 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aec60b-5667-42e4-8b0b-661b0f45a01a admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:08.301174 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aec60b-5667-42e4-8b0b-661b0f45a01a admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:08.308574 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93325bca-0520-4dfe-b027-a01034cfe5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:08.309372 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93325bca-0520-4dfe-b027-a01034cfe5ff admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:08.309684 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93325bca-0520-4dfe-b027-a01034cfe5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:08.310100 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93325bca-0520-4dfe-b027-a01034cfe5ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:08.310851 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93325bca-0520-4dfe-b027-a01034cfe5ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:08.312493 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93325bca-0520-4dfe-b027-a01034cfe5ff admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:08.325185 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1036/2063] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:55:08.329465 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247290e-60e8-4dda-b439-2848706ca459 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:08.340422 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247290e-60e8-4dda-b439-2848706ca459 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:08.345966 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e0736-90d1-49b4-b36c-a2d6c0156225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:08.346864 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e0736-90d1-49b4-b36c-a2d6c0156225 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:08.347141 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e0736-90d1-49b4-b36c-a2d6c0156225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:08.347450 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e0736-90d1-49b4-b36c-a2d6c0156225 admin admin] PATH_INFO: `/v3/projects/be382fb72b744b84a506fb47ebdfbb31/users/08d3f214c42e4a969f2d213d54ff87a8/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:08.359935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:08.364593 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e0736-90d1-49b4-b36c-a2d6c0156225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be382fb72b744b84a506fb47ebdfbb31, user_id=08d3f214c42e4a969f2d213d54ff87a8, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:08.368419 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e0736-90d1-49b4-b36c-a2d6c0156225 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:08.382790 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1028/2064] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:55:08 2022] PUT /identity/v3/projects/be382fb72b744b84a506fb47ebdfbb31/users/08d3f214c42e4a969f2d213d54ff87a8/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:08.386782 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93325bca-0520-4dfe-b027-a01034cfe5ff admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:08.399972 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93325bca-0520-4dfe-b027-a01034cfe5ff admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:08.457057 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a18a79-fb7c-4fdf-adc2-4db3dca17881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:08.457727 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a18a79-fb7c-4fdf-adc2-4db3dca17881 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:08.458048 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a18a79-fb7c-4fdf-adc2-4db3dca17881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:08.458321 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a18a79-fb7c-4fdf-adc2-4db3dca17881 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:08.459212 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a18a79-fb7c-4fdf-adc2-4db3dca17881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:08.460808 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a18a79-fb7c-4fdf-adc2-4db3dca17881 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:08.470892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1037/2065] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:55:08.475540 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e0736-90d1-49b4-b36c-a2d6c0156225 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:08.486470 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e0736-90d1-49b4-b36c-a2d6c0156225 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:08.492468 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523062d-2fb0-4d75-bbb5-1857dd7c49df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:08.493372 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523062d-2fb0-4d75-bbb5-1857dd7c49df admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:08.493660 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523062d-2fb0-4d75-bbb5-1857dd7c49df admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:08.493892 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523062d-2fb0-4d75-bbb5-1857dd7c49df admin admin] PATH_INFO: `/v3/projects/be382fb72b744b84a506fb47ebdfbb31/users/08d3f214c42e4a969f2d213d54ff87a8/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:08.496288 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523062d-2fb0-4d75-bbb5-1857dd7c49df admin admin] RBAC: Authorizing `identity:create_grant(project_id=be382fb72b744b84a506fb47ebdfbb31, user_id=08d3f214c42e4a969f2d213d54ff87a8, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:08.499001 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523062d-2fb0-4d75-bbb5-1857dd7c49df admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:08.510201 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1029/2066] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:55:08 2022] PUT /identity/v3/projects/be382fb72b744b84a506fb47ebdfbb31/users/08d3f214c42e4a969f2d213d54ff87a8/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:08.520288 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004c489-1033-4071-b07c-f445f0d4f244 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:08.520571 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004c489-1033-4071-b07c-f445f0d4f244 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:08.520844 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004c489-1033-4071-b07c-f445f0d4f244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:08.547850 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-c004c489-1033-4071-b07c-f445f0d4f244 None None] MFA Rules not processed for user `08d3f214c42e4a969f2d213d54ff87a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:08.549061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c004c489-1033-4071-b07c-f445f0d4f244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:08.623234 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1038/2067] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:08.636030 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523062d-2fb0-4d75-bbb5-1857dd7c49df admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:08.637946 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-8523062d-2fb0-4d75-bbb5-1857dd7c49df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:08.698282 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523062d-2fb0-4d75-bbb5-1857dd7c49df admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:08.703189 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24de7f-b7e3-40d1-8f1f-bf874919bcd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:08.703842 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24de7f-b7e3-40d1-8f1f-bf874919bcd2 service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:08.704121 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24de7f-b7e3-40d1-8f1f-bf874919bcd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:08.704393 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24de7f-b7e3-40d1-8f1f-bf874919bcd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:08.713779 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24de7f-b7e3-40d1-8f1f-bf874919bcd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:08.715201 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24de7f-b7e3-40d1-8f1f-bf874919bcd2 service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:08.725213 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1030/2068] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:55:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:55:09.047803 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004c489-1033-4071-b07c-f445f0d4f244 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:09.052325 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:09.058597 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004c489-1033-4071-b07c-f445f0d4f244 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:09.064048 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987d5f8-ecc4-4d1f-9d5b-c803e92616d4 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d3f214c42e4a969f2d213d54ff87a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be382fb72b744b84a506fb47ebdfbb31', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:09.064715 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987d5f8-ecc4-4d1f-9d5b-c803e92616d4 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:09.065042 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987d5f8-ecc4-4d1f-9d5b-c803e92616d4 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:09.065331 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987d5f8-ecc4-4d1f-9d5b-c803e92616d4 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:09.066075 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987d5f8-ecc4-4d1f-9d5b-c803e92616d4 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:55:09.066386 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987d5f8-ecc4-4d1f-9d5b-c803e92616d4 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:09.068028 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987d5f8-ecc4-4d1f-9d5b-c803e92616d4 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:09.080067 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1039/2069] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:55:09.084232 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24de7f-b7e3-40d1-8f1f-bf874919bcd2 service cinder] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:09.093935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24de7f-b7e3-40d1-8f1f-bf874919bcd2 service cinder] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:09.099242 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d14063-f337-418e-8ca6-2e181789c6c2 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d3f214c42e4a969f2d213d54ff87a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be382fb72b744b84a506fb47ebdfbb31', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:09.100281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d14063-f337-418e-8ca6-2e181789c6c2 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:09.100599 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d14063-f337-418e-8ca6-2e181789c6c2 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:09.100971 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d14063-f337-418e-8ca6-2e181789c6c2 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:09.101680 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d14063-f337-418e-8ca6-2e181789c6c2 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:09.103686 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d14063-f337-418e-8ca6-2e181789c6c2 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:09.134969 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1031/2070] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:55:09 2022] POST /identity/v3/projects => generated 354 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:55:09.136466 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987d5f8-ecc4-4d1f-9d5b-c803e92616d4 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:09.147842 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987d5f8-ecc4-4d1f-9d5b-c803e92616d4 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:09.207691 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a692b9-bcb6-4624-bb96-9336572a3d17 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d3f214c42e4a969f2d213d54ff87a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be382fb72b744b84a506fb47ebdfbb31', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:09.208375 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a692b9-bcb6-4624-bb96-9336572a3d17 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:09.208716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a692b9-bcb6-4624-bb96-9336572a3d17 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:09.209228 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a692b9-bcb6-4624-bb96-9336572a3d17 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:09.210050 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a692b9-bcb6-4624-bb96-9336572a3d17 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:55:09.210395 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a692b9-bcb6-4624-bb96-9336572a3d17 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:09.212092 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a692b9-bcb6-4624-bb96-9336572a3d17 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:09.225302 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1040/2071] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:55:09.261467 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d14063-f337-418e-8ca6-2e181789c6c2 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:09.272212 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d14063-f337-418e-8ca6-2e181789c6c2 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:09.277256 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f23f7-0b81-4471-b4fc-c1ade90b8cb7 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d3f214c42e4a969f2d213d54ff87a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be382fb72b744b84a506fb47ebdfbb31', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:09.278106 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f23f7-0b81-4471-b4fc-c1ade90b8cb7 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:09.278405 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f23f7-0b81-4471-b4fc-c1ade90b8cb7 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:09.278684 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f23f7-0b81-4471-b4fc-c1ade90b8cb7 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] PATH_INFO: `/v3/projects/9e6d39985ce64c30841ecded84935d39` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:09.280091 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f23f7-0b81-4471-b4fc-c1ade90b8cb7 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9e6d39985ce64c30841ecded84935d39)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:09.282024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f23f7-0b81-4471-b4fc-c1ade90b8cb7 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:09.332412 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ed7f23f7-0b81-4471-b4fc-c1ade90b8cb7 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e6d39985ce64c30841ecded84935d39', 'request_id': 'req-ed7f23f7-0b81-4471-b4fc-c1ade90b8cb7'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:09.340506 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ed7f23f7-0b81-4471-b4fc-c1ade90b8cb7 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e6d39985ce64c30841ecded84935d39', 'request_id': 'req-ed7f23f7-0b81-4471-b4fc-c1ade90b8cb7'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:09.346033 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ed7f23f7-0b81-4471-b4fc-c1ade90b8cb7 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e6d39985ce64c30841ecded84935d39', 'request_id': 'req-ed7f23f7-0b81-4471-b4fc-c1ade90b8cb7'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:09.358874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ed7f23f7-0b81-4471-b4fc-c1ade90b8cb7 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] The token cache is being invalidate because project 9e6d39985ce64c30841ecded84935d39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:55:09.359209 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ed7f23f7-0b81-4471-b4fc-c1ade90b8cb7 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:09.359934 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ed7f23f7-0b81-4471-b4fc-c1ade90b8cb7 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:09.361580 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1032/2072] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:55:09 2022] DELETE /identity/v3/projects/9e6d39985ce64c30841ecded84935d39 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:09.593544 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a692b9-bcb6-4624-bb96-9336572a3d17 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:09.595862 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e0a692b9-bcb6-4624-bb96-9336572a3d17 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:09.675993 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a692b9-bcb6-4624-bb96-9336572a3d17 tempest-VolumeQuotaClassesTest-2126199754 tempest-VolumeQuotaClassesTest-2126199754-project-admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:09.737343 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292bdb5-ef95-45cf-9f57-7b58febcf2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:09.738177 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292bdb5-ef95-45cf-9f57-7b58febcf2c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:09.738462 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292bdb5-ef95-45cf-9f57-7b58febcf2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:09.738740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292bdb5-ef95-45cf-9f57-7b58febcf2c6 admin admin] PATH_INFO: `/v3/users/60706c22f0374cef85d9a7ae5c1a07a1` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:09.740516 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292bdb5-ef95-45cf-9f57-7b58febcf2c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60706c22f0374cef85d9a7ae5c1a07a1)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:09.742508 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292bdb5-ef95-45cf-9f57-7b58febcf2c6 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:09.782774 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:09.796804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b292bdb5-ef95-45cf-9f57-7b58febcf2c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60706c22f0374cef85d9a7ae5c1a07a1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:09.804170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b292bdb5-ef95-45cf-9f57-7b58febcf2c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60706c22f0374cef85d9a7ae5c1a07a1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:09.814086 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b292bdb5-ef95-45cf-9f57-7b58febcf2c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60706c22f0374cef85d9a7ae5c1a07a1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:09.814813 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b292bdb5-ef95-45cf-9f57-7b58febcf2c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60706c22f0374cef85d9a7ae5c1a07a1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:09.827915 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b292bdb5-ef95-45cf-9f57-7b58febcf2c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60706c22f0374cef85d9a7ae5c1a07a1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:09.834493 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1041/2073] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:55:09 2022] DELETE /identity/v3/users/60706c22f0374cef85d9a7ae5c1a07a1 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:09.839620 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa7718-ac35-474c-ad01-4ae30f167ea6 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:09.839945 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa7718-ac35-474c-ad01-4ae30f167ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:09.840225 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa7718-ac35-474c-ad01-4ae30f167ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:09.865285 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-77aa7718-ac35-474c-ad01-4ae30f167ea6 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:09.866551 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-77aa7718-ac35-474c-ad01-4ae30f167ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:09.912116 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:09.949760 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1033/2074] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:09.959750 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292bdb5-ef95-45cf-9f57-7b58febcf2c6 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:09.960862 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b292bdb5-ef95-45cf-9f57-7b58febcf2c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:10.022561 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292bdb5-ef95-45cf-9f57-7b58febcf2c6 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:10.027068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5778a-ed45-4c4c-af30-fa1979b40fa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:10.027851 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5778a-ed45-4c4c-af30-fa1979b40fa7 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:10.028138 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5778a-ed45-4c4c-af30-fa1979b40fa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:10.028435 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5778a-ed45-4c4c-af30-fa1979b40fa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:10.039081 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5778a-ed45-4c4c-af30-fa1979b40fa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:10.040566 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5778a-ed45-4c4c-af30-fa1979b40fa7 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:10.059440 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1042/2075] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:55:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:55:10.362682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa7718-ac35-474c-ad01-4ae30f167ea6 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:10.365564 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-77aa7718-ac35-474c-ad01-4ae30f167ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:10.392695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa7718-ac35-474c-ad01-4ae30f167ea6 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:10.398511 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aeb6b6-4b4d-4878-ba20-c51b29cc18eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:10.399634 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aeb6b6-4b4d-4878-ba20-c51b29cc18eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:10.400000 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aeb6b6-4b4d-4878-ba20-c51b29cc18eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:10.400501 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aeb6b6-4b4d-4878-ba20-c51b29cc18eb admin admin] PATH_INFO: `/v3/projects/5068389aaa2c4f658d133aaf1aa7a979` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:10.402005 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aeb6b6-4b4d-4878-ba20-c51b29cc18eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5068389aaa2c4f658d133aaf1aa7a979)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:10.404455 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aeb6b6-4b4d-4878-ba20-c51b29cc18eb admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:10.465489 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-08aeb6b6-4b4d-4878-ba20-c51b29cc18eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5068389aaa2c4f658d133aaf1aa7a979', 'request_id': 'req-08aeb6b6-4b4d-4878-ba20-c51b29cc18eb'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:10.476370 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-08aeb6b6-4b4d-4878-ba20-c51b29cc18eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5068389aaa2c4f658d133aaf1aa7a979', 'request_id': 'req-08aeb6b6-4b4d-4878-ba20-c51b29cc18eb'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:10.485402 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-08aeb6b6-4b4d-4878-ba20-c51b29cc18eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5068389aaa2c4f658d133aaf1aa7a979', 'request_id': 'req-08aeb6b6-4b4d-4878-ba20-c51b29cc18eb'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:10.508218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-08aeb6b6-4b4d-4878-ba20-c51b29cc18eb admin admin] The token cache is being invalidate because project 5068389aaa2c4f658d133aaf1aa7a979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:55:10.508521 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-08aeb6b6-4b4d-4878-ba20-c51b29cc18eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:10.509239 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-08aeb6b6-4b4d-4878-ba20-c51b29cc18eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:10.510864 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1034/2076] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:55:10 2022] DELETE /identity/v3/projects/5068389aaa2c4f658d133aaf1aa7a979 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:10.514796 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5778a-ed45-4c4c-af30-fa1979b40fa7 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:10.526119 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5778a-ed45-4c4c-af30-fa1979b40fa7 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:10.604526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b582c5-f1e4-4400-b0b8-6ef59c5c0d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:10.605421 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b582c5-f1e4-4400-b0b8-6ef59c5c0d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:10.605790 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b582c5-f1e4-4400-b0b8-6ef59c5c0d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:10.606057 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b582c5-f1e4-4400-b0b8-6ef59c5c0d77 admin admin] PATH_INFO: `/v3/users/08d3f214c42e4a969f2d213d54ff87a8` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:10.607461 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b582c5-f1e4-4400-b0b8-6ef59c5c0d77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08d3f214c42e4a969f2d213d54ff87a8)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:10.615742 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b582c5-f1e4-4400-b0b8-6ef59c5c0d77 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:10.720260 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e3b582c5-f1e4-4400-b0b8-6ef59c5c0d77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08d3f214c42e4a969f2d213d54ff87a8'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:10.728877 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:10.732812 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e3b582c5-f1e4-4400-b0b8-6ef59c5c0d77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08d3f214c42e4a969f2d213d54ff87a8'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:10.745910 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e3b582c5-f1e4-4400-b0b8-6ef59c5c0d77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08d3f214c42e4a969f2d213d54ff87a8'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:10.753361 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e3b582c5-f1e4-4400-b0b8-6ef59c5c0d77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08d3f214c42e4a969f2d213d54ff87a8'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:10.775623 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e3b582c5-f1e4-4400-b0b8-6ef59c5c0d77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08d3f214c42e4a969f2d213d54ff87a8'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:10.784262 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1043/2077] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:55:10 2022] DELETE /identity/v3/users/08d3f214c42e4a969f2d213d54ff87a8 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:55:11.076982 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aeb6b6-4b4d-4878-ba20-c51b29cc18eb admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:11.078718 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-08aeb6b6-4b4d-4878-ba20-c51b29cc18eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:11.096371 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aeb6b6-4b4d-4878-ba20-c51b29cc18eb admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:11.154400 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc9fb5-0827-48f4-abf1-696e87a5fcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:11.155319 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc9fb5-0827-48f4-abf1-696e87a5fcad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:11.155600 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc9fb5-0827-48f4-abf1-696e87a5fcad admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:11.155875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc9fb5-0827-48f4-abf1-696e87a5fcad admin admin] PATH_INFO: `/v3/projects/be382fb72b744b84a506fb47ebdfbb31` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:11.157104 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc9fb5-0827-48f4-abf1-696e87a5fcad admin admin] RBAC: Authorizing `identity:delete_project(project_id=be382fb72b744b84a506fb47ebdfbb31)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:11.159031 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc9fb5-0827-48f4-abf1-696e87a5fcad admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:11.212527 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-0efc9fb5-0827-48f4-abf1-696e87a5fcad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be382fb72b744b84a506fb47ebdfbb31', 'request_id': 'req-0efc9fb5-0827-48f4-abf1-696e87a5fcad'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:11.222945 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-0efc9fb5-0827-48f4-abf1-696e87a5fcad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be382fb72b744b84a506fb47ebdfbb31', 'request_id': 'req-0efc9fb5-0827-48f4-abf1-696e87a5fcad'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:11.229260 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-0efc9fb5-0827-48f4-abf1-696e87a5fcad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be382fb72b744b84a506fb47ebdfbb31', 'request_id': 'req-0efc9fb5-0827-48f4-abf1-696e87a5fcad'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:11.230340 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:11.243032 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-0efc9fb5-0827-48f4-abf1-696e87a5fcad admin admin] The token cache is being invalidate because project be382fb72b744b84a506fb47ebdfbb31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:55:11.243490 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-0efc9fb5-0827-48f4-abf1-696e87a5fcad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:11.244155 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-0efc9fb5-0827-48f4-abf1-696e87a5fcad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:11.245705 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1035/2078] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:55:11 2022] DELETE /identity/v3/projects/be382fb72b744b84a506fb47ebdfbb31 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:11.250701 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66d8f4-1c04-40b4-915f-a8b05f1ca4ca None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:11.251096 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66d8f4-1c04-40b4-915f-a8b05f1ca4ca None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:11.251332 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66d8f4-1c04-40b4-915f-a8b05f1ca4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:11.269038 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-1c66d8f4-1c04-40b4-915f-a8b05f1ca4ca None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:11.270243 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1c66d8f4-1c04-40b4-915f-a8b05f1ca4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:11.334516 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1044/2079] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:11.342382 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0713f31-5452-4441-96d6-da77beddb9e0 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:11.342812 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0713f31-5452-4441-96d6-da77beddb9e0 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:11.343185 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0713f31-5452-4441-96d6-da77beddb9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:11.363666 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-f0713f31-5452-4441-96d6-da77beddb9e0 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:11.365232 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-f0713f31-5452-4441-96d6-da77beddb9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:11.374362 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1036/2080] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:11.378639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66d8f4-1c04-40b4-915f-a8b05f1ca4ca None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:11.388369 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66d8f4-1c04-40b4-915f-a8b05f1ca4ca None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:11.394177 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f69921-71a6-4066-8a92-ab983ac51ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:11.395003 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f69921-71a6-4066-8a92-ab983ac51ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:11.395320 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f69921-71a6-4066-8a92-ab983ac51ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:11.395672 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f69921-71a6-4066-8a92-ab983ac51ad2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:11.396479 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f69921-71a6-4066-8a92-ab983ac51ad2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:55:11.397101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f69921-71a6-4066-8a92-ab983ac51ad2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:11.398553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f69921-71a6-4066-8a92-ab983ac51ad2 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:11.415894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1045/2081] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:55:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:55:11.417145 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0713f31-5452-4441-96d6-da77beddb9e0 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:11.427323 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0713f31-5452-4441-96d6-da77beddb9e0 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:11.433909 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c91653-b44c-4f1b-9e15-50be652833c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:11.434669 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c91653-b44c-4f1b-9e15-50be652833c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:11.435049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c91653-b44c-4f1b-9e15-50be652833c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:11.435459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c91653-b44c-4f1b-9e15-50be652833c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:11.436260 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c91653-b44c-4f1b-9e15-50be652833c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:11.438313 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c91653-b44c-4f1b-9e15-50be652833c5 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:11.466306 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1037/2082] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:55:11 2022] POST /identity/v3/projects => generated 407 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:55:11.470741 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f69921-71a6-4066-8a92-ab983ac51ad2 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:11.481525 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f69921-71a6-4066-8a92-ab983ac51ad2 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:11.544375 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bed24-9d73-4f7f-9b19-508ad383488b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:11.545050 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bed24-9d73-4f7f-9b19-508ad383488b admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:11.545330 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bed24-9d73-4f7f-9b19-508ad383488b admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:11.545622 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bed24-9d73-4f7f-9b19-508ad383488b admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:11.546293 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643bed24-9d73-4f7f-9b19-508ad383488b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:11.548232 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643bed24-9d73-4f7f-9b19-508ad383488b admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:11.580309 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1046/2083] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:55:11 2022] POST /identity/v3/users => generated 304 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:55:11.582441 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c91653-b44c-4f1b-9e15-50be652833c5 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:11.595476 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c91653-b44c-4f1b-9e15-50be652833c5 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:11.601557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ed1b3-1aad-4be7-bb7e-0a07cae8ffe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:11.602464 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ed1b3-1aad-4be7-bb7e-0a07cae8ffe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:11.602850 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ed1b3-1aad-4be7-bb7e-0a07cae8ffe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:11.603238 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ed1b3-1aad-4be7-bb7e-0a07cae8ffe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:11.604063 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ed1b3-1aad-4be7-bb7e-0a07cae8ffe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:11.606814 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ed1b3-1aad-4be7-bb7e-0a07cae8ffe5 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:11.622916 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1038/2084] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:55:11.627309 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bed24-9d73-4f7f-9b19-508ad383488b admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:11.640154 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bed24-9d73-4f7f-9b19-508ad383488b admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:11.645137 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb31d87-8db4-4155-ae82-fb0ebda40668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:11.645819 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb31d87-8db4-4155-ae82-fb0ebda40668 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:11.646154 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb31d87-8db4-4155-ae82-fb0ebda40668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:11.646494 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb31d87-8db4-4155-ae82-fb0ebda40668 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:11.647401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb31d87-8db4-4155-ae82-fb0ebda40668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:11.648877 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb31d87-8db4-4155-ae82-fb0ebda40668 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:11.659793 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1047/2085] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:55:11.664410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ed1b3-1aad-4be7-bb7e-0a07cae8ffe5 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:11.676046 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ed1b3-1aad-4be7-bb7e-0a07cae8ffe5 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:11.682665 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d2711-16ef-478a-b651-9b53442a41a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:11.683608 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d2711-16ef-478a-b651-9b53442a41a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:11.683893 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d2711-16ef-478a-b651-9b53442a41a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:11.684170 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d2711-16ef-478a-b651-9b53442a41a4 admin admin] PATH_INFO: `/v3/projects/226c829577af45ac8272eaec783d1427/users/3ce4c6ff50e84c71afd0480e3c8ce58c/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:11.702030 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d2711-16ef-478a-b651-9b53442a41a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=226c829577af45ac8272eaec783d1427, user_id=3ce4c6ff50e84c71afd0480e3c8ce58c, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:11.704734 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d2711-16ef-478a-b651-9b53442a41a4 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:11.726824 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1039/2086] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:55:11 2022] PUT /identity/v3/projects/226c829577af45ac8272eaec783d1427/users/3ce4c6ff50e84c71afd0480e3c8ce58c/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:11.737965 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fbcfe-ad05-4d03-a8c1-ab3a15e9c06d None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:11.738256 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fbcfe-ad05-4d03-a8c1-ab3a15e9c06d None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:11.738548 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fbcfe-ad05-4d03-a8c1-ab3a15e9c06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:11.767072 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-281fbcfe-ad05-4d03-a8c1-ab3a15e9c06d None None] MFA Rules not processed for user `3ce4c6ff50e84c71afd0480e3c8ce58c`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:11.768358 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-281fbcfe-ad05-4d03-a8c1-ab3a15e9c06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:11.796470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:11.846424 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1048/2087] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:11 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:11.848680 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d2711-16ef-478a-b651-9b53442a41a4 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:11.941407 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d2711-16ef-478a-b651-9b53442a41a4 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:11.947646 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf6a97-31e6-4c21-86a1-90561cf00fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:11.948448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf6a97-31e6-4c21-86a1-90561cf00fea admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:11.948834 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf6a97-31e6-4c21-86a1-90561cf00fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:11.949168 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf6a97-31e6-4c21-86a1-90561cf00fea admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:11.950072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf6a97-31e6-4c21-86a1-90561cf00fea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:11.955782 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf6a97-31e6-4c21-86a1-90561cf00fea admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:12.000370 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1040/2088] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:55:11 2022] POST /identity/v3/projects => generated 409 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:55:12.002214 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fbcfe-ad05-4d03-a8c1-ab3a15e9c06d None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:12.020501 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fbcfe-ad05-4d03-a8c1-ab3a15e9c06d None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:12.092054 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b381f-fef1-4c32-a2a6-998aab61a5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:12.092900 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b381f-fef1-4c32-a2a6-998aab61a5ed admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:12.093194 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b381f-fef1-4c32-a2a6-998aab61a5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:12.093480 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b381f-fef1-4c32-a2a6-998aab61a5ed admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:12.094309 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b381f-fef1-4c32-a2a6-998aab61a5ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:12.096310 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b381f-fef1-4c32-a2a6-998aab61a5ed admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:12.121106 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1049/2089] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:55:12 2022] POST /identity/v3/users => generated 311 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:55:12.122430 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf6a97-31e6-4c21-86a1-90561cf00fea admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:12.133217 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf6a97-31e6-4c21-86a1-90561cf00fea admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:12.137874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02102332-6191-46d4-92b7-49ad5dd3976a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:12.138554 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02102332-6191-46d4-92b7-49ad5dd3976a admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:12.138837 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02102332-6191-46d4-92b7-49ad5dd3976a admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:12.139117 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02102332-6191-46d4-92b7-49ad5dd3976a admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:12.139884 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02102332-6191-46d4-92b7-49ad5dd3976a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:12.141500 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02102332-6191-46d4-92b7-49ad5dd3976a admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:12.152966 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1041/2090] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:55:12.157103 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b381f-fef1-4c32-a2a6-998aab61a5ed admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:12.167469 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b381f-fef1-4c32-a2a6-998aab61a5ed admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:12.172075 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281809dd-558b-476e-9823-7d5c5519efc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:12.172973 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281809dd-558b-476e-9823-7d5c5519efc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:12.173267 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281809dd-558b-476e-9823-7d5c5519efc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:12.173544 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281809dd-558b-476e-9823-7d5c5519efc1 admin admin] PATH_INFO: `/v3/projects/0aa749c4ec844ea98c8298f468f8575d/users/6d801151d06d465ab3f60dd1135c711b/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:12.191664 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281809dd-558b-476e-9823-7d5c5519efc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aa749c4ec844ea98c8298f468f8575d, user_id=6d801151d06d465ab3f60dd1135c711b, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:12.194703 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281809dd-558b-476e-9823-7d5c5519efc1 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:12.209145 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1050/2091] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:55:12 2022] PUT /identity/v3/projects/0aa749c4ec844ea98c8298f468f8575d/users/6d801151d06d465ab3f60dd1135c711b/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:12.213172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02102332-6191-46d4-92b7-49ad5dd3976a admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:12.223438 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02102332-6191-46d4-92b7-49ad5dd3976a admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:12.302523 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e7e14-2ea2-4407-9e56-216f66440559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:12.303738 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e7e14-2ea2-4407-9e56-216f66440559 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:12.303880 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e7e14-2ea2-4407-9e56-216f66440559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:12.304176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e7e14-2ea2-4407-9e56-216f66440559 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:12.305484 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e7e14-2ea2-4407-9e56-216f66440559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:12.307061 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e7e14-2ea2-4407-9e56-216f66440559 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:12.313701 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:12.320418 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1042/2092] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:55:12.324359 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281809dd-558b-476e-9823-7d5c5519efc1 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:12.335507 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281809dd-558b-476e-9823-7d5c5519efc1 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:12.340258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4f450-c45e-43db-80c5-6d7816efcec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:12.341166 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4f450-c45e-43db-80c5-6d7816efcec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:12.341450 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4f450-c45e-43db-80c5-6d7816efcec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:12.341730 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4f450-c45e-43db-80c5-6d7816efcec1 admin admin] PATH_INFO: `/v3/projects/0aa749c4ec844ea98c8298f468f8575d/users/6d801151d06d465ab3f60dd1135c711b/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:12.343863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4f450-c45e-43db-80c5-6d7816efcec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aa749c4ec844ea98c8298f468f8575d, user_id=6d801151d06d465ab3f60dd1135c711b, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:12.346657 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4f450-c45e-43db-80c5-6d7816efcec1 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:12.361418 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1051/2093] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:55:12 2022] PUT /identity/v3/projects/0aa749c4ec844ea98c8298f468f8575d/users/6d801151d06d465ab3f60dd1135c711b/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:12.371966 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb3cd4-4829-46f3-a7e0-6ed9a1e4e9f7 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:12.372448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb3cd4-4829-46f3-a7e0-6ed9a1e4e9f7 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:12.372536 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb3cd4-4829-46f3-a7e0-6ed9a1e4e9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:12.400764 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-9fcb3cd4-4829-46f3-a7e0-6ed9a1e4e9f7 None None] MFA Rules not processed for user `6d801151d06d465ab3f60dd1135c711b`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:12.402203 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-9fcb3cd4-4829-46f3-a7e0-6ed9a1e4e9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:12.477280 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1043/2094] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:12 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:12.488253 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4f450-c45e-43db-80c5-6d7816efcec1 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:12.490194 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c6f4f450-c45e-43db-80c5-6d7816efcec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:12.553838 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4f450-c45e-43db-80c5-6d7816efcec1 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:12.558401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec808576-a0ce-4c7a-96ed-12355c373380 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:12.559047 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec808576-a0ce-4c7a-96ed-12355c373380 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:12.559356 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec808576-a0ce-4c7a-96ed-12355c373380 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:12.559668 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec808576-a0ce-4c7a-96ed-12355c373380 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:12.569982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec808576-a0ce-4c7a-96ed-12355c373380 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:12.571485 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec808576-a0ce-4c7a-96ed-12355c373380 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:12.581758 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1052/2095] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:55:12 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:55:12.673438 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bb693-14cc-459a-9086-ad6219df50ee None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:12.673738 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bb693-14cc-459a-9086-ad6219df50ee None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:12.674028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bb693-14cc-459a-9086-ad6219df50ee None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:12.675496 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1044/2096] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jun 24 10:55:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:55:12.687365 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73b367-f8f5-4a7e-b9e5-e13b4cea5f8c None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:12.687537 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73b367-f8f5-4a7e-b9e5-e13b4cea5f8c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:12.687816 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73b367-f8f5-4a7e-b9e5-e13b4cea5f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:12.727120 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-6d73b367-f8f5-4a7e-b9e5-e13b4cea5f8c None None] MFA Rules not processed for user `b365d9dd635e4518a41181649c323062`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:12.728413 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6d73b367-f8f5-4a7e-b9e5-e13b4cea5f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:12.762239 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bb693-14cc-459a-9086-ad6219df50ee None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:12.762746 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:12.764320 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-a86bb693-14cc-459a-9086-ad6219df50ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:12.783823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bb693-14cc-459a-9086-ad6219df50ee None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:12.797782 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab39db-2aa6-459b-b186-c44575787dc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:12.798543 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab39db-2aa6-459b-b186-c44575787dc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:12.798826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab39db-2aa6-459b-b186-c44575787dc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:12.799096 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab39db-2aa6-459b-b186-c44575787dc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:12.822762 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1053/2097] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jun 24 10:55:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:55:12.838179 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73b367-f8f5-4a7e-b9e5-e13b4cea5f8c None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:12.839740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6d73b367-f8f5-4a7e-b9e5-e13b4cea5f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:12.861190 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73b367-f8f5-4a7e-b9e5-e13b4cea5f8c None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:12.867857 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fdd943-522f-4741-84ca-6ade295ca6b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b365d9dd635e4518a41181649c323062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:12.870356 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdd943-522f-4741-84ca-6ade295ca6b7 service placement] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:12.870356 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdd943-522f-4741-84ca-6ade295ca6b7 service placement] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:12.870356 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdd943-522f-4741-84ca-6ade295ca6b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:12.880331 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fdd943-522f-4741-84ca-6ade295ca6b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:12.882895 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fdd943-522f-4741-84ca-6ade295ca6b7 service placement] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:12.887322 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab39db-2aa6-459b-b186-c44575787dc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:12.889116 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab39db-2aa6-459b-b186-c44575787dc3 service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:12.899207 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1054/2098] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:55:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:55:12.914488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1045/2099] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:55:12 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:55:13.182719 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fdd943-522f-4741-84ca-6ade295ca6b7 service placement] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:13.184915 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-26fdd943-522f-4741-84ca-6ade295ca6b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:13.345024 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fdd943-522f-4741-84ca-6ade295ca6b7 service placement] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:13.350946 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952fda43-4738-4ca0-b35c-28d738eb879d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:13.352178 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fda43-4738-4ca0-b35c-28d738eb879d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:13.352609 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fda43-4738-4ca0-b35c-28d738eb879d admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:13.352926 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fda43-4738-4ca0-b35c-28d738eb879d admin admin] PATH_INFO: `/v3/users/f1886b841d414af899542700c486953e` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:13.354763 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952fda43-4738-4ca0-b35c-28d738eb879d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1886b841d414af899542700c486953e)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:13.357286 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952fda43-4738-4ca0-b35c-28d738eb879d admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:13.427826 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-952fda43-4738-4ca0-b35c-28d738eb879d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1886b841d414af899542700c486953e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:13.437628 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-952fda43-4738-4ca0-b35c-28d738eb879d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1886b841d414af899542700c486953e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:13.448426 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-952fda43-4738-4ca0-b35c-28d738eb879d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1886b841d414af899542700c486953e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:13.449361 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-952fda43-4738-4ca0-b35c-28d738eb879d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1886b841d414af899542700c486953e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:13.464967 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-952fda43-4738-4ca0-b35c-28d738eb879d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1886b841d414af899542700c486953e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:13.471265 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1055/2100] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:55:13 2022] DELETE /identity/v3/users/f1886b841d414af899542700c486953e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:13.476244 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07863ddb-b859-461d-bd04-7407a63b2dff None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:13.476774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07863ddb-b859-461d-bd04-7407a63b2dff None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:13.477605 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07863ddb-b859-461d-bd04-7407a63b2dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:13.496406 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-07863ddb-b859-461d-bd04-7407a63b2dff None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:13.497726 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-07863ddb-b859-461d-bd04-7407a63b2dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:13.510057 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952fda43-4738-4ca0-b35c-28d738eb879d admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:13.511248 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-952fda43-4738-4ca0-b35c-28d738eb879d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:13.540965 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:13.567724 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1046/2101] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:55:13.577636 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07863ddb-b859-461d-bd04-7407a63b2dff None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:13.579012 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-07863ddb-b859-461d-bd04-7407a63b2dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:13.579245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952fda43-4738-4ca0-b35c-28d738eb879d admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:13.583963 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ca4ef-db83-4fac-a304-607928f4c6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:13.584931 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ca4ef-db83-4fac-a304-607928f4c6e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:13.585671 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ca4ef-db83-4fac-a304-607928f4c6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:13.585671 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ca4ef-db83-4fac-a304-607928f4c6e3 admin admin] PATH_INFO: `/v3/users/2499c7e4d2bc4a8d9e9f34459bfda6c3` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:13.586674 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ca4ef-db83-4fac-a304-607928f4c6e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2499c7e4d2bc4a8d9e9f34459bfda6c3)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:13.588768 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ca4ef-db83-4fac-a304-607928f4c6e3 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:13.618919 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:13.645105 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-737ca4ef-db83-4fac-a304-607928f4c6e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2499c7e4d2bc4a8d9e9f34459bfda6c3'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:13.653220 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-737ca4ef-db83-4fac-a304-607928f4c6e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2499c7e4d2bc4a8d9e9f34459bfda6c3'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:13.661755 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-737ca4ef-db83-4fac-a304-607928f4c6e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2499c7e4d2bc4a8d9e9f34459bfda6c3'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:13.662059 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07863ddb-b859-461d-bd04-7407a63b2dff None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:13.662719 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-737ca4ef-db83-4fac-a304-607928f4c6e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2499c7e4d2bc4a8d9e9f34459bfda6c3'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:13.665852 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0fa52-72f6-432a-a13a-6316e708f20e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:13.666429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0fa52-72f6-432a-a13a-6316e708f20e service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:13.666714 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0fa52-72f6-432a-a13a-6316e708f20e service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:13.666986 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0fa52-72f6-432a-a13a-6316e708f20e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:13.675740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-737ca4ef-db83-4fac-a304-607928f4c6e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2499c7e4d2bc4a8d9e9f34459bfda6c3'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:13.676701 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0fa52-72f6-432a-a13a-6316e708f20e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:13.678206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0fa52-72f6-432a-a13a-6316e708f20e service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:13.683035 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1056/2102] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:55:13 2022] DELETE /identity/v3/users/2499c7e4d2bc4a8d9e9f34459bfda6c3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:55:13.691764 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1047/2103] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:55:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:55:13.911852 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ca4ef-db83-4fac-a304-607928f4c6e3 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:13.913760 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-737ca4ef-db83-4fac-a304-607928f4c6e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:13.994316 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ca4ef-db83-4fac-a304-607928f4c6e3 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:14.004394 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fdba8-fcee-40cd-9fa4-6d808bcbdf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:14.005319 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fdba8-fcee-40cd-9fa4-6d808bcbdf2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:14.005671 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fdba8-fcee-40cd-9fa4-6d808bcbdf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:14.006319 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fdba8-fcee-40cd-9fa4-6d808bcbdf2a admin admin] PATH_INFO: `/v3/projects/7c7d7fa494bd4a0bab64a3afd3d0c27c` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:14.008104 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1fdba8-fcee-40cd-9fa4-6d808bcbdf2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c7d7fa494bd4a0bab64a3afd3d0c27c)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:14.010071 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1fdba8-fcee-40cd-9fa4-6d808bcbdf2a admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:14.033114 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0fa52-72f6-432a-a13a-6316e708f20e service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:14.035956 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-10e0fa52-72f6-432a-a13a-6316e708f20e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:14.052115 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0fa52-72f6-432a-a13a-6316e708f20e service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:14.069153 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:14.073076 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6b1fdba8-fcee-40cd-9fa4-6d808bcbdf2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c7d7fa494bd4a0bab64a3afd3d0c27c', 'request_id': 'req-6b1fdba8-fcee-40cd-9fa4-6d808bcbdf2a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:14.082480 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6b1fdba8-fcee-40cd-9fa4-6d808bcbdf2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c7d7fa494bd4a0bab64a3afd3d0c27c', 'request_id': 'req-6b1fdba8-fcee-40cd-9fa4-6d808bcbdf2a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:14.088671 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6b1fdba8-fcee-40cd-9fa4-6d808bcbdf2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c7d7fa494bd4a0bab64a3afd3d0c27c', 'request_id': 'req-6b1fdba8-fcee-40cd-9fa4-6d808bcbdf2a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:14.101067 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6b1fdba8-fcee-40cd-9fa4-6d808bcbdf2a admin admin] The token cache is being invalidate because project 7c7d7fa494bd4a0bab64a3afd3d0c27c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:55:14.101367 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6b1fdba8-fcee-40cd-9fa4-6d808bcbdf2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:14.102016 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6b1fdba8-fcee-40cd-9fa4-6d808bcbdf2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:14.104040 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1057/2104] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:55:13 2022] DELETE /identity/v3/projects/7c7d7fa494bd4a0bab64a3afd3d0c27c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:14.107858 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fdba8-fcee-40cd-9fa4-6d808bcbdf2a admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:14.118687 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6b1fdba8-fcee-40cd-9fa4-6d808bcbdf2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:14.126813 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea2166-a21a-4058-ae0c-201acf9852b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:14.127673 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea2166-a21a-4058-ae0c-201acf9852b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:14.127960 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea2166-a21a-4058-ae0c-201acf9852b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:14.128231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea2166-a21a-4058-ae0c-201acf9852b3 admin admin] PATH_INFO: `/v3/projects/d8cff6160f4e4cb29c379cd6aff79ca3` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:14.129416 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea2166-a21a-4058-ae0c-201acf9852b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8cff6160f4e4cb29c379cd6aff79ca3)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:14.131539 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea2166-a21a-4058-ae0c-201acf9852b3 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:14.177674 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-1aea2166-a21a-4058-ae0c-201acf9852b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8cff6160f4e4cb29c379cd6aff79ca3', 'request_id': 'req-1aea2166-a21a-4058-ae0c-201acf9852b3'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:14.186496 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-1aea2166-a21a-4058-ae0c-201acf9852b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8cff6160f4e4cb29c379cd6aff79ca3', 'request_id': 'req-1aea2166-a21a-4058-ae0c-201acf9852b3'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:14.187686 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fdba8-fcee-40cd-9fa4-6d808bcbdf2a admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:14.192802 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-1aea2166-a21a-4058-ae0c-201acf9852b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8cff6160f4e4cb29c379cd6aff79ca3', 'request_id': 'req-1aea2166-a21a-4058-ae0c-201acf9852b3'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:14.204721 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-1aea2166-a21a-4058-ae0c-201acf9852b3 admin admin] The token cache is being invalidate because project d8cff6160f4e4cb29c379cd6aff79ca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:55:14.205010 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-1aea2166-a21a-4058-ae0c-201acf9852b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:14.205657 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-1aea2166-a21a-4058-ae0c-201acf9852b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:14.207259 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1048/2105] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:55:14 2022] DELETE /identity/v3/projects/d8cff6160f4e4cb29c379cd6aff79ca3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:14.213224 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284929f-2b21-41ca-b143-8287591abee6 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:14.213520 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284929f-2b21-41ca-b143-8287591abee6 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:14.213798 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284929f-2b21-41ca-b143-8287591abee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:14.232319 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-6284929f-2b21-41ca-b143-8287591abee6 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:14.233563 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-6284929f-2b21-41ca-b143-8287591abee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:14.248233 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f004bf-9c40-4f37-afca-7ab0f3ae04d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:14.249149 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f004bf-9c40-4f37-afca-7ab0f3ae04d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:14.249427 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f004bf-9c40-4f37-afca-7ab0f3ae04d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:14.249697 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f004bf-9c40-4f37-afca-7ab0f3ae04d6 admin admin] PATH_INFO: `/v3/users/2a04a2272c344b32aa20505ae9be912a` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:14.250976 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f004bf-9c40-4f37-afca-7ab0f3ae04d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a04a2272c344b32aa20505ae9be912a)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:14.252931 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f004bf-9c40-4f37-afca-7ab0f3ae04d6 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:14.285740 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:14.298860 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1049/2106] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:55:14.307408 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce5c20-7338-47f6-9763-0bcd56c41be2 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:14.307693 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce5c20-7338-47f6-9763-0bcd56c41be2 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:14.308030 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce5c20-7338-47f6-9763-0bcd56c41be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:14.311995 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e1f004bf-9c40-4f37-afca-7ab0f3ae04d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a04a2272c344b32aa20505ae9be912a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:14.321245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e1f004bf-9c40-4f37-afca-7ab0f3ae04d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a04a2272c344b32aa20505ae9be912a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:14.331304 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-70ce5c20-7338-47f6-9763-0bcd56c41be2 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:14.332833 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-70ce5c20-7338-47f6-9763-0bcd56c41be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:14.344535 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e1f004bf-9c40-4f37-afca-7ab0f3ae04d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a04a2272c344b32aa20505ae9be912a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:14.345494 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e1f004bf-9c40-4f37-afca-7ab0f3ae04d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a04a2272c344b32aa20505ae9be912a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:14.346696 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1050/2107] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:55:14.351084 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce5c20-7338-47f6-9763-0bcd56c41be2 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:14.361485 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce5c20-7338-47f6-9763-0bcd56c41be2 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:14.366725 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490aafa-5ac9-479d-adf5-8d49daacdcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:14.367643 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490aafa-5ac9-479d-adf5-8d49daacdcfb admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:14.367740 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490aafa-5ac9-479d-adf5-8d49daacdcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:14.368040 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490aafa-5ac9-479d-adf5-8d49daacdcfb admin admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:14.368797 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490aafa-5ac9-479d-adf5-8d49daacdcfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:55:14.369106 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490aafa-5ac9-479d-adf5-8d49daacdcfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:14.369711 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e1f004bf-9c40-4f37-afca-7ab0f3ae04d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a04a2272c344b32aa20505ae9be912a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:14.370976 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490aafa-5ac9-479d-adf5-8d49daacdcfb admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:14.376413 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:14.388658 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1058/2108] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:55:14 2022] DELETE /identity/v3/users/2a04a2272c344b32aa20505ae9be912a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:55:14.389400 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1051/2109] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:55:14.389638 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f004bf-9c40-4f37-afca-7ab0f3ae04d6 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:14.392019 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e1f004bf-9c40-4f37-afca-7ab0f3ae04d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:14.484020 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f004bf-9c40-4f37-afca-7ab0f3ae04d6 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:14.496048 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45399790-b233-492b-abcf-e5389ebc40ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:14.496048 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45399790-b233-492b-abcf-e5389ebc40ac admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:14.496048 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45399790-b233-492b-abcf-e5389ebc40ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:14.496048 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45399790-b233-492b-abcf-e5389ebc40ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:14.496426 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45399790-b233-492b-abcf-e5389ebc40ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:14.496426 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45399790-b233-492b-abcf-e5389ebc40ac admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:14.544186 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1059/2110] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:55:14 2022] POST /identity/v3/projects => generated 369 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:55:14.545465 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490aafa-5ac9-479d-adf5-8d49daacdcfb admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:14.560154 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490aafa-5ac9-479d-adf5-8d49daacdcfb admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:14.656297 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf3ba2-da98-4616-88af-0d8ecb34cad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:14.658890 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf3ba2-da98-4616-88af-0d8ecb34cad1 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:14.660231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf3ba2-da98-4616-88af-0d8ecb34cad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:14.663297 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf3ba2-da98-4616-88af-0d8ecb34cad1 admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:14.664234 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf3ba2-da98-4616-88af-0d8ecb34cad1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:14.666586 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf3ba2-da98-4616-88af-0d8ecb34cad1 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:14.687178 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45399790-b233-492b-abcf-e5389ebc40ac admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:14.689102 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-45399790-b233-492b-abcf-e5389ebc40ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:14.697515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1052/2111] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:55:14 2022] POST /identity/v3/users => generated 285 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:55:14.702748 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf3ba2-da98-4616-88af-0d8ecb34cad1 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:14.710898 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45399790-b233-492b-abcf-e5389ebc40ac admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:14.715904 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5638eb-6323-4bba-89cc-c6e4c65f8659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:14.716792 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5638eb-6323-4bba-89cc-c6e4c65f8659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:14.717200 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5638eb-6323-4bba-89cc-c6e4c65f8659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:14.717480 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5638eb-6323-4bba-89cc-c6e4c65f8659 admin admin] PATH_INFO: `/v3/projects/48e1424b52d44c539758eb68bcbc0d4f` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:14.718660 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5638eb-6323-4bba-89cc-c6e4c65f8659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48e1424b52d44c539758eb68bcbc0d4f)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:14.721582 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5638eb-6323-4bba-89cc-c6e4c65f8659 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:14.727086 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf3ba2-da98-4616-88af-0d8ecb34cad1 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:14.732108 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddace6-195f-471c-ba63-0520df7b4cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:14.733071 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddace6-195f-471c-ba63-0520df7b4cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:14.733358 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddace6-195f-471c-ba63-0520df7b4cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:14.733637 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddace6-195f-471c-ba63-0520df7b4cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:14.734885 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ddace6-195f-471c-ba63-0520df7b4cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:14.736593 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ddace6-195f-471c-ba63-0520df7b4cd8 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:14.750895 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1053/2112] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:55:14.751750 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddace6-195f-471c-ba63-0520df7b4cd8 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:14.762776 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddace6-195f-471c-ba63-0520df7b4cd8 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:14.778467 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-fd5638eb-6323-4bba-89cc-c6e4c65f8659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48e1424b52d44c539758eb68bcbc0d4f', 'request_id': 'req-fd5638eb-6323-4bba-89cc-c6e4c65f8659'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:14.788822 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-fd5638eb-6323-4bba-89cc-c6e4c65f8659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48e1424b52d44c539758eb68bcbc0d4f', 'request_id': 'req-fd5638eb-6323-4bba-89cc-c6e4c65f8659'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:14.796281 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-fd5638eb-6323-4bba-89cc-c6e4c65f8659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48e1424b52d44c539758eb68bcbc0d4f', 'request_id': 'req-fd5638eb-6323-4bba-89cc-c6e4c65f8659'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:14.811475 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-fd5638eb-6323-4bba-89cc-c6e4c65f8659 admin admin] The token cache is being invalidate because project 48e1424b52d44c539758eb68bcbc0d4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:55:14.811761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-fd5638eb-6323-4bba-89cc-c6e4c65f8659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:14.812414 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-fd5638eb-6323-4bba-89cc-c6e4c65f8659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:14.814292 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1060/2113] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:55:14 2022] DELETE /identity/v3/projects/48e1424b52d44c539758eb68bcbc0d4f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:55:14.826634 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafbc44-8419-462c-8b0d-57d466e4a845 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:14.827078 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafbc44-8419-462c-8b0d-57d466e4a845 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:14.827391 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafbc44-8419-462c-8b0d-57d466e4a845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:14.836186 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f642e5-5d30-4b13-b41b-4b83063c5048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:14.836938 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f642e5-5d30-4b13-b41b-4b83063c5048 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:14.837224 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f642e5-5d30-4b13-b41b-4b83063c5048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:14.837548 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f642e5-5d30-4b13-b41b-4b83063c5048 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:14.838270 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f642e5-5d30-4b13-b41b-4b83063c5048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:14.839908 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f642e5-5d30-4b13-b41b-4b83063c5048 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:14.848811 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-9cafbc44-8419-462c-8b0d-57d466e4a845 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:14.851329 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1054/2114] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:55:14.851549 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9cafbc44-8419-462c-8b0d-57d466e4a845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:14.855567 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f642e5-5d30-4b13-b41b-4b83063c5048 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:14.864156 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-e1f642e5-5d30-4b13-b41b-4b83063c5048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:14.864873 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1061/2115] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:14.879050 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f642e5-5d30-4b13-b41b-4b83063c5048 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:14.880749 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd099f-704b-401f-b60a-4ec93704e1a7 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:14.881276 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd099f-704b-401f-b60a-4ec93704e1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:14.881649 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd099f-704b-401f-b60a-4ec93704e1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:14.886043 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51e1c2-9582-4364-a3f2-c82aca6bd530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:14.886926 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51e1c2-9582-4364-a3f2-c82aca6bd530 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:14.887260 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51e1c2-9582-4364-a3f2-c82aca6bd530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:14.887543 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51e1c2-9582-4364-a3f2-c82aca6bd530 admin admin] PATH_INFO: `/v3/projects/e59ac361b1954e01b4a2233c0c784f5f/users/452f11aeadbc4e14a75612a8d3200cb1/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:14.903003 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-8efd099f-704b-401f-b60a-4ec93704e1a7 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:14.904424 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-8efd099f-704b-401f-b60a-4ec93704e1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:14.909469 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51e1c2-9582-4364-a3f2-c82aca6bd530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59ac361b1954e01b4a2233c0c784f5f, user_id=452f11aeadbc4e14a75612a8d3200cb1, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:14.913463 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51e1c2-9582-4364-a3f2-c82aca6bd530 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:14.918883 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1062/2116] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:14.923931 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd099f-704b-401f-b60a-4ec93704e1a7 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:14.939121 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1055/2117] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:55:14 2022] PUT /identity/v3/projects/e59ac361b1954e01b4a2233c0c784f5f/users/452f11aeadbc4e14a75612a8d3200cb1/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:14.939334 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd099f-704b-401f-b60a-4ec93704e1a7 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:14.941674 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f943b1-1362-4c70-9830-5c087c83f14a None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:14.942036 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f943b1-1362-4c70-9830-5c087c83f14a None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:14.942385 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f943b1-1362-4c70-9830-5c087c83f14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:14.985016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-57f943b1-1362-4c70-9830-5c087c83f14a None None] MFA Rules not processed for user `452f11aeadbc4e14a75612a8d3200cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:14.986391 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-57f943b1-1362-4c70-9830-5c087c83f14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:15.006068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:15.016560 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42dbf5b-b29f-4be4-ab46-7fe2b189953d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:15.017316 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dbf5b-b29f-4be4-ab46-7fe2b189953d admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:15.017578 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dbf5b-b29f-4be4-ab46-7fe2b189953d admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:15.017734 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:15.017890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dbf5b-b29f-4be4-ab46-7fe2b189953d admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:15.018777 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42dbf5b-b29f-4be4-ab46-7fe2b189953d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:55:15.019511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42dbf5b-b29f-4be4-ab46-7fe2b189953d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:15.022973 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42dbf5b-b29f-4be4-ab46-7fe2b189953d admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:15.038519 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1063/2118] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:55:15.044866 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42dbf5b-b29f-4be4-ab46-7fe2b189953d admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:15.056915 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42dbf5b-b29f-4be4-ab46-7fe2b189953d admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:15.063453 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b353418-4db9-40ae-b186-2d342d724e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:15.064233 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b353418-4db9-40ae-b186-2d342d724e16 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:15.064539 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b353418-4db9-40ae-b186-2d342d724e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:15.064899 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b353418-4db9-40ae-b186-2d342d724e16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:15.065676 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b353418-4db9-40ae-b186-2d342d724e16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:15.067693 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b353418-4db9-40ae-b186-2d342d724e16 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:15.077580 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1056/2119] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:14 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:55:15.091727 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f943b1-1362-4c70-9830-5c087c83f14a None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:15.093885 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-57f943b1-1362-4c70-9830-5c087c83f14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:15.103911 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1064/2120] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:55:15 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:55:15.104897 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b353418-4db9-40ae-b186-2d342d724e16 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:15.159706 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f943b1-1362-4c70-9830-5c087c83f14a None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:15.174896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b353418-4db9-40ae-b186-2d342d724e16 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:15.180655 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a1cbb-12c5-435e-a6fa-c84664e312f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:15.181339 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a1cbb-12c5-435e-a6fa-c84664e312f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:15.181623 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a1cbb-12c5-435e-a6fa-c84664e312f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:15.181910 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a1cbb-12c5-435e-a6fa-c84664e312f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:15.182606 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a1cbb-12c5-435e-a6fa-c84664e312f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:15.184562 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a1cbb-12c5-435e-a6fa-c84664e312f8 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:15.208117 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1065/2121] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:55:15 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:55:15.212232 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a1cbb-12c5-435e-a6fa-c84664e312f8 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:15.227496 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a1cbb-12c5-435e-a6fa-c84664e312f8 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:15.230187 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0030f-34a6-4695-9ed1-2c62798fea62 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcba737e66244fe2b5b6ec3dd17dabd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:15.230862 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0030f-34a6-4695-9ed1-2c62798fea62 service glance] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:15.231172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0030f-34a6-4695-9ed1-2c62798fea62 service glance] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:15.231583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0030f-34a6-4695-9ed1-2c62798fea62 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:15.234575 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9447c8b-972a-4eb4-8bce-d6803068c7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:15.235452 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9447c8b-972a-4eb4-8bce-d6803068c7be admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:15.236010 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9447c8b-972a-4eb4-8bce-d6803068c7be admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:15.236435 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9447c8b-972a-4eb4-8bce-d6803068c7be admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:15.237378 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9447c8b-972a-4eb4-8bce-d6803068c7be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:15.239261 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9447c8b-972a-4eb4-8bce-d6803068c7be admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:15.251807 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1066/2122] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:55:15.255686 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9447c8b-972a-4eb4-8bce-d6803068c7be admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:15.266492 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9447c8b-972a-4eb4-8bce-d6803068c7be admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:15.273528 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b2af4-c43b-4747-ab12-82ff9237be94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:15.274210 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b2af4-c43b-4747-ab12-82ff9237be94 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:15.274498 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b2af4-c43b-4747-ab12-82ff9237be94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:15.274778 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b2af4-c43b-4747-ab12-82ff9237be94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:15.275681 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b2af4-c43b-4747-ab12-82ff9237be94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:15.277319 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b2af4-c43b-4747-ab12-82ff9237be94 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:15.293082 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1067/2123] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:55:15.294078 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b2af4-c43b-4747-ab12-82ff9237be94 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:15.302679 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff0030f-34a6-4695-9ed1-2c62798fea62 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:15.304362 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff0030f-34a6-4695-9ed1-2c62798fea62 service glance] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:15.305090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b2af4-c43b-4747-ab12-82ff9237be94 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:15.310178 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c7632-1087-484b-8207-5b5ec4833546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:15.311076 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c7632-1087-484b-8207-5b5ec4833546 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:15.311409 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c7632-1087-484b-8207-5b5ec4833546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:15.311663 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c7632-1087-484b-8207-5b5ec4833546 admin admin] PATH_INFO: `/v3/projects/846143aa0da747b5a27f042a1cbc8cdd/users/5f25977a6ff5497db067c014e7fa623e/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:15.316318 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1057/2124] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:55:15 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:55:15.329585 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c7632-1087-484b-8207-5b5ec4833546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=846143aa0da747b5a27f042a1cbc8cdd, user_id=5f25977a6ff5497db067c014e7fa623e, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:15.332283 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c7632-1087-484b-8207-5b5ec4833546 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:15.348647 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1068/2125] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:55:15 2022] PUT /identity/v3/projects/846143aa0da747b5a27f042a1cbc8cdd/users/5f25977a6ff5497db067c014e7fa623e/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:15.362565 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf724c-c956-4d9b-afcd-04cabcfca968 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:15.362859 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf724c-c956-4d9b-afcd-04cabcfca968 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:15.363142 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf724c-c956-4d9b-afcd-04cabcfca968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:15.391403 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-30cf724c-c956-4d9b-afcd-04cabcfca968 None None] MFA Rules not processed for user `5f25977a6ff5497db067c014e7fa623e`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:15.392555 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-30cf724c-c956-4d9b-afcd-04cabcfca968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:15.415397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:15.487775 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1058/2126] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:15.489024 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c7632-1087-484b-8207-5b5ec4833546 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:15.567228 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c7632-1087-484b-8207-5b5ec4833546 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:15.573651 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab1e64-4c20-42f8-8367-dbf858ac4391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:15.574518 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab1e64-4c20-42f8-8367-dbf858ac4391 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:15.574866 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab1e64-4c20-42f8-8367-dbf858ac4391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:15.575250 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab1e64-4c20-42f8-8367-dbf858ac4391 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:15.576013 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab1e64-4c20-42f8-8367-dbf858ac4391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:15.578266 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab1e64-4c20-42f8-8367-dbf858ac4391 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:15.614407 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:15.638687 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1069/2127] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:55:15 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:55:15.643480 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf724c-c956-4d9b-afcd-04cabcfca968 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:15.659500 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf724c-c956-4d9b-afcd-04cabcfca968 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:15.737687 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8332e78-7120-4d18-b27b-6895de45a6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:15.738487 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8332e78-7120-4d18-b27b-6895de45a6e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:15.739554 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8332e78-7120-4d18-b27b-6895de45a6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:15.739890 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8332e78-7120-4d18-b27b-6895de45a6e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:15.740888 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8332e78-7120-4d18-b27b-6895de45a6e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:15.743316 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8332e78-7120-4d18-b27b-6895de45a6e5 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:15.774752 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1059/2128] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:55:15 2022] POST /identity/v3/users => generated 294 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:55:15.779465 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab1e64-4c20-42f8-8367-dbf858ac4391 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:15.790655 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab1e64-4c20-42f8-8367-dbf858ac4391 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:15.809927 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d2940-ab42-4e78-8f89-93f621297f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:15.811065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d2940-ab42-4e78-8f89-93f621297f1f admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:15.811703 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d2940-ab42-4e78-8f89-93f621297f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:15.812125 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d2940-ab42-4e78-8f89-93f621297f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:15.813216 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d2940-ab42-4e78-8f89-93f621297f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:15.815004 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d2940-ab42-4e78-8f89-93f621297f1f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:15.832205 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1070/2129] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:55:15.833432 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8332e78-7120-4d18-b27b-6895de45a6e5 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:15.846956 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8332e78-7120-4d18-b27b-6895de45a6e5 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:15.853446 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b0753-9c53-4504-a45b-c5cee3d5f986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:15.854547 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b0753-9c53-4504-a45b-c5cee3d5f986 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:15.854962 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b0753-9c53-4504-a45b-c5cee3d5f986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:15.855359 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b0753-9c53-4504-a45b-c5cee3d5f986 admin admin] PATH_INFO: `/v3/projects/14ae19f9040645b6b444e54e13da9e7c/users/702fe471d68f401895fc66994f7ad992/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:15.880570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b0753-9c53-4504-a45b-c5cee3d5f986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14ae19f9040645b6b444e54e13da9e7c, user_id=702fe471d68f401895fc66994f7ad992, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:15.885472 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b0753-9c53-4504-a45b-c5cee3d5f986 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:15.912454 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d2940-ab42-4e78-8f89-93f621297f1f admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:15.913672 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1060/2130] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:55:15 2022] PUT /identity/v3/projects/14ae19f9040645b6b444e54e13da9e7c/users/702fe471d68f401895fc66994f7ad992/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:55:15.923180 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d2940-ab42-4e78-8f89-93f621297f1f admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:15.987320 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610d064-a778-461d-9f73-17539980dd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:15.988003 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610d064-a778-461d-9f73-17539980dd39 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:15.988289 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610d064-a778-461d-9f73-17539980dd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:15.988568 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610d064-a778-461d-9f73-17539980dd39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:15.989304 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b610d064-a778-461d-9f73-17539980dd39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:15.991328 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b610d064-a778-461d-9f73-17539980dd39 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:16.001505 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1071/2131] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:55:16.006074 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b0753-9c53-4504-a45b-c5cee3d5f986 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:16.016560 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b0753-9c53-4504-a45b-c5cee3d5f986 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:16.021547 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1b2a6-da2f-4761-821e-563a5b4d1819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:16.022563 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1b2a6-da2f-4761-821e-563a5b4d1819 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:16.022841 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1b2a6-da2f-4761-821e-563a5b4d1819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:16.023118 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1b2a6-da2f-4761-821e-563a5b4d1819 admin admin] PATH_INFO: `/v3/projects/14ae19f9040645b6b444e54e13da9e7c/users/702fe471d68f401895fc66994f7ad992/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:16.025171 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d1b2a6-da2f-4761-821e-563a5b4d1819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14ae19f9040645b6b444e54e13da9e7c, user_id=702fe471d68f401895fc66994f7ad992, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:16.027899 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d1b2a6-da2f-4761-821e-563a5b4d1819 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:16.039206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1061/2132] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:55:16 2022] PUT /identity/v3/projects/14ae19f9040645b6b444e54e13da9e7c/users/702fe471d68f401895fc66994f7ad992/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:16.049450 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b090b-521e-40ad-89dc-24a0e0459e35 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:16.049746 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b090b-521e-40ad-89dc-24a0e0459e35 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:16.050033 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b090b-521e-40ad-89dc-24a0e0459e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:16.078059 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-185b090b-521e-40ad-89dc-24a0e0459e35 None None] MFA Rules not processed for user `702fe471d68f401895fc66994f7ad992`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:16.079347 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-185b090b-521e-40ad-89dc-24a0e0459e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:16.152128 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1072/2133] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:16 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:16.162957 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1b2a6-da2f-4761-821e-563a5b4d1819 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:16.164817 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-33d1b2a6-da2f-4761-821e-563a5b4d1819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:16.222825 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1b2a6-da2f-4761-821e-563a5b4d1819 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:16.227017 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06ef00-5a27-4fe7-bb5b-2e7e19af6327 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:16.227727 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06ef00-5a27-4fe7-bb5b-2e7e19af6327 service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:16.228013 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06ef00-5a27-4fe7-bb5b-2e7e19af6327 service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:16.228286 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06ef00-5a27-4fe7-bb5b-2e7e19af6327 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:16.255696 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:16.291261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06ef00-5a27-4fe7-bb5b-2e7e19af6327 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:16.292809 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06ef00-5a27-4fe7-bb5b-2e7e19af6327 service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:16.306663 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1062/2134] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:55:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:55:26.149199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=70 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:26.298960 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=16 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:26.439509 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b090b-521e-40ad-89dc-24a0e0459e35 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:26.511807 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b090b-521e-40ad-89dc-24a0e0459e35 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:26.516611 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58c2fd-3821-4a4e-ae3e-5412333693d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:26.517600 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58c2fd-3821-4a4e-ae3e-5412333693d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:26.517881 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58c2fd-3821-4a4e-ae3e-5412333693d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:26.518186 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58c2fd-3821-4a4e-ae3e-5412333693d8 admin admin] PATH_INFO: `/v3/users/5f25977a6ff5497db067c014e7fa623e` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:26.519624 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58c2fd-3821-4a4e-ae3e-5412333693d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f25977a6ff5497db067c014e7fa623e)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:26.521705 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58c2fd-3821-4a4e-ae3e-5412333693d8 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:26.573214 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-1f58c2fd-3821-4a4e-ae3e-5412333693d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f25977a6ff5497db067c014e7fa623e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:26.584917 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-1f58c2fd-3821-4a4e-ae3e-5412333693d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f25977a6ff5497db067c014e7fa623e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:26.598751 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-1f58c2fd-3821-4a4e-ae3e-5412333693d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f25977a6ff5497db067c014e7fa623e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:26.599808 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-1f58c2fd-3821-4a4e-ae3e-5412333693d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f25977a6ff5497db067c014e7fa623e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:26.615626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-1f58c2fd-3821-4a4e-ae3e-5412333693d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f25977a6ff5497db067c014e7fa623e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:26.622295 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1073/2135] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:55:26 2022] DELETE /identity/v3/users/5f25977a6ff5497db067c014e7fa623e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:26.627285 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0db71-9f0f-4be6-91da-84e673cf641e None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:26.627570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0db71-9f0f-4be6-91da-84e673cf641e None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:26.627848 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0db71-9f0f-4be6-91da-84e673cf641e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:26.646687 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-a5d0db71-9f0f-4be6-91da-84e673cf641e None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:26.647941 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-a5d0db71-9f0f-4be6-91da-84e673cf641e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:26.717952 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1063/2136] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:26.728737 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58c2fd-3821-4a4e-ae3e-5412333693d8 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:26.730988 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1f58c2fd-3821-4a4e-ae3e-5412333693d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:26.819802 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58c2fd-3821-4a4e-ae3e-5412333693d8 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:26.826007 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22625d35-aeae-469f-a52f-d988c7982500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:26.827104 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22625d35-aeae-469f-a52f-d988c7982500 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:26.827707 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22625d35-aeae-469f-a52f-d988c7982500 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:26.828237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22625d35-aeae-469f-a52f-d988c7982500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:26.844706 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22625d35-aeae-469f-a52f-d988c7982500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:26.847769 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22625d35-aeae-469f-a52f-d988c7982500 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:26.860737 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1074/2137] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:55:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:55:26.994199 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0db71-9f0f-4be6-91da-84e673cf641e None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:26.996076 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-a5d0db71-9f0f-4be6-91da-84e673cf641e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:27.009374 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0db71-9f0f-4be6-91da-84e673cf641e None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:27.015206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4eb01-fd86-4fbe-bb0b-7bc5381c11cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:27.016173 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4eb01-fd86-4fbe-bb0b-7bc5381c11cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:27.016458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4eb01-fd86-4fbe-bb0b-7bc5381c11cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:27.016733 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4eb01-fd86-4fbe-bb0b-7bc5381c11cc admin admin] PATH_INFO: `/v3/users/3ce4c6ff50e84c71afd0480e3c8ce58c` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:27.018115 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4eb01-fd86-4fbe-bb0b-7bc5381c11cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ce4c6ff50e84c71afd0480e3c8ce58c)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:27.020301 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4eb01-fd86-4fbe-bb0b-7bc5381c11cc admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:27.076823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-8cb4eb01-fd86-4fbe-bb0b-7bc5381c11cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ce4c6ff50e84c71afd0480e3c8ce58c'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:27.084831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-8cb4eb01-fd86-4fbe-bb0b-7bc5381c11cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ce4c6ff50e84c71afd0480e3c8ce58c'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:27.093082 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-8cb4eb01-fd86-4fbe-bb0b-7bc5381c11cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ce4c6ff50e84c71afd0480e3c8ce58c'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:27.093980 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-8cb4eb01-fd86-4fbe-bb0b-7bc5381c11cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ce4c6ff50e84c71afd0480e3c8ce58c'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:27.107641 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-8cb4eb01-fd86-4fbe-bb0b-7bc5381c11cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ce4c6ff50e84c71afd0480e3c8ce58c'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:27.116761 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1064/2138] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:55:26 2022] DELETE /identity/v3/users/3ce4c6ff50e84c71afd0480e3c8ce58c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:27.118938 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e751af-dab2-4b7b-b09f-37d8d2b86c24 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:27.119319 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e751af-dab2-4b7b-b09f-37d8d2b86c24 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:27.119604 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e751af-dab2-4b7b-b09f-37d8d2b86c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:27.138218 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-e7e751af-dab2-4b7b-b09f-37d8d2b86c24 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:27.139566 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e7e751af-dab2-4b7b-b09f-37d8d2b86c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:27.160653 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:27.182347 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4eb01-fd86-4fbe-bb0b-7bc5381c11cc admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:27.184784 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-8cb4eb01-fd86-4fbe-bb0b-7bc5381c11cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:27.231565 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1075/2139] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:27.238123 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e751af-dab2-4b7b-b09f-37d8d2b86c24 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:27.239604 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e7e751af-dab2-4b7b-b09f-37d8d2b86c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:27.259796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4eb01-fd86-4fbe-bb0b-7bc5381c11cc admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:27.264635 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab69045-c15f-4c12-8feb-35f01f53525e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:27.265508 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab69045-c15f-4c12-8feb-35f01f53525e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:27.265789 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab69045-c15f-4c12-8feb-35f01f53525e admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:27.266065 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab69045-c15f-4c12-8feb-35f01f53525e admin admin] PATH_INFO: `/v3/projects/846143aa0da747b5a27f042a1cbc8cdd` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:27.267285 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab69045-c15f-4c12-8feb-35f01f53525e admin admin] RBAC: Authorizing `identity:delete_project(project_id=846143aa0da747b5a27f042a1cbc8cdd)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:27.269210 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab69045-c15f-4c12-8feb-35f01f53525e admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:27.285805 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:27.300046 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e751af-dab2-4b7b-b09f-37d8d2b86c24 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:27.304699 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab3ce3-990e-4277-8670-64a7d4394c96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:27.305828 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab3ce3-990e-4277-8670-64a7d4394c96 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:27.306123 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab3ce3-990e-4277-8670-64a7d4394c96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:27.306407 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab3ce3-990e-4277-8670-64a7d4394c96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:27.317436 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab3ce3-990e-4277-8670-64a7d4394c96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:27.319261 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab3ce3-990e-4277-8670-64a7d4394c96 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:27.324810 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-6ab69045-c15f-4c12-8feb-35f01f53525e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '846143aa0da747b5a27f042a1cbc8cdd', 'request_id': 'req-6ab69045-c15f-4c12-8feb-35f01f53525e'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:27.329912 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1076/2140] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:55:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:55:27.333410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-6ab69045-c15f-4c12-8feb-35f01f53525e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '846143aa0da747b5a27f042a1cbc8cdd', 'request_id': 'req-6ab69045-c15f-4c12-8feb-35f01f53525e'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:27.339590 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-6ab69045-c15f-4c12-8feb-35f01f53525e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '846143aa0da747b5a27f042a1cbc8cdd', 'request_id': 'req-6ab69045-c15f-4c12-8feb-35f01f53525e'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:27.350945 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-6ab69045-c15f-4c12-8feb-35f01f53525e admin admin] The token cache is being invalidate because project 846143aa0da747b5a27f042a1cbc8cdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:55:27.351264 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-6ab69045-c15f-4c12-8feb-35f01f53525e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:27.351929 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-6ab69045-c15f-4c12-8feb-35f01f53525e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:27.353521 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1065/2141] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:55:27 2022] DELETE /identity/v3/projects/846143aa0da747b5a27f042a1cbc8cdd => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:27.357895 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab3ce3-990e-4277-8670-64a7d4394c96 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:27.367785 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab3ce3-990e-4277-8670-64a7d4394c96 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:27.444547 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08119e56-4e3a-4727-a03a-021ed10c015f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:27.444547 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08119e56-4e3a-4727-a03a-021ed10c015f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:27.444547 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08119e56-4e3a-4727-a03a-021ed10c015f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:27.444547 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08119e56-4e3a-4727-a03a-021ed10c015f admin admin] PATH_INFO: `/v3/users/702fe471d68f401895fc66994f7ad992` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:27.445056 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08119e56-4e3a-4727-a03a-021ed10c015f admin admin] RBAC: Authorizing `identity:delete_user(user_id=702fe471d68f401895fc66994f7ad992)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:27.446928 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08119e56-4e3a-4727-a03a-021ed10c015f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:27.506084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-08119e56-4e3a-4727-a03a-021ed10c015f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '702fe471d68f401895fc66994f7ad992'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:27.514792 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-08119e56-4e3a-4727-a03a-021ed10c015f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '702fe471d68f401895fc66994f7ad992'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:27.528138 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-08119e56-4e3a-4727-a03a-021ed10c015f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '702fe471d68f401895fc66994f7ad992'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:27.529740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-08119e56-4e3a-4727-a03a-021ed10c015f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '702fe471d68f401895fc66994f7ad992'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:27.536514 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:27.549061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-08119e56-4e3a-4727-a03a-021ed10c015f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '702fe471d68f401895fc66994f7ad992'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:27.555957 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1077/2142] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:55:27 2022] DELETE /identity/v3/users/702fe471d68f401895fc66994f7ad992 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:55:27.649946 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab69045-c15f-4c12-8feb-35f01f53525e admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:27.657352 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-6ab69045-c15f-4c12-8feb-35f01f53525e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:27.671280 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab69045-c15f-4c12-8feb-35f01f53525e admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:27.734674 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cebf5b-a6b0-409a-be85-5283afa74c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:27.735596 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cebf5b-a6b0-409a-be85-5283afa74c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:27.735881 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cebf5b-a6b0-409a-be85-5283afa74c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:27.736155 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cebf5b-a6b0-409a-be85-5283afa74c01 admin admin] PATH_INFO: `/v3/projects/226c829577af45ac8272eaec783d1427` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:27.737338 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cebf5b-a6b0-409a-be85-5283afa74c01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=226c829577af45ac8272eaec783d1427)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:27.739274 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cebf5b-a6b0-409a-be85-5283afa74c01 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:27.800567 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a4cebf5b-a6b0-409a-be85-5283afa74c01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '226c829577af45ac8272eaec783d1427', 'request_id': 'req-a4cebf5b-a6b0-409a-be85-5283afa74c01'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:27.810480 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a4cebf5b-a6b0-409a-be85-5283afa74c01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '226c829577af45ac8272eaec783d1427', 'request_id': 'req-a4cebf5b-a6b0-409a-be85-5283afa74c01'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:27.816636 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a4cebf5b-a6b0-409a-be85-5283afa74c01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '226c829577af45ac8272eaec783d1427', 'request_id': 'req-a4cebf5b-a6b0-409a-be85-5283afa74c01'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:27.831739 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a4cebf5b-a6b0-409a-be85-5283afa74c01 admin admin] The token cache is being invalidate because project 226c829577af45ac8272eaec783d1427 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:55:27.832034 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a4cebf5b-a6b0-409a-be85-5283afa74c01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:27.832715 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a4cebf5b-a6b0-409a-be85-5283afa74c01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:27.834778 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1066/2143] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:55:27 2022] DELETE /identity/v3/projects/226c829577af45ac8272eaec783d1427 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:55:27.839221 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08119e56-4e3a-4727-a03a-021ed10c015f admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:27.840735 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-08119e56-4e3a-4727-a03a-021ed10c015f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:27.853701 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cebf5b-a6b0-409a-be85-5283afa74c01 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:27.854689 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08119e56-4e3a-4727-a03a-021ed10c015f admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:27.858848 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-a4cebf5b-a6b0-409a-be85-5283afa74c01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:27.909445 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:27.945301 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cebf5b-a6b0-409a-be85-5283afa74c01 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:27.950125 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66570a95-d29e-4bdb-8565-4a5658a6a2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:27.951013 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66570a95-d29e-4bdb-8565-4a5658a6a2ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:27.951329 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66570a95-d29e-4bdb-8565-4a5658a6a2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:27.951705 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66570a95-d29e-4bdb-8565-4a5658a6a2ce admin admin] PATH_INFO: `/v3/projects/14ae19f9040645b6b444e54e13da9e7c` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:27.952798 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66570a95-d29e-4bdb-8565-4a5658a6a2ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=14ae19f9040645b6b444e54e13da9e7c)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:27.954758 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66570a95-d29e-4bdb-8565-4a5658a6a2ce admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:27.956407 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2426046-487e-4051-811f-09c860dc7b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:27.957302 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2426046-487e-4051-811f-09c860dc7b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:27.957586 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2426046-487e-4051-811f-09c860dc7b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:27.957860 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2426046-487e-4051-811f-09c860dc7b67 admin admin] PATH_INFO: `/v3/users/6d801151d06d465ab3f60dd1135c711b` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:27.960030 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2426046-487e-4051-811f-09c860dc7b67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d801151d06d465ab3f60dd1135c711b)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:27.962007 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2426046-487e-4051-811f-09c860dc7b67 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:28.018119 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-66570a95-d29e-4bdb-8565-4a5658a6a2ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14ae19f9040645b6b444e54e13da9e7c', 'request_id': 'req-66570a95-d29e-4bdb-8565-4a5658a6a2ce'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:28.029835 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a2426046-487e-4051-811f-09c860dc7b67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d801151d06d465ab3f60dd1135c711b'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:28.031397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-66570a95-d29e-4bdb-8565-4a5658a6a2ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14ae19f9040645b6b444e54e13da9e7c', 'request_id': 'req-66570a95-d29e-4bdb-8565-4a5658a6a2ce'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:28.037127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a2426046-487e-4051-811f-09c860dc7b67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d801151d06d465ab3f60dd1135c711b'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:28.038171 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-66570a95-d29e-4bdb-8565-4a5658a6a2ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14ae19f9040645b6b444e54e13da9e7c', 'request_id': 'req-66570a95-d29e-4bdb-8565-4a5658a6a2ce'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:28.048501 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a2426046-487e-4051-811f-09c860dc7b67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d801151d06d465ab3f60dd1135c711b'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:28.049385 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a2426046-487e-4051-811f-09c860dc7b67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d801151d06d465ab3f60dd1135c711b'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:28.053051 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-66570a95-d29e-4bdb-8565-4a5658a6a2ce admin admin] The token cache is being invalidate because project 14ae19f9040645b6b444e54e13da9e7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:55:28.053788 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-66570a95-d29e-4bdb-8565-4a5658a6a2ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:28.055390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-66570a95-d29e-4bdb-8565-4a5658a6a2ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:28.061964 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1067/2144] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:55:27 2022] DELETE /identity/v3/projects/14ae19f9040645b6b444e54e13da9e7c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:28.063230 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66570a95-d29e-4bdb-8565-4a5658a6a2ce admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:28.065890 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-66570a95-d29e-4bdb-8565-4a5658a6a2ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:28.076291 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a2426046-487e-4051-811f-09c860dc7b67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d801151d06d465ab3f60dd1135c711b'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:28.082726 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1078/2145] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:55:27 2022] DELETE /identity/v3/users/6d801151d06d465ab3f60dd1135c711b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:28.084336 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54308960-592c-4de5-931f-993ade0dfe6c None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:28.084749 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54308960-592c-4de5-931f-993ade0dfe6c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:28.085032 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54308960-592c-4de5-931f-993ade0dfe6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:28.105880 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-54308960-592c-4de5-931f-993ade0dfe6c None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:28.107433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-54308960-592c-4de5-931f-993ade0dfe6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:28.149181 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66570a95-d29e-4bdb-8565-4a5658a6a2ce admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:28.200604 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1079/2146] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:28.208918 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032b162-a6fb-4a2a-9da7-3ba51bca76d9 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:28.209440 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032b162-a6fb-4a2a-9da7-3ba51bca76d9 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:28.210307 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032b162-a6fb-4a2a-9da7-3ba51bca76d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:28.220167 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:28.221480 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67c624-559e-4a01-ab4a-061d74f5be54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:28.222830 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67c624-559e-4a01-ab4a-061d74f5be54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:28.223332 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67c624-559e-4a01-ab4a-061d74f5be54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:28.223707 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67c624-559e-4a01-ab4a-061d74f5be54 admin admin] PATH_INFO: `/v3/users/55a9a77ef09940e7beed281cd2672667` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:28.225077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67c624-559e-4a01-ab4a-061d74f5be54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55a9a77ef09940e7beed281cd2672667)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:28.227587 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67c624-559e-4a01-ab4a-061d74f5be54 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:28.233977 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-0032b162-a6fb-4a2a-9da7-3ba51bca76d9 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:28.236715 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-0032b162-a6fb-4a2a-9da7-3ba51bca76d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:28.244791 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:28.248642 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1080/2147] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:28.253062 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032b162-a6fb-4a2a-9da7-3ba51bca76d9 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:28.270506 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032b162-a6fb-4a2a-9da7-3ba51bca76d9 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:28.277413 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7400a39-6fd7-4b6b-b84c-40522d82812c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:28.278131 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7400a39-6fd7-4b6b-b84c-40522d82812c admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:28.278418 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7400a39-6fd7-4b6b-b84c-40522d82812c admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:28.278702 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7400a39-6fd7-4b6b-b84c-40522d82812c admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:28.279533 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7400a39-6fd7-4b6b-b84c-40522d82812c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:55:28.280050 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7400a39-6fd7-4b6b-b84c-40522d82812c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:28.283264 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7400a39-6fd7-4b6b-b84c-40522d82812c admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:28.298521 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1081/2148] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:55:28.302666 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7400a39-6fd7-4b6b-b84c-40522d82812c admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:28.314782 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ad67c624-559e-4a01-ab4a-061d74f5be54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55a9a77ef09940e7beed281cd2672667'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:28.316894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7400a39-6fd7-4b6b-b84c-40522d82812c admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:28.322556 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a0087-cff2-484a-a14e-ebcb4e756fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:28.323863 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ad67c624-559e-4a01-ab4a-061d74f5be54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55a9a77ef09940e7beed281cd2672667'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:28.324176 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a0087-cff2-484a-a14e-ebcb4e756fcb admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:28.324377 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a0087-cff2-484a-a14e-ebcb4e756fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:28.324814 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a0087-cff2-484a-a14e-ebcb4e756fcb admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:28.325475 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a0087-cff2-484a-a14e-ebcb4e756fcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:28.327772 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a0087-cff2-484a-a14e-ebcb4e756fcb admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:28.333477 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ad67c624-559e-4a01-ab4a-061d74f5be54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55a9a77ef09940e7beed281cd2672667'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:28.334496 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ad67c624-559e-4a01-ab4a-061d74f5be54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55a9a77ef09940e7beed281cd2672667'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:28.350250 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ad67c624-559e-4a01-ab4a-061d74f5be54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55a9a77ef09940e7beed281cd2672667'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:28.357884 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1068/2149] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:55:28 2022] DELETE /identity/v3/users/55a9a77ef09940e7beed281cd2672667 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:28.361549 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1082/2150] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:55:28 2022] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:55:28.362432 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f32d5-7d0d-4675-8ac3-71e7f97a0ee9 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:28.362563 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a0087-cff2-484a-a14e-ebcb4e756fcb admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:28.362727 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f32d5-7d0d-4675-8ac3-71e7f97a0ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:28.363010 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f32d5-7d0d-4675-8ac3-71e7f97a0ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:28.366364 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-d83a0087-cff2-484a-a14e-ebcb4e756fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:28.380934 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-420f32d5-7d0d-4675-8ac3-71e7f97a0ee9 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:28.382107 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-420f32d5-7d0d-4675-8ac3-71e7f97a0ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:28.448365 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a0087-cff2-484a-a14e-ebcb4e756fcb admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:28.465790 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1069/2151] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:28.466798 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f32d5-7d0d-4675-8ac3-71e7f97a0ee9 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:28.475732 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-420f32d5-7d0d-4675-8ac3-71e7f97a0ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:28.489206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f32d5-7d0d-4675-8ac3-71e7f97a0ee9 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:28.499201 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1287b5-4f33-4558-8f83-3546e8492e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:28.499201 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1287b5-4f33-4558-8f83-3546e8492e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:28.499527 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1287b5-4f33-4558-8f83-3546e8492e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:28.500035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1287b5-4f33-4558-8f83-3546e8492e4d admin admin] PATH_INFO: `/v3/projects/0aa749c4ec844ea98c8298f468f8575d` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:28.501363 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1287b5-4f33-4558-8f83-3546e8492e4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aa749c4ec844ea98c8298f468f8575d)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:28.503629 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1287b5-4f33-4558-8f83-3546e8492e4d admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:28.525901 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299f4f6-ec88-4e36-87f6-245bef82f0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:28.527068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299f4f6-ec88-4e36-87f6-245bef82f0cb admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:28.527512 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299f4f6-ec88-4e36-87f6-245bef82f0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:28.527883 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299f4f6-ec88-4e36-87f6-245bef82f0cb admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:28.529202 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299f4f6-ec88-4e36-87f6-245bef82f0cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:28.530988 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299f4f6-ec88-4e36-87f6-245bef82f0cb admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:28.555901 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1083/2152] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:55:28 2022] POST /identity/v3/users => generated 285 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:55:28.557209 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299f4f6-ec88-4e36-87f6-245bef82f0cb admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:28.559465 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-8299f4f6-ec88-4e36-87f6-245bef82f0cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:28.560885 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-8c1287b5-4f33-4558-8f83-3546e8492e4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aa749c4ec844ea98c8298f468f8575d', 'request_id': 'req-8c1287b5-4f33-4558-8f83-3546e8492e4d'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:28.568509 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-8c1287b5-4f33-4558-8f83-3546e8492e4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aa749c4ec844ea98c8298f468f8575d', 'request_id': 'req-8c1287b5-4f33-4558-8f83-3546e8492e4d'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:28.574224 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-8c1287b5-4f33-4558-8f83-3546e8492e4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aa749c4ec844ea98c8298f468f8575d', 'request_id': 'req-8c1287b5-4f33-4558-8f83-3546e8492e4d'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:28.586097 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-8c1287b5-4f33-4558-8f83-3546e8492e4d admin admin] The token cache is being invalidate because project 0aa749c4ec844ea98c8298f468f8575d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:55:28.586390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-8c1287b5-4f33-4558-8f83-3546e8492e4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:28.587076 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-8c1287b5-4f33-4558-8f83-3546e8492e4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:28.588687 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1070/2153] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:55:28 2022] DELETE /identity/v3/projects/0aa749c4ec844ea98c8298f468f8575d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:28.592796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1287b5-4f33-4558-8f83-3546e8492e4d admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:28.592796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-8c1287b5-4f33-4558-8f83-3546e8492e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:28.605531 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:28.624256 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299f4f6-ec88-4e36-87f6-245bef82f0cb admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:28.641587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:28.671679 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1287b5-4f33-4558-8f83-3546e8492e4d admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:28.676370 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a30c8-35e1-439c-9365-4f35a6375c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:28.677052 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a30c8-35e1-439c-9365-4f35a6375c91 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:28.677340 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a30c8-35e1-439c-9365-4f35a6375c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:28.677646 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a30c8-35e1-439c-9365-4f35a6375c91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:28.678385 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a30c8-35e1-439c-9365-4f35a6375c91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:28.680425 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a30c8-35e1-439c-9365-4f35a6375c91 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:28.685418 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b5753-c29a-47ab-9d6d-f05fb880e17a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:28.686073 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b5753-c29a-47ab-9d6d-f05fb880e17a service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:28.686357 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b5753-c29a-47ab-9d6d-f05fb880e17a service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:28.686636 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b5753-c29a-47ab-9d6d-f05fb880e17a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:28.688500 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-576b5753-c29a-47ab-9d6d-f05fb880e17a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:28.690541 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1071/2154] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:55:28.691809 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00bab6-053f-4c14-b5f7-91e166f5b3e0 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:28.692096 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00bab6-053f-4c14-b5f7-91e166f5b3e0 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:28.692373 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00bab6-053f-4c14-b5f7-91e166f5b3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:28.704131 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b5753-c29a-47ab-9d6d-f05fb880e17a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:28.705505 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b5753-c29a-47ab-9d6d-f05fb880e17a service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:28.711231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-8e00bab6-053f-4c14-b5f7-91e166f5b3e0 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:28.712455 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-8e00bab6-053f-4c14-b5f7-91e166f5b3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:28.715336 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1084/2155] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:55:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:55:28.716217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b5753-c29a-47ab-9d6d-f05fb880e17a service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:28.721848 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1072/2156] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:28.725795 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b5753-c29a-47ab-9d6d-f05fb880e17a service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:28.734015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0d58a-3dbb-4431-be8d-bca962fbbb29 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:28.734314 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0d58a-3dbb-4431-be8d-bca962fbbb29 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:28.734603 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0d58a-3dbb-4431-be8d-bca962fbbb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:28.737096 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe47250-5260-41d4-a6ee-3a0aa6236ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:28.737979 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe47250-5260-41d4-a6ee-3a0aa6236ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:28.738414 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe47250-5260-41d4-a6ee-3a0aa6236ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:28.738861 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe47250-5260-41d4-a6ee-3a0aa6236ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:28.739915 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe47250-5260-41d4-a6ee-3a0aa6236ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:28.741742 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe47250-5260-41d4-a6ee-3a0aa6236ed9 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:28.753463 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1085/2157] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:55:28.757852 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe47250-5260-41d4-a6ee-3a0aa6236ed9 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:28.761315 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-5ef0d58a-3dbb-4431-be8d-bca962fbbb29 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:28.762817 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-5ef0d58a-3dbb-4431-be8d-bca962fbbb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:28.768871 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe47250-5260-41d4-a6ee-3a0aa6236ed9 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:28.776175 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be6f6b-fc6c-467c-b8fb-2d623863b34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:28.776175 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be6f6b-fc6c-467c-b8fb-2d623863b34b admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:28.776175 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be6f6b-fc6c-467c-b8fb-2d623863b34b admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:28.776175 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be6f6b-fc6c-467c-b8fb-2d623863b34b admin admin] PATH_INFO: `/v3/projects/6f318448901f482c9e445f9a6d3f20f2/users/5d6f6733e3604ee79f09f177f5e32012/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:28.777446 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1073/2158] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:28.778728 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0d58a-3dbb-4431-be8d-bca962fbbb29 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:28.790377 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0d58a-3dbb-4431-be8d-bca962fbbb29 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:28.794112 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be6f6b-fc6c-467c-b8fb-2d623863b34b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f318448901f482c9e445f9a6d3f20f2, user_id=5d6f6733e3604ee79f09f177f5e32012, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:28.796769 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd652a8-5528-4be5-870d-e5d3d931a710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:28.796984 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be6f6b-fc6c-467c-b8fb-2d623863b34b admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:28.797369 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd652a8-5528-4be5-870d-e5d3d931a710 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:28.797720 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd652a8-5528-4be5-870d-e5d3d931a710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:28.798085 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd652a8-5528-4be5-870d-e5d3d931a710 admin admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:28.798724 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd652a8-5528-4be5-870d-e5d3d931a710 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:55:28.799039 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd652a8-5528-4be5-870d-e5d3d931a710 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:28.800754 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd652a8-5528-4be5-870d-e5d3d931a710 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:28.812662 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1086/2159] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:55:28 2022] PUT /identity/v3/projects/6f318448901f482c9e445f9a6d3f20f2/users/5d6f6733e3604ee79f09f177f5e32012/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:55:28.818105 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1074/2160] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:55:28.818250 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf744e-5280-402d-9a5a-2ce8205b30a5 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:28.818250 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf744e-5280-402d-9a5a-2ce8205b30a5 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:28.818250 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf744e-5280-402d-9a5a-2ce8205b30a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:28.820175 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd652a8-5528-4be5-870d-e5d3d931a710 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:28.832849 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd652a8-5528-4be5-870d-e5d3d931a710 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:28.837888 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-0fcf744e-5280-402d-9a5a-2ce8205b30a5 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:28.839121 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-0fcf744e-5280-402d-9a5a-2ce8205b30a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:28.909909 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b07e9d-d7d6-4375-8407-84c05ac83a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:28.910639 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b07e9d-d7d6-4375-8407-84c05ac83a1d admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:28.910928 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b07e9d-d7d6-4375-8407-84c05ac83a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:28.911236 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b07e9d-d7d6-4375-8407-84c05ac83a1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:28.911978 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b07e9d-d7d6-4375-8407-84c05ac83a1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:28.913902 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b07e9d-d7d6-4375-8407-84c05ac83a1d admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:28.923485 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1087/2161] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:55:28.930406 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf744e-5280-402d-9a5a-2ce8205b30a5 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:28.931969 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-0fcf744e-5280-402d-9a5a-2ce8205b30a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:28.950155 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1075/2162] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:55:28 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:55:28.954409 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b07e9d-d7d6-4375-8407-84c05ac83a1d admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:29.003013 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf744e-5280-402d-9a5a-2ce8205b30a5 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:29.040365 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b07e9d-d7d6-4375-8407-84c05ac83a1d admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:29.046972 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe007a-56f3-4f06-b902-0c36eeef03ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:29.047721 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe007a-56f3-4f06-b902-0c36eeef03ae admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:29.047993 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe007a-56f3-4f06-b902-0c36eeef03ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:29.048278 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe007a-56f3-4f06-b902-0c36eeef03ae admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:29.048988 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe007a-56f3-4f06-b902-0c36eeef03ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:29.050991 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe007a-56f3-4f06-b902-0c36eeef03ae admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:29.059403 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:29.070005 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:29.076494 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf189fd-5735-4fa7-8eaf-a2675d37fd56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:29.077258 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf189fd-5735-4fa7-8eaf-a2675d37fd56 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:29.077543 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf189fd-5735-4fa7-8eaf-a2675d37fd56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:29.077968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf189fd-5735-4fa7-8eaf-a2675d37fd56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:29.081016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1076/2163] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:55:28 2022] POST /identity/v3/users => generated 290 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:55:29.081957 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe007a-56f3-4f06-b902-0c36eeef03ae admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:29.083595 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-c9fe007a-56f3-4f06-b902-0c36eeef03ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:29.087845 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf189fd-5735-4fa7-8eaf-a2675d37fd56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:29.089293 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf189fd-5735-4fa7-8eaf-a2675d37fd56 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:29.095596 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe007a-56f3-4f06-b902-0c36eeef03ae admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:29.098940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1088/2164] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:55:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:55:29.099777 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf189fd-5735-4fa7-8eaf-a2675d37fd56 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:29.100672 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91361895-a046-4f4e-bd98-dec343992813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:29.101617 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91361895-a046-4f4e-bd98-dec343992813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:29.101974 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91361895-a046-4f4e-bd98-dec343992813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:29.102326 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91361895-a046-4f4e-bd98-dec343992813 admin admin] PATH_INFO: `/v3/projects/effe42953f78475fb85e3916e1bb96cb` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:29.103624 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91361895-a046-4f4e-bd98-dec343992813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=effe42953f78475fb85e3916e1bb96cb)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:29.105892 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91361895-a046-4f4e-bd98-dec343992813 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:29.109658 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf189fd-5735-4fa7-8eaf-a2675d37fd56 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:29.114414 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec83e1-f815-4bf6-b271-b33dedf53c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:29.115086 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec83e1-f815-4bf6-b271-b33dedf53c0b admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:29.115401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec83e1-f815-4bf6-b271-b33dedf53c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:29.115680 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec83e1-f815-4bf6-b271-b33dedf53c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:29.116534 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec83e1-f815-4bf6-b271-b33dedf53c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:29.118329 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec83e1-f815-4bf6-b271-b33dedf53c0b admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:29.139567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1089/2165] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:55:29.146642 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec83e1-f815-4bf6-b271-b33dedf53c0b admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:29.160402 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec83e1-f815-4bf6-b271-b33dedf53c0b admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:29.177094 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-91361895-a046-4f4e-bd98-dec343992813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'effe42953f78475fb85e3916e1bb96cb', 'request_id': 'req-91361895-a046-4f4e-bd98-dec343992813'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:29.189893 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-91361895-a046-4f4e-bd98-dec343992813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'effe42953f78475fb85e3916e1bb96cb', 'request_id': 'req-91361895-a046-4f4e-bd98-dec343992813'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:29.196787 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-91361895-a046-4f4e-bd98-dec343992813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'effe42953f78475fb85e3916e1bb96cb', 'request_id': 'req-91361895-a046-4f4e-bd98-dec343992813'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:29.216907 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-91361895-a046-4f4e-bd98-dec343992813 admin admin] The token cache is being invalidate because project effe42953f78475fb85e3916e1bb96cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:55:29.217209 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-91361895-a046-4f4e-bd98-dec343992813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:29.217754 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-91361895-a046-4f4e-bd98-dec343992813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:29.219435 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1077/2166] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:55:29 2022] DELETE /identity/v3/projects/effe42953f78475fb85e3916e1bb96cb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:29.224386 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e7a11-30e7-4494-8641-5868ff500324 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:29.224757 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e7a11-30e7-4494-8641-5868ff500324 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:29.225124 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e7a11-30e7-4494-8641-5868ff500324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:29.233782 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0ad8d-cbeb-4448-a905-5285f666f874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:29.236530 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0ad8d-cbeb-4448-a905-5285f666f874 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:29.236530 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0ad8d-cbeb-4448-a905-5285f666f874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:29.236530 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0ad8d-cbeb-4448-a905-5285f666f874 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:29.242572 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0ad8d-cbeb-4448-a905-5285f666f874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:29.244730 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0ad8d-cbeb-4448-a905-5285f666f874 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:29.257418 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-903e7a11-30e7-4494-8641-5868ff500324 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:29.258928 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-903e7a11-30e7-4494-8641-5868ff500324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:29.265397 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1090/2167] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:55:29.271236 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1078/2168] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:55:29.271394 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0ad8d-cbeb-4448-a905-5285f666f874 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:29.271394 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5bc0ad8d-cbeb-4448-a905-5285f666f874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:29.279087 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e888936-9d73-4f1c-833e-fe3e4ef7c5e3 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:29.280843 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e888936-9d73-4f1c-833e-fe3e4ef7c5e3 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:29.282491 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e888936-9d73-4f1c-833e-fe3e4ef7c5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:29.290928 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0ad8d-cbeb-4448-a905-5285f666f874 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:29.296956 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b3cae-bb72-4281-be94-590cca925563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:29.298011 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b3cae-bb72-4281-be94-590cca925563 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:29.298474 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b3cae-bb72-4281-be94-590cca925563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:29.298909 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b3cae-bb72-4281-be94-590cca925563 admin admin] PATH_INFO: `/v3/projects/2b41b0caa0364032adf9b78c49cb39ae/users/724717414f05415fbe47d4f30668b886/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:29.313717 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-8e888936-9d73-4f1c-833e-fe3e4ef7c5e3 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:29.314895 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-8e888936-9d73-4f1c-833e-fe3e4ef7c5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:29.319607 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b3cae-bb72-4281-be94-590cca925563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b41b0caa0364032adf9b78c49cb39ae, user_id=724717414f05415fbe47d4f30668b886, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:29.324695 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b3cae-bb72-4281-be94-590cca925563 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:29.327674 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1079/2169] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:29.332413 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e888936-9d73-4f1c-833e-fe3e4ef7c5e3 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:29.346607 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e888936-9d73-4f1c-833e-fe3e4ef7c5e3 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:29.348038 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1091/2170] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:55:29 2022] PUT /identity/v3/projects/2b41b0caa0364032adf9b78c49cb39ae/users/724717414f05415fbe47d4f30668b886/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:55:29.359617 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b169e5-e1ff-43db-a1a7-8b447007eb5b None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:29.360062 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b169e5-e1ff-43db-a1a7-8b447007eb5b None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:29.360351 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b169e5-e1ff-43db-a1a7-8b447007eb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:29.397950 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-d2b169e5-e1ff-43db-a1a7-8b447007eb5b None None] MFA Rules not processed for user `724717414f05415fbe47d4f30668b886`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:29.399219 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-d2b169e5-e1ff-43db-a1a7-8b447007eb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:29.426454 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e483d1-5e10-454a-847f-1ebc87aae751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:29.427162 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e483d1-5e10-454a-847f-1ebc87aae751 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:29.427972 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e483d1-5e10-454a-847f-1ebc87aae751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:29.428281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e483d1-5e10-454a-847f-1ebc87aae751 admin admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:29.429035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e483d1-5e10-454a-847f-1ebc87aae751 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:55:29.429705 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e483d1-5e10-454a-847f-1ebc87aae751 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:29.431363 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e483d1-5e10-454a-847f-1ebc87aae751 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:29.447536 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1080/2171] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:55:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:55:29.451440 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e483d1-5e10-454a-847f-1ebc87aae751 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:29.480488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e483d1-5e10-454a-847f-1ebc87aae751 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:29.482665 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1092/2172] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:55:29.487091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b169e5-e1ff-43db-a1a7-8b447007eb5b None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:29.488303 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb2173-5974-4572-a38e-8f1f53ac3117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:29.489068 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb2173-5974-4572-a38e-8f1f53ac3117 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:29.489417 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb2173-5974-4572-a38e-8f1f53ac3117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:29.489764 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb2173-5974-4572-a38e-8f1f53ac3117 admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:29.490532 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb2173-5974-4572-a38e-8f1f53ac3117 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:29.492557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb2173-5974-4572-a38e-8f1f53ac3117 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:29.498398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b169e5-e1ff-43db-a1a7-8b447007eb5b None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:29.504512 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d9325-9643-4ff1-abde-bc6f72a059df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:29.504512 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d9325-9643-4ff1-abde-bc6f72a059df admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:29.504512 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d9325-9643-4ff1-abde-bc6f72a059df admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:29.504825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d9325-9643-4ff1-abde-bc6f72a059df admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:29.505544 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d9325-9643-4ff1-abde-bc6f72a059df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:29.507802 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d9325-9643-4ff1-abde-bc6f72a059df admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:29.525081 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1081/2173] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:55:29 2022] POST /identity/v3/projects => generated 375 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:55:29.529938 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb2173-5974-4572-a38e-8f1f53ac3117 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:29.549155 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1093/2174] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:55:29 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:55:29.555261 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d9325-9643-4ff1-abde-bc6f72a059df admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:29.591005 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:29.634091 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:29.682332 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d9325-9643-4ff1-abde-bc6f72a059df admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:29.687631 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520abac4-e891-4eac-85f1-de82a6943ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:29.688323 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520abac4-e891-4eac-85f1-de82a6943ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:29.688605 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520abac4-e891-4eac-85f1-de82a6943ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:29.688880 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520abac4-e891-4eac-85f1-de82a6943ad3 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:29.689578 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520abac4-e891-4eac-85f1-de82a6943ad3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:29.691533 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520abac4-e891-4eac-85f1-de82a6943ad3 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:29.694553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb2173-5974-4572-a38e-8f1f53ac3117 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:29.701372 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ce8dd-9d0c-4dcb-b380-bb2ddcafb27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:29.702431 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ce8dd-9d0c-4dcb-b380-bb2ddcafb27d admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:29.702976 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ce8dd-9d0c-4dcb-b380-bb2ddcafb27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:29.703682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ce8dd-9d0c-4dcb-b380-bb2ddcafb27d admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:29.704791 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ce8dd-9d0c-4dcb-b380-bb2ddcafb27d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:29.707509 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ce8dd-9d0c-4dcb-b380-bb2ddcafb27d admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:29.717399 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1094/2175] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:55:29 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:55:29.721427 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520abac4-e891-4eac-85f1-de82a6943ad3 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:29.732470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520abac4-e891-4eac-85f1-de82a6943ad3 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:29.738232 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1082/2176] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:55:29 2022] POST /identity/v3/users => generated 288 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:55:29.740952 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f88aa-c29a-410e-94d4-38815bea3ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:29.741942 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f88aa-c29a-410e-94d4-38815bea3ccd admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:29.742272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f88aa-c29a-410e-94d4-38815bea3ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:29.742377 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ce8dd-9d0c-4dcb-b380-bb2ddcafb27d admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:29.742715 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f88aa-c29a-410e-94d4-38815bea3ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:29.743539 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f88aa-c29a-410e-94d4-38815bea3ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:29.745350 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f88aa-c29a-410e-94d4-38815bea3ccd admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:29.754432 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ce8dd-9d0c-4dcb-b380-bb2ddcafb27d admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:29.757072 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1095/2177] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:55:29.759895 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55865bd2-bd26-444c-9a4d-27577c6e3f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:29.760640 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55865bd2-bd26-444c-9a4d-27577c6e3f66 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:29.760958 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55865bd2-bd26-444c-9a4d-27577c6e3f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:29.761344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f88aa-c29a-410e-94d4-38815bea3ccd admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:29.761550 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55865bd2-bd26-444c-9a4d-27577c6e3f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:29.762927 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55865bd2-bd26-444c-9a4d-27577c6e3f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:29.764577 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55865bd2-bd26-444c-9a4d-27577c6e3f66 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:29.772452 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f88aa-c29a-410e-94d4-38815bea3ccd admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:29.776662 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1083/2178] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:55:29.777469 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914f28f-481a-4e63-b4b7-7e31ad30e00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:29.778442 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914f28f-481a-4e63-b4b7-7e31ad30e00f admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:29.778796 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914f28f-481a-4e63-b4b7-7e31ad30e00f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:29.779133 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914f28f-481a-4e63-b4b7-7e31ad30e00f admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:29.780032 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d914f28f-481a-4e63-b4b7-7e31ad30e00f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:29.781903 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d914f28f-481a-4e63-b4b7-7e31ad30e00f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:29.782648 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55865bd2-bd26-444c-9a4d-27577c6e3f66 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:29.793981 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1096/2179] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:55:29.795920 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55865bd2-bd26-444c-9a4d-27577c6e3f66 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:29.798122 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914f28f-481a-4e63-b4b7-7e31ad30e00f admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:29.800947 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96671c0-ad65-4c04-8807-5f26addad813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:29.801627 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96671c0-ad65-4c04-8807-5f26addad813 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:29.801916 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96671c0-ad65-4c04-8807-5f26addad813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:29.802201 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96671c0-ad65-4c04-8807-5f26addad813 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:29.802940 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96671c0-ad65-4c04-8807-5f26addad813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:29.805000 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96671c0-ad65-4c04-8807-5f26addad813 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:29.808976 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914f28f-481a-4e63-b4b7-7e31ad30e00f admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:29.815992 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d73a36-8646-43f4-9a6b-2f681d495543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:29.816709 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d73a36-8646-43f4-9a6b-2f681d495543 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:29.817061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d73a36-8646-43f4-9a6b-2f681d495543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:29.817338 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d73a36-8646-43f4-9a6b-2f681d495543 admin admin] PATH_INFO: `/v3/projects/5d840db042834dccbcdfaadc265eeaf0/users/c93675ee6b9e45d1928b7666596c7478/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:29.820874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1084/2180] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:55:29.821622 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96671c0-ad65-4c04-8807-5f26addad813 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:29.836849 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96671c0-ad65-4c04-8807-5f26addad813 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:29.839446 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d73a36-8646-43f4-9a6b-2f681d495543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d840db042834dccbcdfaadc265eeaf0, user_id=c93675ee6b9e45d1928b7666596c7478, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:29.842015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9f268-d099-41dd-9eb7-099c6d382cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:29.842335 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d73a36-8646-43f4-9a6b-2f681d495543 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:29.843001 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9f268-d099-41dd-9eb7-099c6d382cd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:29.843330 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9f268-d099-41dd-9eb7-099c6d382cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:29.843612 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9f268-d099-41dd-9eb7-099c6d382cd2 admin admin] PATH_INFO: `/v3/projects/9f209054846f4415b7e40dd2d1e5cdc0/users/ce2e58b6744d407a8bdab2634cd67a41/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:29.862868 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1097/2181] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:55:29 2022] PUT /identity/v3/projects/5d840db042834dccbcdfaadc265eeaf0/users/c93675ee6b9e45d1928b7666596c7478/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:55:29.866721 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9f268-d099-41dd-9eb7-099c6d382cd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f209054846f4415b7e40dd2d1e5cdc0, user_id=ce2e58b6744d407a8bdab2634cd67a41, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:29.867451 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d5f64-bd51-44cd-a0b6-da1bdc226593 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:29.867769 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d5f64-bd51-44cd-a0b6-da1bdc226593 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:29.868047 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d5f64-bd51-44cd-a0b6-da1bdc226593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:29.869868 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9f268-d099-41dd-9eb7-099c6d382cd2 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:29.885456 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1085/2182] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:55:29 2022] PUT /identity/v3/projects/9f209054846f4415b7e40dd2d1e5cdc0/users/ce2e58b6744d407a8bdab2634cd67a41/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:29.895931 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d360e-57d9-43dd-8468-8d1c44f2d39e None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:29.896277 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d360e-57d9-43dd-8468-8d1c44f2d39e None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:29.896567 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d360e-57d9-43dd-8468-8d1c44f2d39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:29.897314 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-6e8d5f64-bd51-44cd-a0b6-da1bdc226593 None None] MFA Rules not processed for user `c93675ee6b9e45d1928b7666596c7478`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:29.898798 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6e8d5f64-bd51-44cd-a0b6-da1bdc226593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:29.923465 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-443d360e-57d9-43dd-8468-8d1c44f2d39e None None] MFA Rules not processed for user `ce2e58b6744d407a8bdab2634cd67a41`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:29.924807 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-443d360e-57d9-43dd-8468-8d1c44f2d39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:29.973453 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1098/2183] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:55:29.978259 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d5f64-bd51-44cd-a0b6-da1bdc226593 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:30.008107 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1086/2184] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:55:30.031093 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d360e-57d9-43dd-8468-8d1c44f2d39e None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:30.031093 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-443d360e-57d9-43dd-8468-8d1c44f2d39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:30.056024 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:30.082812 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d5f64-bd51-44cd-a0b6-da1bdc226593 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:30.088326 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527de136-6b97-4a9b-baba-48f68a5ec71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:30.089154 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527de136-6b97-4a9b-baba-48f68a5ec71e admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:30.089442 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527de136-6b97-4a9b-baba-48f68a5ec71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:30.089911 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527de136-6b97-4a9b-baba-48f68a5ec71e admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:30.090694 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527de136-6b97-4a9b-baba-48f68a5ec71e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:30.092730 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527de136-6b97-4a9b-baba-48f68a5ec71e admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:30.094641 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d360e-57d9-43dd-8468-8d1c44f2d39e None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:30.098406 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a595d-12fd-49e9-9f97-e57a5f4d3285 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:30.099742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a595d-12fd-49e9-9f97-e57a5f4d3285 service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:30.100035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a595d-12fd-49e9-9f97-e57a5f4d3285 service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:30.100361 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a595d-12fd-49e9-9f97-e57a5f4d3285 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:30.110881 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a595d-12fd-49e9-9f97-e57a5f4d3285 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:30.112429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a595d-12fd-49e9-9f97-e57a5f4d3285 service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:30.131673 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1099/2185] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:55:29 2022] POST /identity/v3/projects => generated 379 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:55:30.131883 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1087/2186] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:55:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:55:30.133089 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65316973-7d0b-4ad3-890a-0660b0000f8e None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:30.133389 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65316973-7d0b-4ad3-890a-0660b0000f8e None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:30.133673 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65316973-7d0b-4ad3-890a-0660b0000f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:30.138744 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a595d-12fd-49e9-9f97-e57a5f4d3285 service cinder] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:30.172222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a595d-12fd-49e9-9f97-e57a5f4d3285 service cinder] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:30.175692 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-65316973-7d0b-4ad3-890a-0660b0000f8e None None] MFA Rules not processed for user `5d6f6733e3604ee79f09f177f5e32012`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:30.180127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-65316973-7d0b-4ad3-890a-0660b0000f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:30.190425 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:30.267988 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ee7ef-b472-4792-860e-d9f35be2d624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:30.268748 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ee7ef-b472-4792-860e-d9f35be2d624 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:30.269039 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ee7ef-b472-4792-860e-d9f35be2d624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:30.269321 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ee7ef-b472-4792-860e-d9f35be2d624 admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:30.270022 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ee7ef-b472-4792-860e-d9f35be2d624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:30.274149 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ee7ef-b472-4792-860e-d9f35be2d624 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:30.276479 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1100/2187] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:30.289281 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65316973-7d0b-4ad3-890a-0660b0000f8e None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:30.292999 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-65316973-7d0b-4ad3-890a-0660b0000f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:30.307185 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1088/2188] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:55:30 2022] POST /identity/v3/users => generated 296 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:55:30.310640 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ee7ef-b472-4792-860e-d9f35be2d624 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:30.321663 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ee7ef-b472-4792-860e-d9f35be2d624 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:30.328321 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e77e0-f48a-4281-83a2-dde0807e23bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:30.329016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e77e0-f48a-4281-83a2-dde0807e23bc admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:30.329304 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e77e0-f48a-4281-83a2-dde0807e23bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:30.329586 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e77e0-f48a-4281-83a2-dde0807e23bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:30.330331 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e77e0-f48a-4281-83a2-dde0807e23bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:30.332260 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e77e0-f48a-4281-83a2-dde0807e23bc admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:30.346639 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1089/2189] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:55:30.350408 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e77e0-f48a-4281-83a2-dde0807e23bc admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:30.372356 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e77e0-f48a-4281-83a2-dde0807e23bc admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:30.378851 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6413d8-6c06-4da4-8245-70a7a38ef47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:30.379854 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6413d8-6c06-4da4-8245-70a7a38ef47b admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:30.380577 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6413d8-6c06-4da4-8245-70a7a38ef47b admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:30.380899 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6413d8-6c06-4da4-8245-70a7a38ef47b admin admin] PATH_INFO: `/v3/projects/537ab5dfba434a65b0d556665164c582/users/75940c7975e743e594e0fc9e1e1e6808/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:30.383662 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65316973-7d0b-4ad3-890a-0660b0000f8e None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:30.389084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa3e1d-ae60-4a71-b3b9-5579561454e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:30.390068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa3e1d-ae60-4a71-b3b9-5579561454e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:30.390648 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa3e1d-ae60-4a71-b3b9-5579561454e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:30.391206 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa3e1d-ae60-4a71-b3b9-5579561454e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:30.407471 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6413d8-6c06-4da4-8245-70a7a38ef47b admin admin] RBAC: Authorizing `identity:create_grant(project_id=537ab5dfba434a65b0d556665164c582, user_id=75940c7975e743e594e0fc9e1e1e6808, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:30.409023 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa3e1d-ae60-4a71-b3b9-5579561454e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:30.411921 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6413d8-6c06-4da4-8245-70a7a38ef47b admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:30.413262 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa3e1d-ae60-4a71-b3b9-5579561454e8 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:30.439318 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1101/2190] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:55:30 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:55:30.443065 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1090/2191] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:55:30 2022] PUT /identity/v3/projects/537ab5dfba434a65b0d556665164c582/users/75940c7975e743e594e0fc9e1e1e6808/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:55:30.447471 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa3e1d-ae60-4a71-b3b9-5579561454e8 service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:30.477949 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa3e1d-ae60-4a71-b3b9-5579561454e8 service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:30.656560 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3862bc-a0d6-43ee-bd99-3577e2f5cc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:30.657564 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3862bc-a0d6-43ee-bd99-3577e2f5cc81 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:30.657970 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3862bc-a0d6-43ee-bd99-3577e2f5cc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:30.658345 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3862bc-a0d6-43ee-bd99-3577e2f5cc81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:30.662143 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3862bc-a0d6-43ee-bd99-3577e2f5cc81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:30.664801 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3862bc-a0d6-43ee-bd99-3577e2f5cc81 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:30.668057 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:30.693669 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1102/2192] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:55:30.698240 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6413d8-6c06-4da4-8245-70a7a38ef47b admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:30.712470 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6413d8-6c06-4da4-8245-70a7a38ef47b admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:30.735935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580f45e-d9fe-4523-ad45-e0ecdb48d77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:30.736938 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580f45e-d9fe-4523-ad45-e0ecdb48d77a admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:30.737262 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580f45e-d9fe-4523-ad45-e0ecdb48d77a admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:30.737504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580f45e-d9fe-4523-ad45-e0ecdb48d77a admin admin] PATH_INFO: `/v3/projects/537ab5dfba434a65b0d556665164c582/users/75940c7975e743e594e0fc9e1e1e6808/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:30.740492 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580f45e-d9fe-4523-ad45-e0ecdb48d77a admin admin] RBAC: Authorizing `identity:create_grant(project_id=537ab5dfba434a65b0d556665164c582, user_id=75940c7975e743e594e0fc9e1e1e6808, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:30.743187 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580f45e-d9fe-4523-ad45-e0ecdb48d77a admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:30.757329 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1091/2193] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:55:30 2022] PUT /identity/v3/projects/537ab5dfba434a65b0d556665164c582/users/75940c7975e743e594e0fc9e1e1e6808/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:30.770051 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b9dc9-840d-42c2-9955-9043c6ce2925 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:30.770232 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b9dc9-840d-42c2-9955-9043c6ce2925 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:30.770558 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b9dc9-840d-42c2-9955-9043c6ce2925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:30.803654 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-7e5b9dc9-840d-42c2-9955-9043c6ce2925 None None] MFA Rules not processed for user `75940c7975e743e594e0fc9e1e1e6808`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:30.805244 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-7e5b9dc9-840d-42c2-9955-9043c6ce2925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:30.895478 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1103/2194] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:30.921114 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580f45e-d9fe-4523-ad45-e0ecdb48d77a admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:30.988232 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580f45e-d9fe-4523-ad45-e0ecdb48d77a admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:30.991921 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055bb214-2b64-4544-8f4a-67f7262cdee7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:30.992713 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bb214-2b64-4544-8f4a-67f7262cdee7 service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:30.992850 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bb214-2b64-4544-8f4a-67f7262cdee7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:30.993133 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bb214-2b64-4544-8f4a-67f7262cdee7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:31.003452 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055bb214-2b64-4544-8f4a-67f7262cdee7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:31.005006 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055bb214-2b64-4544-8f4a-67f7262cdee7 service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:31.014762 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1092/2195] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:55:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:55:31.054874 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b9dc9-840d-42c2-9955-9043c6ce2925 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:31.065852 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b9dc9-840d-42c2-9955-9043c6ce2925 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:31.069528 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9bf8f-d485-4a98-871e-a48f4ff4a476 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:31.070189 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9bf8f-d485-4a98-871e-a48f4ff4a476 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:31.070474 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9bf8f-d485-4a98-871e-a48f4ff4a476 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:31.070756 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9bf8f-d485-4a98-871e-a48f4ff4a476 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:31.139516 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9bf8f-d485-4a98-871e-a48f4ff4a476 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:31.140968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9bf8f-d485-4a98-871e-a48f4ff4a476 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:31.152195 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1104/2196] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:55:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:55:31.710233 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb635340-ce22-4a22-97ed-a058bd7a406e None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:31.710775 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb635340-ce22-4a22-97ed-a058bd7a406e None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:31.710775 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb635340-ce22-4a22-97ed-a058bd7a406e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:31.739544 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-cb635340-ce22-4a22-97ed-a058bd7a406e None None] MFA Rules not processed for user `ce2e58b6744d407a8bdab2634cd67a41`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:31.740898 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-cb635340-ce22-4a22-97ed-a058bd7a406e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:31.798942 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:31.830478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1093/2197] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:33.030209 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a8a37-c062-4f39-8452-b2771238b79f None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:33.030777 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a8a37-c062-4f39-8452-b2771238b79f None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:33.031075 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a8a37-c062-4f39-8452-b2771238b79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:33.051070 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-2f5a8a37-c062-4f39-8452-b2771238b79f None None] MFA Rules not processed for user `5d6f6733e3604ee79f09f177f5e32012`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:33.052417 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-2f5a8a37-c062-4f39-8452-b2771238b79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:33.110600 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1105/2198] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:35.330381 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb635340-ce22-4a22-97ed-a058bd7a406e None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:35.464214 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb635340-ce22-4a22-97ed-a058bd7a406e None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:35.470114 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9e96f-46dc-4d74-989f-81a5be86b56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:35.471020 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9e96f-46dc-4d74-989f-81a5be86b56e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:35.471344 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9e96f-46dc-4d74-989f-81a5be86b56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:35.471614 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9e96f-46dc-4d74-989f-81a5be86b56e admin admin] PATH_INFO: `/v3/users/724717414f05415fbe47d4f30668b886` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:35.472863 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9e96f-46dc-4d74-989f-81a5be86b56e admin admin] RBAC: Authorizing `identity:delete_user(user_id=724717414f05415fbe47d4f30668b886)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:35.474865 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9e96f-46dc-4d74-989f-81a5be86b56e admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:35.542684 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-bba9e96f-46dc-4d74-989f-81a5be86b56e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '724717414f05415fbe47d4f30668b886'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:35.554023 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-bba9e96f-46dc-4d74-989f-81a5be86b56e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '724717414f05415fbe47d4f30668b886'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:35.567046 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-bba9e96f-46dc-4d74-989f-81a5be86b56e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '724717414f05415fbe47d4f30668b886'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:35.568064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-bba9e96f-46dc-4d74-989f-81a5be86b56e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '724717414f05415fbe47d4f30668b886'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:35.583308 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-bba9e96f-46dc-4d74-989f-81a5be86b56e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '724717414f05415fbe47d4f30668b886'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:35.590748 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1094/2199] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:55:35 2022] DELETE /identity/v3/users/724717414f05415fbe47d4f30668b886 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:35.596787 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f2e2a-1c3d-4e83-8f31-3a347d265234 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:35.597304 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f2e2a-1c3d-4e83-8f31-3a347d265234 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:35.597421 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f2e2a-1c3d-4e83-8f31-3a347d265234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:35.645656 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-5f3f2e2a-1c3d-4e83-8f31-3a347d265234 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:35.646973 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5f3f2e2a-1c3d-4e83-8f31-3a347d265234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:35.652077 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:35.750163 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1106/2200] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:35.762009 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9e96f-46dc-4d74-989f-81a5be86b56e admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:35.764212 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-bba9e96f-46dc-4d74-989f-81a5be86b56e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:35.810456 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:35.885338 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9e96f-46dc-4d74-989f-81a5be86b56e admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:35.890673 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3c4f3-1526-42ca-b5fd-7dc1c6a677bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:35.891566 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3c4f3-1526-42ca-b5fd-7dc1c6a677bc service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:35.891979 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3c4f3-1526-42ca-b5fd-7dc1c6a677bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:35.892403 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3c4f3-1526-42ca-b5fd-7dc1c6a677bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:35.904277 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd3c4f3-1526-42ca-b5fd-7dc1c6a677bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:35.905757 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd3c4f3-1526-42ca-b5fd-7dc1c6a677bc service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:35.921290 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1095/2201] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:55:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:55:36.263291 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f2e2a-1c3d-4e83-8f31-3a347d265234 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:36.265071 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5f3f2e2a-1c3d-4e83-8f31-3a347d265234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:36.281278 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f2e2a-1c3d-4e83-8f31-3a347d265234 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:36.297909 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b3e4f-efed-485e-a024-fc3ca4a4d141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:36.303000 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b3e4f-efed-485e-a024-fc3ca4a4d141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:36.303473 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b3e4f-efed-485e-a024-fc3ca4a4d141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:36.303921 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b3e4f-efed-485e-a024-fc3ca4a4d141 admin admin] PATH_INFO: `/v3/projects/2b41b0caa0364032adf9b78c49cb39ae` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:36.306474 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b3e4f-efed-485e-a024-fc3ca4a4d141 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b41b0caa0364032adf9b78c49cb39ae)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:36.308672 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b3e4f-efed-485e-a024-fc3ca4a4d141 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:36.367885 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-470b3e4f-efed-485e-a024-fc3ca4a4d141 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b41b0caa0364032adf9b78c49cb39ae', 'request_id': 'req-470b3e4f-efed-485e-a024-fc3ca4a4d141'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:36.379247 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-470b3e4f-efed-485e-a024-fc3ca4a4d141 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b41b0caa0364032adf9b78c49cb39ae', 'request_id': 'req-470b3e4f-efed-485e-a024-fc3ca4a4d141'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:36.387241 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-470b3e4f-efed-485e-a024-fc3ca4a4d141 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b41b0caa0364032adf9b78c49cb39ae', 'request_id': 'req-470b3e4f-efed-485e-a024-fc3ca4a4d141'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:36.402888 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-470b3e4f-efed-485e-a024-fc3ca4a4d141 admin admin] The token cache is being invalidate because project 2b41b0caa0364032adf9b78c49cb39ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:55:36.403417 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-470b3e4f-efed-485e-a024-fc3ca4a4d141 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:36.404333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-470b3e4f-efed-485e-a024-fc3ca4a4d141 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:36.411137 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1107/2202] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:55:36 2022] DELETE /identity/v3/projects/2b41b0caa0364032adf9b78c49cb39ae => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:36.411478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3c4f3-1526-42ca-b5fd-7dc1c6a677bc service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:36.424164 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3c4f3-1526-42ca-b5fd-7dc1c6a677bc service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:36.512066 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc66baf3-dd27-493c-8db6-ab53b2b01d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:36.513306 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66baf3-dd27-493c-8db6-ab53b2b01d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:36.513614 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66baf3-dd27-493c-8db6-ab53b2b01d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:36.513996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66baf3-dd27-493c-8db6-ab53b2b01d8c admin admin] PATH_INFO: `/v3/users/c93675ee6b9e45d1928b7666596c7478` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:36.516885 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc66baf3-dd27-493c-8db6-ab53b2b01d8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c93675ee6b9e45d1928b7666596c7478)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:36.519570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc66baf3-dd27-493c-8db6-ab53b2b01d8c admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:36.623426 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-cc66baf3-dd27-493c-8db6-ab53b2b01d8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c93675ee6b9e45d1928b7666596c7478'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:36.640439 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-cc66baf3-dd27-493c-8db6-ab53b2b01d8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c93675ee6b9e45d1928b7666596c7478'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:36.661403 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-cc66baf3-dd27-493c-8db6-ab53b2b01d8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c93675ee6b9e45d1928b7666596c7478'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:36.662030 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-cc66baf3-dd27-493c-8db6-ab53b2b01d8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c93675ee6b9e45d1928b7666596c7478'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:36.679770 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-cc66baf3-dd27-493c-8db6-ab53b2b01d8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c93675ee6b9e45d1928b7666596c7478'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:36.688451 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1096/2203] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:55:36 2022] DELETE /identity/v3/users/c93675ee6b9e45d1928b7666596c7478 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:55:37.011354 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b3e4f-efed-485e-a024-fc3ca4a4d141 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:37.015308 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc66baf3-dd27-493c-8db6-ab53b2b01d8c admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:37.016823 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-470b3e4f-efed-485e-a024-fc3ca4a4d141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:37.019492 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-cc66baf3-dd27-493c-8db6-ab53b2b01d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:37.035763 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b3e4f-efed-485e-a024-fc3ca4a4d141 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:37.045143 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:37.114672 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447ddb4-b020-4eab-b715-5822541c9e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:37.115682 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447ddb4-b020-4eab-b715-5822541c9e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:37.115973 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447ddb4-b020-4eab-b715-5822541c9e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:37.116255 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447ddb4-b020-4eab-b715-5822541c9e74 admin admin] PATH_INFO: `/v3/users/8834b2df0cb74d7a92fb0af695a31510` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:37.117594 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447ddb4-b020-4eab-b715-5822541c9e74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8834b2df0cb74d7a92fb0af695a31510)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:37.119734 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447ddb4-b020-4eab-b715-5822541c9e74 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:37.140653 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc66baf3-dd27-493c-8db6-ab53b2b01d8c admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:37.146310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6850ba-b813-4e7f-aa45-d07d49014c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:37.147092 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6850ba-b813-4e7f-aa45-d07d49014c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:37.148085 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6850ba-b813-4e7f-aa45-d07d49014c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:37.148085 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6850ba-b813-4e7f-aa45-d07d49014c0c admin admin] PATH_INFO: `/v3/projects/5d840db042834dccbcdfaadc265eeaf0` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:37.149960 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6850ba-b813-4e7f-aa45-d07d49014c0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d840db042834dccbcdfaadc265eeaf0)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:37.152099 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6850ba-b813-4e7f-aa45-d07d49014c0c admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:37.172537 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:37.184114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a447ddb4-b020-4eab-b715-5822541c9e74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8834b2df0cb74d7a92fb0af695a31510'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:37.192776 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a447ddb4-b020-4eab-b715-5822541c9e74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8834b2df0cb74d7a92fb0af695a31510'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:37.203394 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a447ddb4-b020-4eab-b715-5822541c9e74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8834b2df0cb74d7a92fb0af695a31510'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:37.204895 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a447ddb4-b020-4eab-b715-5822541c9e74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8834b2df0cb74d7a92fb0af695a31510'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:37.220663 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-2d6850ba-b813-4e7f-aa45-d07d49014c0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d840db042834dccbcdfaadc265eeaf0', 'request_id': 'req-2d6850ba-b813-4e7f-aa45-d07d49014c0c'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:37.229139 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a447ddb4-b020-4eab-b715-5822541c9e74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8834b2df0cb74d7a92fb0af695a31510'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:37.231715 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-2d6850ba-b813-4e7f-aa45-d07d49014c0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d840db042834dccbcdfaadc265eeaf0', 'request_id': 'req-2d6850ba-b813-4e7f-aa45-d07d49014c0c'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:37.239641 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1108/2204] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:55:37 2022] DELETE /identity/v3/users/8834b2df0cb74d7a92fb0af695a31510 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:37.240876 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-2d6850ba-b813-4e7f-aa45-d07d49014c0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d840db042834dccbcdfaadc265eeaf0', 'request_id': 'req-2d6850ba-b813-4e7f-aa45-d07d49014c0c'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:37.246086 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2be15-a310-415d-9fd9-003435875963 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:37.246380 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2be15-a310-415d-9fd9-003435875963 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:37.246885 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2be15-a310-415d-9fd9-003435875963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:37.268419 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-2d6850ba-b813-4e7f-aa45-d07d49014c0c admin admin] The token cache is being invalidate because project 5d840db042834dccbcdfaadc265eeaf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:55:37.268722 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-2d6850ba-b813-4e7f-aa45-d07d49014c0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:37.269605 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-2d6850ba-b813-4e7f-aa45-d07d49014c0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:37.274287 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1097/2205] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:55:37 2022] DELETE /identity/v3/projects/5d840db042834dccbcdfaadc265eeaf0 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:55:37.277032 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-f0b2be15-a310-415d-9fd9-003435875963 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:37.279437 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-f0b2be15-a310-415d-9fd9-003435875963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:37.281827 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6850ba-b813-4e7f-aa45-d07d49014c0c admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:37.284636 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-2d6850ba-b813-4e7f-aa45-d07d49014c0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:37.411659 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1109/2206] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:37.427088 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2be15-a310-415d-9fd9-003435875963 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:37.428899 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-f0b2be15-a310-415d-9fd9-003435875963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:37.450278 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6850ba-b813-4e7f-aa45-d07d49014c0c admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:37.463777 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a5114-ad09-4399-8ebf-e66d6d0990b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:37.465087 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a5114-ad09-4399-8ebf-e66d6d0990b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:37.465567 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a5114-ad09-4399-8ebf-e66d6d0990b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:37.467438 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a5114-ad09-4399-8ebf-e66d6d0990b9 admin admin] PATH_INFO: `/v3/users/75940c7975e743e594e0fc9e1e1e6808` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:37.469425 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a5114-ad09-4399-8ebf-e66d6d0990b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75940c7975e743e594e0fc9e1e1e6808)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:37.472569 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a5114-ad09-4399-8ebf-e66d6d0990b9 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:37.502103 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2be15-a310-415d-9fd9-003435875963 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:37.506933 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa87420-3c04-4ec0-a92b-1c4ae91cc948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:37.507815 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa87420-3c04-4ec0-a92b-1c4ae91cc948 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:37.508322 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa87420-3c04-4ec0-a92b-1c4ae91cc948 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:37.508693 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa87420-3c04-4ec0-a92b-1c4ae91cc948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:37.520452 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa87420-3c04-4ec0-a92b-1c4ae91cc948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:37.522090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa87420-3c04-4ec0-a92b-1c4ae91cc948 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:37.535104 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1110/2207] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:55:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:55:37.546904 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-f76a5114-ad09-4399-8ebf-e66d6d0990b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75940c7975e743e594e0fc9e1e1e6808'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:37.553363 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:37.558948 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-f76a5114-ad09-4399-8ebf-e66d6d0990b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75940c7975e743e594e0fc9e1e1e6808'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:37.570105 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-f76a5114-ad09-4399-8ebf-e66d6d0990b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75940c7975e743e594e0fc9e1e1e6808'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:37.571179 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-f76a5114-ad09-4399-8ebf-e66d6d0990b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75940c7975e743e594e0fc9e1e1e6808'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:37.590864 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-f76a5114-ad09-4399-8ebf-e66d6d0990b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75940c7975e743e594e0fc9e1e1e6808'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:37.599296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1098/2208] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:55:37 2022] DELETE /identity/v3/users/75940c7975e743e594e0fc9e1e1e6808 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:38.019989 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa87420-3c04-4ec0-a92b-1c4ae91cc948 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:38.022037 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-cfa87420-3c04-4ec0-a92b-1c4ae91cc948 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:38.035456 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa87420-3c04-4ec0-a92b-1c4ae91cc948 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:38.111629 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:38.121761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0eada-ed52-4094-84d4-75249491de85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:38.123071 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0eada-ed52-4094-84d4-75249491de85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:38.123379 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0eada-ed52-4094-84d4-75249491de85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:38.124496 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0eada-ed52-4094-84d4-75249491de85 admin admin] PATH_INFO: `/v3/projects/b6e5f9625f794a99ba7d68baaf08d850` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:38.126253 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0eada-ed52-4094-84d4-75249491de85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6e5f9625f794a99ba7d68baaf08d850)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:38.128532 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0eada-ed52-4094-84d4-75249491de85 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:38.128833 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a5114-ad09-4399-8ebf-e66d6d0990b9 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:38.130489 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-f76a5114-ad09-4399-8ebf-e66d6d0990b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:38.172710 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a5114-ad09-4399-8ebf-e66d6d0990b9 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:38.187554 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3fd134-ba0c-4909-948c-598d2ef45fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:38.187554 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3fd134-ba0c-4909-948c-598d2ef45fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:38.187554 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3fd134-ba0c-4909-948c-598d2ef45fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:38.187554 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3fd134-ba0c-4909-948c-598d2ef45fcb admin admin] PATH_INFO: `/v3/projects/537ab5dfba434a65b0d556665164c582` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:38.187981 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3fd134-ba0c-4909-948c-598d2ef45fcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=537ab5dfba434a65b0d556665164c582)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:38.189338 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3fd134-ba0c-4909-948c-598d2ef45fcb admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:38.201525 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-67b0eada-ed52-4094-84d4-75249491de85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6e5f9625f794a99ba7d68baaf08d850', 'request_id': 'req-67b0eada-ed52-4094-84d4-75249491de85'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:38.210646 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-67b0eada-ed52-4094-84d4-75249491de85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6e5f9625f794a99ba7d68baaf08d850', 'request_id': 'req-67b0eada-ed52-4094-84d4-75249491de85'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:38.217536 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-67b0eada-ed52-4094-84d4-75249491de85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6e5f9625f794a99ba7d68baaf08d850', 'request_id': 'req-67b0eada-ed52-4094-84d4-75249491de85'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:38.230285 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-67b0eada-ed52-4094-84d4-75249491de85 admin admin] The token cache is being invalidate because project b6e5f9625f794a99ba7d68baaf08d850 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:55:38.230473 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-67b0eada-ed52-4094-84d4-75249491de85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:38.231100 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-67b0eada-ed52-4094-84d4-75249491de85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:38.233702 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1111/2209] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:55:38 2022] DELETE /identity/v3/projects/b6e5f9625f794a99ba7d68baaf08d850 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:38.238608 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000a156-8b8b-4e3a-a7e3-47b47fc45f00 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:38.238900 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000a156-8b8b-4e3a-a7e3-47b47fc45f00 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:38.239203 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000a156-8b8b-4e3a-a7e3-47b47fc45f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:38.250579 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ca3fd134-ba0c-4909-948c-598d2ef45fcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '537ab5dfba434a65b0d556665164c582', 'request_id': 'req-ca3fd134-ba0c-4909-948c-598d2ef45fcb'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:38.263656 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ca3fd134-ba0c-4909-948c-598d2ef45fcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '537ab5dfba434a65b0d556665164c582', 'request_id': 'req-ca3fd134-ba0c-4909-948c-598d2ef45fcb'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:38.271284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ca3fd134-ba0c-4909-948c-598d2ef45fcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '537ab5dfba434a65b0d556665164c582', 'request_id': 'req-ca3fd134-ba0c-4909-948c-598d2ef45fcb'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:38.283684 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ca3fd134-ba0c-4909-948c-598d2ef45fcb admin admin] The token cache is being invalidate because project 537ab5dfba434a65b0d556665164c582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:55:38.283870 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ca3fd134-ba0c-4909-948c-598d2ef45fcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:38.284512 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ca3fd134-ba0c-4909-948c-598d2ef45fcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:38.286517 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-5000a156-8b8b-4e3a-a7e3-47b47fc45f00 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:38.286643 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1099/2210] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:55:38 2022] DELETE /identity/v3/projects/537ab5dfba434a65b0d556665164c582 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:55:38.287511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5000a156-8b8b-4e3a-a7e3-47b47fc45f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:38.292281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a35ae-cd30-4eb5-94ee-fa6bf20244ea None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:38.292551 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a35ae-cd30-4eb5-94ee-fa6bf20244ea None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:38.292815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a35ae-cd30-4eb5-94ee-fa6bf20244ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:38.314420 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-5d3a35ae-cd30-4eb5-94ee-fa6bf20244ea None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:38.315679 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-5d3a35ae-cd30-4eb5-94ee-fa6bf20244ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:38.361571 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1112/2211] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:55:38.370158 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cf3ff-00d5-43f6-a850-77bbb98fe68f None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:38.371142 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cf3ff-00d5-43f6-a850-77bbb98fe68f None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:38.371681 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cf3ff-00d5-43f6-a850-77bbb98fe68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:38.391408 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1100/2212] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:55:38.393073 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e3821-df63-4743-b11f-3af0005a11c8 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:38.393788 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e3821-df63-4743-b11f-3af0005a11c8 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:38.394087 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e3821-df63-4743-b11f-3af0005a11c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:38.411227 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-dc2cf3ff-00d5-43f6-a850-77bbb98fe68f None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:38.413516 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-dc2cf3ff-00d5-43f6-a850-77bbb98fe68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:38.420369 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-c72e3821-df63-4743-b11f-3af0005a11c8 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:38.422207 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-c72e3821-df63-4743-b11f-3af0005a11c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:38.427878 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1113/2213] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:55:38.432322 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2cf3ff-00d5-43f6-a850-77bbb98fe68f None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:38.436352 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1101/2214] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:38.437278 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e3821-df63-4743-b11f-3af0005a11c8 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:38.442289 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2cf3ff-00d5-43f6-a850-77bbb98fe68f None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:38.446461 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e3821-df63-4743-b11f-3af0005a11c8 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:38.447000 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f99f1-f0ee-4a4e-adb5-ba10171a2413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:38.447995 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f99f1-f0ee-4a4e-adb5-ba10171a2413 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:38.448279 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f99f1-f0ee-4a4e-adb5-ba10171a2413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:38.448551 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f99f1-f0ee-4a4e-adb5-ba10171a2413 admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:38.449293 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f99f1-f0ee-4a4e-adb5-ba10171a2413 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:55:38.449601 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f99f1-f0ee-4a4e-adb5-ba10171a2413 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:38.451295 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f99f1-f0ee-4a4e-adb5-ba10171a2413 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:38.452262 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc742999-9e7c-4adb-81c8-62ceb2040e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:38.453643 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc742999-9e7c-4adb-81c8-62ceb2040e52 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:38.453643 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc742999-9e7c-4adb-81c8-62ceb2040e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:38.453819 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc742999-9e7c-4adb-81c8-62ceb2040e52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:38.454498 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc742999-9e7c-4adb-81c8-62ceb2040e52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:55:38.454727 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc742999-9e7c-4adb-81c8-62ceb2040e52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:38.456679 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc742999-9e7c-4adb-81c8-62ceb2040e52 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:38.473523 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1102/2215] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:55:38.473734 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1114/2216] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:55:38.473838 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc742999-9e7c-4adb-81c8-62ceb2040e52 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:38.475184 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f99f1-f0ee-4a4e-adb5-ba10171a2413 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:38.481964 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc742999-9e7c-4adb-81c8-62ceb2040e52 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:38.487115 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f3fb7-24ba-4af7-b579-c8cdbad13c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:38.487826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f3fb7-24ba-4af7-b579-c8cdbad13c84 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:38.488106 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f3fb7-24ba-4af7-b579-c8cdbad13c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:38.488381 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f3fb7-24ba-4af7-b579-c8cdbad13c84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:38.488990 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f99f1-f0ee-4a4e-adb5-ba10171a2413 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:38.489093 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f3fb7-24ba-4af7-b579-c8cdbad13c84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:38.491014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f3fb7-24ba-4af7-b579-c8cdbad13c84 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:38.494128 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f6247-9390-400f-bc0b-60cc11ed7b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:38.494919 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f6247-9390-400f-bc0b-60cc11ed7b10 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:38.495292 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f6247-9390-400f-bc0b-60cc11ed7b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:38.495641 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f6247-9390-400f-bc0b-60cc11ed7b10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:38.496503 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f6247-9390-400f-bc0b-60cc11ed7b10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:38.498746 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f6247-9390-400f-bc0b-60cc11ed7b10 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:38.530355 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1103/2217] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:55:38 2022] POST /identity/v3/projects => generated 397 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:55:38.534352 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f3fb7-24ba-4af7-b579-c8cdbad13c84 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:38.549779 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:38.553968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1115/2218] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:55:38 2022] POST /identity/v3/projects => generated 387 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:55:38.555972 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f6247-9390-400f-bc0b-60cc11ed7b10 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:38.599169 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:38.633712 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f6247-9390-400f-bc0b-60cc11ed7b10 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:38.635702 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f3fb7-24ba-4af7-b579-c8cdbad13c84 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:38.638583 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffa211-f4ae-4c81-ab62-02a4215927cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:38.639425 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffa211-f4ae-4c81-ab62-02a4215927cf admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:38.639774 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffa211-f4ae-4c81-ab62-02a4215927cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:38.640146 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffa211-f4ae-4c81-ab62-02a4215927cf admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:38.640907 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cffa211-f4ae-4c81-ab62-02a4215927cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:38.641009 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f9f5c-73b0-42b8-9cd6-e98f75bd6074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:38.641681 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f9f5c-73b0-42b8-9cd6-e98f75bd6074 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:38.641964 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f9f5c-73b0-42b8-9cd6-e98f75bd6074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:38.642240 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f9f5c-73b0-42b8-9cd6-e98f75bd6074 admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:38.642934 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f9f5c-73b0-42b8-9cd6-e98f75bd6074 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:38.643206 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cffa211-f4ae-4c81-ab62-02a4215927cf admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:38.644912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f9f5c-73b0-42b8-9cd6-e98f75bd6074 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:38.671567 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1116/2219] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:55:38 2022] POST /identity/v3/users => generated 294 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:55:38.672832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffa211-f4ae-4c81-ab62-02a4215927cf admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:38.673320 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1104/2220] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:55:38 2022] POST /identity/v3/users => generated 299 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:55:38.677105 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f9f5c-73b0-42b8-9cd6-e98f75bd6074 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:38.686612 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffa211-f4ae-4c81-ab62-02a4215927cf admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:38.689924 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f9f5c-73b0-42b8-9cd6-e98f75bd6074 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:38.691731 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1e300-fbe7-4ddd-9050-1287a8a5b35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:38.692431 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1e300-fbe7-4ddd-9050-1287a8a5b35c admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:38.692721 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1e300-fbe7-4ddd-9050-1287a8a5b35c admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:38.692998 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1e300-fbe7-4ddd-9050-1287a8a5b35c admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:38.693737 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1e300-fbe7-4ddd-9050-1287a8a5b35c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:38.694816 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92db23-3529-45ea-bb6d-23076830a3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:38.695446 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1e300-fbe7-4ddd-9050-1287a8a5b35c admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:38.695620 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92db23-3529-45ea-bb6d-23076830a3fc admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:38.696026 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92db23-3529-45ea-bb6d-23076830a3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:38.696378 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92db23-3529-45ea-bb6d-23076830a3fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:38.697213 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f92db23-3529-45ea-bb6d-23076830a3fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:38.698910 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f92db23-3529-45ea-bb6d-23076830a3fc admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:38.709971 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1117/2221] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:55:38.711121 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1e300-fbe7-4ddd-9050-1287a8a5b35c admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:38.716906 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1105/2222] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:55:38.718095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92db23-3529-45ea-bb6d-23076830a3fc admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:38.722717 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1e300-fbe7-4ddd-9050-1287a8a5b35c admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:38.728048 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f3b76-66ab-4f79-a8de-3ca75f4ae680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:38.728764 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92db23-3529-45ea-bb6d-23076830a3fc admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:38.728878 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f3b76-66ab-4f79-a8de-3ca75f4ae680 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:38.729303 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f3b76-66ab-4f79-a8de-3ca75f4ae680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:38.729686 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f3b76-66ab-4f79-a8de-3ca75f4ae680 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:38.730703 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f3b76-66ab-4f79-a8de-3ca75f4ae680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:38.732457 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f3b76-66ab-4f79-a8de-3ca75f4ae680 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:38.733984 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2dba5-b7e0-4044-bb1c-72f9d11f2170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:38.734655 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2dba5-b7e0-4044-bb1c-72f9d11f2170 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:38.734942 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2dba5-b7e0-4044-bb1c-72f9d11f2170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:38.735577 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2dba5-b7e0-4044-bb1c-72f9d11f2170 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:38.735989 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2dba5-b7e0-4044-bb1c-72f9d11f2170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:38.737596 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2dba5-b7e0-4044-bb1c-72f9d11f2170 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:38.748275 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1118/2223] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:55:38.749397 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f3b76-66ab-4f79-a8de-3ca75f4ae680 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:38.755126 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1106/2224] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:55:38.757108 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2dba5-b7e0-4044-bb1c-72f9d11f2170 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:38.760188 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f3b76-66ab-4f79-a8de-3ca75f4ae680 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:38.765462 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09dfada-46c8-4f6d-b859-2c4c6921e6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:38.766372 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dfada-46c8-4f6d-b859-2c4c6921e6bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:38.766657 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dfada-46c8-4f6d-b859-2c4c6921e6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:38.766934 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dfada-46c8-4f6d-b859-2c4c6921e6bc admin admin] PATH_INFO: `/v3/projects/f5c5553d7a6442e98567d93be836f030/users/69a5e31dd80f49eaa74878feb24b68fc/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:38.768041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2dba5-b7e0-4044-bb1c-72f9d11f2170 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:38.773333 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2af820-964e-475e-9299-40e53ef4ff61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:38.774252 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2af820-964e-475e-9299-40e53ef4ff61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:38.774536 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2af820-964e-475e-9299-40e53ef4ff61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:38.774813 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2af820-964e-475e-9299-40e53ef4ff61 admin admin] PATH_INFO: `/v3/projects/053f5e063c8d4a428ee678184a7ee05a/users/0ce8250d6cdf4f9d8f7c59c3c07900ee/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:38.784496 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09dfada-46c8-4f6d-b859-2c4c6921e6bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5c5553d7a6442e98567d93be836f030, user_id=69a5e31dd80f49eaa74878feb24b68fc, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:38.787940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09dfada-46c8-4f6d-b859-2c4c6921e6bc admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:38.792409 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2af820-964e-475e-9299-40e53ef4ff61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=053f5e063c8d4a428ee678184a7ee05a, user_id=0ce8250d6cdf4f9d8f7c59c3c07900ee, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:38.795398 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2af820-964e-475e-9299-40e53ef4ff61 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:38.804171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1119/2225] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:55:38 2022] PUT /identity/v3/projects/f5c5553d7a6442e98567d93be836f030/users/69a5e31dd80f49eaa74878feb24b68fc/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:55:38.816624 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ec221-70ad-4931-ac89-6d4dfb3b0b2f None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:38.817150 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ec221-70ad-4931-ac89-6d4dfb3b0b2f None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:38.817499 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ec221-70ad-4931-ac89-6d4dfb3b0b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:38.821387 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1107/2226] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:55:38 2022] PUT /identity/v3/projects/053f5e063c8d4a428ee678184a7ee05a/users/0ce8250d6cdf4f9d8f7c59c3c07900ee/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:55:38.832960 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae116f12-5d98-427f-8ca9-c0189d136497 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:38.833274 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae116f12-5d98-427f-8ca9-c0189d136497 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:38.833564 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae116f12-5d98-427f-8ca9-c0189d136497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:38.849321 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-385ec221-70ad-4931-ac89-6d4dfb3b0b2f None None] MFA Rules not processed for user `69a5e31dd80f49eaa74878feb24b68fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:38.850744 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-385ec221-70ad-4931-ac89-6d4dfb3b0b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:38.865429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-ae116f12-5d98-427f-8ca9-c0189d136497 None None] MFA Rules not processed for user `0ce8250d6cdf4f9d8f7c59c3c07900ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:38.866291 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-ae116f12-5d98-427f-8ca9-c0189d136497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:38.945978 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1108/2227] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:55:38.950046 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1120/2228] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:55:38.952466 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ec221-70ad-4931-ac89-6d4dfb3b0b2f None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:38.958764 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae116f12-5d98-427f-8ca9-c0189d136497 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:38.960326 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-ae116f12-5d98-427f-8ca9-c0189d136497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:39.012287 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:39.038207 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ec221-70ad-4931-ac89-6d4dfb3b0b2f None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:39.041795 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae116f12-5d98-427f-8ca9-c0189d136497 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:39.044531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8e76b-6782-4798-ada0-c1106565f372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:39.045332 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8e76b-6782-4798-ada0-c1106565f372 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:39.045616 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8e76b-6782-4798-ada0-c1106565f372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:39.045994 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8e76b-6782-4798-ada0-c1106565f372 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:39.048472 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8e76b-6782-4798-ada0-c1106565f372 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:39.050488 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8e76b-6782-4798-ada0-c1106565f372 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:39.054904 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b1bc1-a115-42ae-a983-5eadb867821c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:39.055621 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b1bc1-a115-42ae-a983-5eadb867821c service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:39.055735 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:39.055932 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b1bc1-a115-42ae-a983-5eadb867821c service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:39.056637 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b1bc1-a115-42ae-a983-5eadb867821c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:39.076820 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b1bc1-a115-42ae-a983-5eadb867821c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:39.078634 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b1bc1-a115-42ae-a983-5eadb867821c service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:39.093265 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1121/2229] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:55:38 2022] POST /identity/v3/projects => generated 387 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:55:39.098854 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8e76b-6782-4798-ada0-c1106565f372 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:39.100405 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1109/2230] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:55:38 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:55:39.182263 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8e76b-6782-4798-ada0-c1106565f372 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:39.187934 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff3771-6ac0-48c3-948b-3cf63570d5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:39.188630 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff3771-6ac0-48c3-948b-3cf63570d5d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:39.188902 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff3771-6ac0-48c3-948b-3cf63570d5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:39.189177 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff3771-6ac0-48c3-948b-3cf63570d5d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:39.190164 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff3771-6ac0-48c3-948b-3cf63570d5d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:39.191867 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff3771-6ac0-48c3-948b-3cf63570d5d2 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:39.227140 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1122/2231] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:55:39 2022] POST /identity/v3/users => generated 300 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:55:39.231366 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b1bc1-a115-42ae-a983-5eadb867821c service cinder] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:39.252784 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b1bc1-a115-42ae-a983-5eadb867821c service cinder] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:39.259457 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df679f21-d5bc-44c9-aa6d-6df8a5bcf452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:39.260284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df679f21-d5bc-44c9-aa6d-6df8a5bcf452 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:39.260636 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df679f21-d5bc-44c9-aa6d-6df8a5bcf452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:39.260986 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df679f21-d5bc-44c9-aa6d-6df8a5bcf452 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:39.261815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df679f21-d5bc-44c9-aa6d-6df8a5bcf452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:39.264284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df679f21-d5bc-44c9-aa6d-6df8a5bcf452 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:39.282161 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1110/2232] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:55:39.282438 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff3771-6ac0-48c3-948b-3cf63570d5d2 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:39.290988 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff3771-6ac0-48c3-948b-3cf63570d5d2 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:39.296672 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ee85d-4833-4299-8b47-1c1f0ba4d977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:39.297661 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ee85d-4833-4299-8b47-1c1f0ba4d977 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:39.298012 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ee85d-4833-4299-8b47-1c1f0ba4d977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:39.298468 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ee85d-4833-4299-8b47-1c1f0ba4d977 admin admin] PATH_INFO: `/v3/projects/fd1b34a99d404cbfaaa342b7a0cfe2eb/users/8d510b30208c46eda3a8b72b7e6f4b0d/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:39.314733 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ee85d-4833-4299-8b47-1c1f0ba4d977 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd1b34a99d404cbfaaa342b7a0cfe2eb, user_id=8d510b30208c46eda3a8b72b7e6f4b0d, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:39.317643 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ee85d-4833-4299-8b47-1c1f0ba4d977 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:39.332146 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1123/2233] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:55:39 2022] PUT /identity/v3/projects/fd1b34a99d404cbfaaa342b7a0cfe2eb/users/8d510b30208c46eda3a8b72b7e6f4b0d/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:55:39.335940 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df679f21-d5bc-44c9-aa6d-6df8a5bcf452 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:39.346787 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df679f21-d5bc-44c9-aa6d-6df8a5bcf452 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:39.409309 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561e5a4-eedf-43da-8dc6-195f256d376b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:39.409997 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561e5a4-eedf-43da-8dc6-195f256d376b admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:39.410389 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561e5a4-eedf-43da-8dc6-195f256d376b admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:39.410575 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561e5a4-eedf-43da-8dc6-195f256d376b admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:39.411427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561e5a4-eedf-43da-8dc6-195f256d376b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:39.413057 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561e5a4-eedf-43da-8dc6-195f256d376b admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:39.423810 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1111/2234] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:55:39.428308 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ee85d-4833-4299-8b47-1c1f0ba4d977 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:39.440715 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ee85d-4833-4299-8b47-1c1f0ba4d977 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:39.446667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec09aa-6426-4429-a52c-fef3892547cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:39.447658 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec09aa-6426-4429-a52c-fef3892547cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:39.447919 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec09aa-6426-4429-a52c-fef3892547cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:39.448195 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec09aa-6426-4429-a52c-fef3892547cf admin admin] PATH_INFO: `/v3/projects/fd1b34a99d404cbfaaa342b7a0cfe2eb/users/8d510b30208c46eda3a8b72b7e6f4b0d/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:39.450513 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec09aa-6426-4429-a52c-fef3892547cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd1b34a99d404cbfaaa342b7a0cfe2eb, user_id=8d510b30208c46eda3a8b72b7e6f4b0d, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:39.453233 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec09aa-6426-4429-a52c-fef3892547cf admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:39.464718 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1124/2235] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:55:39 2022] PUT /identity/v3/projects/fd1b34a99d404cbfaaa342b7a0cfe2eb/users/8d510b30208c46eda3a8b72b7e6f4b0d/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:39.476349 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52448a34-e48c-44f2-9dae-5401ee2db43c None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:39.476879 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52448a34-e48c-44f2-9dae-5401ee2db43c None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:39.476974 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52448a34-e48c-44f2-9dae-5401ee2db43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:39.505734 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-52448a34-e48c-44f2-9dae-5401ee2db43c None None] MFA Rules not processed for user `8d510b30208c46eda3a8b72b7e6f4b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:39.506952 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-52448a34-e48c-44f2-9dae-5401ee2db43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:39.589514 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1112/2236] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:39.602326 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec09aa-6426-4429-a52c-fef3892547cf admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:39.604575 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-daec09aa-6426-4429-a52c-fef3892547cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:39.692924 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec09aa-6426-4429-a52c-fef3892547cf admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:39.697555 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce6f7c-245d-43e8-9c09-13dfcb4d8977 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:39.698216 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce6f7c-245d-43e8-9c09-13dfcb4d8977 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:39.698493 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce6f7c-245d-43e8-9c09-13dfcb4d8977 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:39.698792 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce6f7c-245d-43e8-9c09-13dfcb4d8977 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:39.709263 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce6f7c-245d-43e8-9c09-13dfcb4d8977 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:39.710712 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce6f7c-245d-43e8-9c09-13dfcb4d8977 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:39.720607 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1125/2237] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:55:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:55:40.346075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52448a34-e48c-44f2-9dae-5401ee2db43c None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:40.409651 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:40.415112 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52448a34-e48c-44f2-9dae-5401ee2db43c None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:40.419608 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712233e0-5654-4359-a9d9-b1a25330123c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:40.420964 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712233e0-5654-4359-a9d9-b1a25330123c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:40.420964 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712233e0-5654-4359-a9d9-b1a25330123c admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:40.421177 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712233e0-5654-4359-a9d9-b1a25330123c admin admin] PATH_INFO: `/v3/users/69a5e31dd80f49eaa74878feb24b68fc` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:40.422266 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712233e0-5654-4359-a9d9-b1a25330123c admin admin] RBAC: Authorizing `identity:delete_user(user_id=69a5e31dd80f49eaa74878feb24b68fc)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:40.424251 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712233e0-5654-4359-a9d9-b1a25330123c admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:40.475630 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-712233e0-5654-4359-a9d9-b1a25330123c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69a5e31dd80f49eaa74878feb24b68fc'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:40.483674 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-712233e0-5654-4359-a9d9-b1a25330123c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69a5e31dd80f49eaa74878feb24b68fc'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:40.491664 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-712233e0-5654-4359-a9d9-b1a25330123c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69a5e31dd80f49eaa74878feb24b68fc'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:40.492279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-712233e0-5654-4359-a9d9-b1a25330123c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69a5e31dd80f49eaa74878feb24b68fc'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:40.505861 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-712233e0-5654-4359-a9d9-b1a25330123c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69a5e31dd80f49eaa74878feb24b68fc'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:40.512961 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1113/2238] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:55:40 2022] DELETE /identity/v3/users/69a5e31dd80f49eaa74878feb24b68fc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:40.517634 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f68b05-be0f-4d0c-9ba3-ceee53405346 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:40.518118 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f68b05-be0f-4d0c-9ba3-ceee53405346 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:40.518225 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f68b05-be0f-4d0c-9ba3-ceee53405346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:40.538469 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-89f68b05-be0f-4d0c-9ba3-ceee53405346 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:40.539886 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-89f68b05-be0f-4d0c-9ba3-ceee53405346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:40.577338 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:40.600321 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1126/2239] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:40.610074 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712233e0-5654-4359-a9d9-b1a25330123c admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:40.611922 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-712233e0-5654-4359-a9d9-b1a25330123c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:40.672245 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712233e0-5654-4359-a9d9-b1a25330123c admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:40.676207 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb7a8e-c505-4d5b-af6e-983f51427f05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:40.676948 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb7a8e-c505-4d5b-af6e-983f51427f05 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:40.677336 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb7a8e-c505-4d5b-af6e-983f51427f05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:40.677644 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb7a8e-c505-4d5b-af6e-983f51427f05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:40.687694 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb7a8e-c505-4d5b-af6e-983f51427f05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:40.689136 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb7a8e-c505-4d5b-af6e-983f51427f05 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:40.698918 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1114/2240] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:55:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:55:40.975536 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f68b05-be0f-4d0c-9ba3-ceee53405346 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:40.976976 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-89f68b05-be0f-4d0c-9ba3-ceee53405346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:40.992713 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f68b05-be0f-4d0c-9ba3-ceee53405346 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:40.999341 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dc68a-e88e-472c-9d26-f70f6f5cfae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:41.000603 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dc68a-e88e-472c-9d26-f70f6f5cfae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:41.000837 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dc68a-e88e-472c-9d26-f70f6f5cfae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:41.001121 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dc68a-e88e-472c-9d26-f70f6f5cfae7 admin admin] PATH_INFO: `/v3/projects/f5c5553d7a6442e98567d93be836f030` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:41.002403 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0dc68a-e88e-472c-9d26-f70f6f5cfae7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5c5553d7a6442e98567d93be836f030)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:41.004353 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0dc68a-e88e-472c-9d26-f70f6f5cfae7 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:41.061317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6b0dc68a-e88e-472c-9d26-f70f6f5cfae7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5c5553d7a6442e98567d93be836f030', 'request_id': 'req-6b0dc68a-e88e-472c-9d26-f70f6f5cfae7'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:41.072830 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6b0dc68a-e88e-472c-9d26-f70f6f5cfae7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5c5553d7a6442e98567d93be836f030', 'request_id': 'req-6b0dc68a-e88e-472c-9d26-f70f6f5cfae7'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:41.079493 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6b0dc68a-e88e-472c-9d26-f70f6f5cfae7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5c5553d7a6442e98567d93be836f030', 'request_id': 'req-6b0dc68a-e88e-472c-9d26-f70f6f5cfae7'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:41.090960 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6b0dc68a-e88e-472c-9d26-f70f6f5cfae7 admin admin] The token cache is being invalidate because project f5c5553d7a6442e98567d93be836f030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:55:41.091509 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6b0dc68a-e88e-472c-9d26-f70f6f5cfae7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:41.091954 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6b0dc68a-e88e-472c-9d26-f70f6f5cfae7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:41.093623 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1127/2241] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:55:40 2022] DELETE /identity/v3/projects/f5c5553d7a6442e98567d93be836f030 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:41.097864 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb7a8e-c505-4d5b-af6e-983f51427f05 service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:41.108313 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb7a8e-c505-4d5b-af6e-983f51427f05 service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:41.169760 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d883d1-d69a-4253-bfec-260220d3fe7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:41.170659 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d883d1-d69a-4253-bfec-260220d3fe7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:41.170974 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d883d1-d69a-4253-bfec-260220d3fe7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:41.171273 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d883d1-d69a-4253-bfec-260220d3fe7f admin admin] PATH_INFO: `/v3/users/8d510b30208c46eda3a8b72b7e6f4b0d` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:41.172516 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d883d1-d69a-4253-bfec-260220d3fe7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d510b30208c46eda3a8b72b7e6f4b0d)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:41.174437 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d883d1-d69a-4253-bfec-260220d3fe7f admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:41.197840 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:41.226356 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-02d883d1-d69a-4253-bfec-260220d3fe7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d510b30208c46eda3a8b72b7e6f4b0d'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:41.233761 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-02d883d1-d69a-4253-bfec-260220d3fe7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d510b30208c46eda3a8b72b7e6f4b0d'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:41.242520 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-02d883d1-d69a-4253-bfec-260220d3fe7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d510b30208c46eda3a8b72b7e6f4b0d'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:41.243217 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-02d883d1-d69a-4253-bfec-260220d3fe7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d510b30208c46eda3a8b72b7e6f4b0d'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:41.256788 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-02d883d1-d69a-4253-bfec-260220d3fe7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d510b30208c46eda3a8b72b7e6f4b0d'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:41.263226 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1115/2242] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:55:41 2022] DELETE /identity/v3/users/8d510b30208c46eda3a8b72b7e6f4b0d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:41.558423 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dc68a-e88e-472c-9d26-f70f6f5cfae7 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:41.561721 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6b0dc68a-e88e-472c-9d26-f70f6f5cfae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:41.576800 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dc68a-e88e-472c-9d26-f70f6f5cfae7 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:41.677199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef4e66-8d3f-4da5-92b9-eb4309f530e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:41.678121 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef4e66-8d3f-4da5-92b9-eb4309f530e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:41.678509 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef4e66-8d3f-4da5-92b9-eb4309f530e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:41.678799 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef4e66-8d3f-4da5-92b9-eb4309f530e2 admin admin] PATH_INFO: `/v3/projects/fd1b34a99d404cbfaaa342b7a0cfe2eb` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:41.680451 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef4e66-8d3f-4da5-92b9-eb4309f530e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd1b34a99d404cbfaaa342b7a0cfe2eb)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:41.683837 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef4e66-8d3f-4da5-92b9-eb4309f530e2 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:41.745342 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-55ef4e66-8d3f-4da5-92b9-eb4309f530e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd1b34a99d404cbfaaa342b7a0cfe2eb', 'request_id': 'req-55ef4e66-8d3f-4da5-92b9-eb4309f530e2'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:41.754898 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-55ef4e66-8d3f-4da5-92b9-eb4309f530e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd1b34a99d404cbfaaa342b7a0cfe2eb', 'request_id': 'req-55ef4e66-8d3f-4da5-92b9-eb4309f530e2'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:41.760664 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-55ef4e66-8d3f-4da5-92b9-eb4309f530e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd1b34a99d404cbfaaa342b7a0cfe2eb', 'request_id': 'req-55ef4e66-8d3f-4da5-92b9-eb4309f530e2'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:41.762658 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:41.774195 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-55ef4e66-8d3f-4da5-92b9-eb4309f530e2 admin admin] The token cache is being invalidate because project fd1b34a99d404cbfaaa342b7a0cfe2eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:55:41.774837 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-55ef4e66-8d3f-4da5-92b9-eb4309f530e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:41.775806 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-55ef4e66-8d3f-4da5-92b9-eb4309f530e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:41.777713 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1128/2243] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:55:41 2022] DELETE /identity/v3/projects/fd1b34a99d404cbfaaa342b7a0cfe2eb => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:41.783526 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692c749-6648-4315-8658-a0bd1bf4b9d8 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:41.784089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692c749-6648-4315-8658-a0bd1bf4b9d8 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:41.784194 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692c749-6648-4315-8658-a0bd1bf4b9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:41.803526 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-b692c749-6648-4315-8658-a0bd1bf4b9d8 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:41.807331 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-b692c749-6648-4315-8658-a0bd1bf4b9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:41.869752 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1116/2244] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:55:41.878365 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b94f52-0c91-4e8b-be89-714a09a95ad3 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:41.878767 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b94f52-0c91-4e8b-be89-714a09a95ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:41.879223 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b94f52-0c91-4e8b-be89-714a09a95ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:41.906268 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-84b94f52-0c91-4e8b-be89-714a09a95ad3 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:41.907497 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-84b94f52-0c91-4e8b-be89-714a09a95ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:41.916083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1129/2245] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:41.920892 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692c749-6648-4315-8658-a0bd1bf4b9d8 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:41.931629 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692c749-6648-4315-8658-a0bd1bf4b9d8 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:41.937611 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c45ab-6b09-4b2c-8977-5cfc7e11fc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:41.938287 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c45ab-6b09-4b2c-8977-5cfc7e11fc32 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:41.938574 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c45ab-6b09-4b2c-8977-5cfc7e11fc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:41.938850 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c45ab-6b09-4b2c-8977-5cfc7e11fc32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:41.939611 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c45ab-6b09-4b2c-8977-5cfc7e11fc32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:55:41.939919 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c45ab-6b09-4b2c-8977-5cfc7e11fc32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:41.941566 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c45ab-6b09-4b2c-8977-5cfc7e11fc32 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:41.954913 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1117/2246] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:55:41.959289 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b94f52-0c91-4e8b-be89-714a09a95ad3 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:41.969314 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b94f52-0c91-4e8b-be89-714a09a95ad3 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:41.974228 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aecdc8-4724-4f7e-bb1a-011bf82cf9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:41.974878 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aecdc8-4724-4f7e-bb1a-011bf82cf9fb admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:41.975168 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aecdc8-4724-4f7e-bb1a-011bf82cf9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:41.975472 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aecdc8-4724-4f7e-bb1a-011bf82cf9fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:41.976169 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aecdc8-4724-4f7e-bb1a-011bf82cf9fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:41.978066 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aecdc8-4724-4f7e-bb1a-011bf82cf9fb admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:42.010276 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1130/2247] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:55:41 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:55:42.011514 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c45ab-6b09-4b2c-8977-5cfc7e11fc32 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:42.022192 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c45ab-6b09-4b2c-8977-5cfc7e11fc32 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:42.083108 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afc97f-f241-4848-b78d-9b07c198dc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:42.083814 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afc97f-f241-4848-b78d-9b07c198dc23 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:42.083944 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afc97f-f241-4848-b78d-9b07c198dc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:42.084136 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afc97f-f241-4848-b78d-9b07c198dc23 admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:42.084872 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13afc97f-f241-4848-b78d-9b07c198dc23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:42.086810 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13afc97f-f241-4848-b78d-9b07c198dc23 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:42.112281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1118/2248] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:55:42 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:55:42.116666 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aecdc8-4724-4f7e-bb1a-011bf82cf9fb admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:42.128376 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aecdc8-4724-4f7e-bb1a-011bf82cf9fb admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:42.133536 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10e217-925a-4202-99ca-9a73242a44cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:42.134305 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10e217-925a-4202-99ca-9a73242a44cc admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:42.134636 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10e217-925a-4202-99ca-9a73242a44cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:42.134954 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10e217-925a-4202-99ca-9a73242a44cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:42.135722 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10e217-925a-4202-99ca-9a73242a44cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:42.137331 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10e217-925a-4202-99ca-9a73242a44cc admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:42.148796 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1131/2249] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:55:42.152839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afc97f-f241-4848-b78d-9b07c198dc23 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:42.163858 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afc97f-f241-4848-b78d-9b07c198dc23 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:42.169881 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818f4b0-3117-4dc0-b383-ed5506643b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:42.170578 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818f4b0-3117-4dc0-b383-ed5506643b15 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:42.170886 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818f4b0-3117-4dc0-b383-ed5506643b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:42.171134 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818f4b0-3117-4dc0-b383-ed5506643b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:42.171896 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818f4b0-3117-4dc0-b383-ed5506643b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:42.173489 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818f4b0-3117-4dc0-b383-ed5506643b15 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:42.184918 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1119/2250] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:55:42.189195 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10e217-925a-4202-99ca-9a73242a44cc admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:42.199425 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10e217-925a-4202-99ca-9a73242a44cc admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:42.204563 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f43a8-17b5-4987-9c9f-832a99bcdbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:42.205442 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f43a8-17b5-4987-9c9f-832a99bcdbaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:42.205727 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f43a8-17b5-4987-9c9f-832a99bcdbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:42.206004 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f43a8-17b5-4987-9c9f-832a99bcdbaf admin admin] PATH_INFO: `/v3/projects/008c04030f194909b9fe5123e012b6dc/users/02f26a84ad564b60b01b0e9c46683599/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:42.220724 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f43a8-17b5-4987-9c9f-832a99bcdbaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=008c04030f194909b9fe5123e012b6dc, user_id=02f26a84ad564b60b01b0e9c46683599, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:42.223456 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f43a8-17b5-4987-9c9f-832a99bcdbaf admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:42.238658 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1132/2251] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:55:42 2022] PUT /identity/v3/projects/008c04030f194909b9fe5123e012b6dc/users/02f26a84ad564b60b01b0e9c46683599/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:42.250943 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc30c4-9898-44fe-ac3c-6014fdc31991 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:42.251247 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc30c4-9898-44fe-ac3c-6014fdc31991 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:42.251524 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc30c4-9898-44fe-ac3c-6014fdc31991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:42.259201 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:42.281561 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-f7bc30c4-9898-44fe-ac3c-6014fdc31991 None None] MFA Rules not processed for user `02f26a84ad564b60b01b0e9c46683599`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:42.282730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-f7bc30c4-9898-44fe-ac3c-6014fdc31991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:42.347606 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1120/2252] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:42.359619 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f43a8-17b5-4987-9c9f-832a99bcdbaf admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:42.361444 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-993f43a8-17b5-4987-9c9f-832a99bcdbaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:42.430773 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f43a8-17b5-4987-9c9f-832a99bcdbaf admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:42.435038 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b6f56-8deb-432b-bfe6-7acd2fa68b33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:42.436084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b6f56-8deb-432b-bfe6-7acd2fa68b33 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:42.437189 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b6f56-8deb-432b-bfe6-7acd2fa68b33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:42.437476 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b6f56-8deb-432b-bfe6-7acd2fa68b33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:42.446422 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b6f56-8deb-432b-bfe6-7acd2fa68b33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:42.447895 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b6f56-8deb-432b-bfe6-7acd2fa68b33 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:42.457130 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1133/2253] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:55:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:55:50.452727 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc30c4-9898-44fe-ac3c-6014fdc31991 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:50.460926 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-f7bc30c4-9898-44fe-ac3c-6014fdc31991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:50.536106 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc30c4-9898-44fe-ac3c-6014fdc31991 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:50.540598 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac1d49-5b1e-43d9-a4ce-2d4867024c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:50.541493 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac1d49-5b1e-43d9-a4ce-2d4867024c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:50.541776 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac1d49-5b1e-43d9-a4ce-2d4867024c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:50.542051 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac1d49-5b1e-43d9-a4ce-2d4867024c3d admin admin] PATH_INFO: `/v3/users/0ce8250d6cdf4f9d8f7c59c3c07900ee` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:50.543283 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac1d49-5b1e-43d9-a4ce-2d4867024c3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ce8250d6cdf4f9d8f7c59c3c07900ee)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:50.545215 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac1d49-5b1e-43d9-a4ce-2d4867024c3d admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:50.597051 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-06ac1d49-5b1e-43d9-a4ce-2d4867024c3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ce8250d6cdf4f9d8f7c59c3c07900ee'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:50.603982 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-06ac1d49-5b1e-43d9-a4ce-2d4867024c3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ce8250d6cdf4f9d8f7c59c3c07900ee'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:50.615121 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-06ac1d49-5b1e-43d9-a4ce-2d4867024c3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ce8250d6cdf4f9d8f7c59c3c07900ee'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:50.615822 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-06ac1d49-5b1e-43d9-a4ce-2d4867024c3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ce8250d6cdf4f9d8f7c59c3c07900ee'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:50.631139 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-06ac1d49-5b1e-43d9-a4ce-2d4867024c3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ce8250d6cdf4f9d8f7c59c3c07900ee'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:50.638306 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1121/2254] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:55:50 2022] DELETE /identity/v3/users/0ce8250d6cdf4f9d8f7c59c3c07900ee => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:50.643764 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa0949-20fe-459e-bd27-9ec42a478593 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:50.644259 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa0949-20fe-459e-bd27-9ec42a478593 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:50.644350 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa0949-20fe-459e-bd27-9ec42a478593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:50.662922 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-6baa0949-20fe-459e-bd27-9ec42a478593 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:50.664284 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6baa0949-20fe-459e-bd27-9ec42a478593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:50.729900 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1134/2255] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:50.740061 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac1d49-5b1e-43d9-a4ce-2d4867024c3d admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:50.741582 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-06ac1d49-5b1e-43d9-a4ce-2d4867024c3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:50.757323 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:50.806837 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac1d49-5b1e-43d9-a4ce-2d4867024c3d admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:50.811656 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce066cfc-6b62-447b-8f40-9df19a27c423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:50.812191 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce066cfc-6b62-447b-8f40-9df19a27c423 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:50.812473 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce066cfc-6b62-447b-8f40-9df19a27c423 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:50.812746 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce066cfc-6b62-447b-8f40-9df19a27c423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:50.823775 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce066cfc-6b62-447b-8f40-9df19a27c423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:50.826258 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce066cfc-6b62-447b-8f40-9df19a27c423 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:50.838491 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1122/2256] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:55:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:55:50.933665 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa0949-20fe-459e-bd27-9ec42a478593 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:50.935051 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6baa0949-20fe-459e-bd27-9ec42a478593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:50.951513 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa0949-20fe-459e-bd27-9ec42a478593 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:50.961455 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500282f9-6f8a-44ca-8f0d-7170949fa39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:50.962372 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500282f9-6f8a-44ca-8f0d-7170949fa39b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:50.962786 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500282f9-6f8a-44ca-8f0d-7170949fa39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:50.963036 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500282f9-6f8a-44ca-8f0d-7170949fa39b admin admin] PATH_INFO: `/v3/users/02f26a84ad564b60b01b0e9c46683599` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:50.964492 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500282f9-6f8a-44ca-8f0d-7170949fa39b admin admin] RBAC: Authorizing `identity:delete_user(user_id=02f26a84ad564b60b01b0e9c46683599)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:50.966431 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500282f9-6f8a-44ca-8f0d-7170949fa39b admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:51.012448 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:51.028227 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-500282f9-6f8a-44ca-8f0d-7170949fa39b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02f26a84ad564b60b01b0e9c46683599'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:51.035464 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-500282f9-6f8a-44ca-8f0d-7170949fa39b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02f26a84ad564b60b01b0e9c46683599'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:51.043732 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-500282f9-6f8a-44ca-8f0d-7170949fa39b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02f26a84ad564b60b01b0e9c46683599'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:51.044435 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-500282f9-6f8a-44ca-8f0d-7170949fa39b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02f26a84ad564b60b01b0e9c46683599'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:51.058355 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-500282f9-6f8a-44ca-8f0d-7170949fa39b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02f26a84ad564b60b01b0e9c46683599'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:51.064712 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1135/2257] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:55:50 2022] DELETE /identity/v3/users/02f26a84ad564b60b01b0e9c46683599 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:51.069683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66449933-e382-4e68-aad1-e944970d0a01 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:51.069968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66449933-e382-4e68-aad1-e944970d0a01 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:51.070272 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66449933-e382-4e68-aad1-e944970d0a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:51.088625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-66449933-e382-4e68-aad1-e944970d0a01 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:51.089932 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-66449933-e382-4e68-aad1-e944970d0a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:51.127478 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500282f9-6f8a-44ca-8f0d-7170949fa39b admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:51.128934 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-500282f9-6f8a-44ca-8f0d-7170949fa39b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:51.162876 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1123/2258] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:51.173917 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66449933-e382-4e68-aad1-e944970d0a01 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:51.175341 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-66449933-e382-4e68-aad1-e944970d0a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:51.203435 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500282f9-6f8a-44ca-8f0d-7170949fa39b admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:51.208278 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e6eb7-13db-4bf3-b717-4bbf583e1d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:51.209159 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e6eb7-13db-4bf3-b717-4bbf583e1d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:51.209440 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e6eb7-13db-4bf3-b717-4bbf583e1d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:51.209710 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e6eb7-13db-4bf3-b717-4bbf583e1d17 admin admin] PATH_INFO: `/v3/projects/053f5e063c8d4a428ee678184a7ee05a` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:51.210899 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3e6eb7-13db-4bf3-b717-4bbf583e1d17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=053f5e063c8d4a428ee678184a7ee05a)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:51.212853 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3e6eb7-13db-4bf3-b717-4bbf583e1d17 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:51.233916 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66449933-e382-4e68-aad1-e944970d0a01 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:51.237794 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b41053-fffe-4783-a7c4-ce3bc10bd3c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:51.238562 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b41053-fffe-4783-a7c4-ce3bc10bd3c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:51.238918 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b41053-fffe-4783-a7c4-ce3bc10bd3c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:51.239438 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b41053-fffe-4783-a7c4-ce3bc10bd3c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:51.249943 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b41053-fffe-4783-a7c4-ce3bc10bd3c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:51.251495 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b41053-fffe-4783-a7c4-ce3bc10bd3c0 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:51.259858 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9c3e6eb7-13db-4bf3-b717-4bbf583e1d17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '053f5e063c8d4a428ee678184a7ee05a', 'request_id': 'req-9c3e6eb7-13db-4bf3-b717-4bbf583e1d17'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:51.261006 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1124/2259] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:55:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:55:51.268204 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9c3e6eb7-13db-4bf3-b717-4bbf583e1d17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '053f5e063c8d4a428ee678184a7ee05a', 'request_id': 'req-9c3e6eb7-13db-4bf3-b717-4bbf583e1d17'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:51.274421 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9c3e6eb7-13db-4bf3-b717-4bbf583e1d17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '053f5e063c8d4a428ee678184a7ee05a', 'request_id': 'req-9c3e6eb7-13db-4bf3-b717-4bbf583e1d17'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:51.286374 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9c3e6eb7-13db-4bf3-b717-4bbf583e1d17 admin admin] The token cache is being invalidate because project 053f5e063c8d4a428ee678184a7ee05a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:55:51.286714 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9c3e6eb7-13db-4bf3-b717-4bbf583e1d17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:51.287486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9c3e6eb7-13db-4bf3-b717-4bbf583e1d17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:51.289177 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1136/2260] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:55:51 2022] DELETE /identity/v3/projects/053f5e063c8d4a428ee678184a7ee05a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:55:51.564895 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b41053-fffe-4783-a7c4-ce3bc10bd3c0 service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:51.566481 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-53b41053-fffe-4783-a7c4-ce3bc10bd3c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:51.579921 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b41053-fffe-4783-a7c4-ce3bc10bd3c0 service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:51.644649 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4314137-ea96-4dba-8523-c65e7bf9200f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:51.645543 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4314137-ea96-4dba-8523-c65e7bf9200f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:51.645827 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4314137-ea96-4dba-8523-c65e7bf9200f admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:51.646108 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4314137-ea96-4dba-8523-c65e7bf9200f admin admin] PATH_INFO: `/v3/projects/008c04030f194909b9fe5123e012b6dc` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:51.647361 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4314137-ea96-4dba-8523-c65e7bf9200f admin admin] RBAC: Authorizing `identity:delete_project(project_id=008c04030f194909b9fe5123e012b6dc)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:51.649321 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4314137-ea96-4dba-8523-c65e7bf9200f admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:51.650776 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:51.697614 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-d4314137-ea96-4dba-8523-c65e7bf9200f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '008c04030f194909b9fe5123e012b6dc', 'request_id': 'req-d4314137-ea96-4dba-8523-c65e7bf9200f'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:51.708174 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-d4314137-ea96-4dba-8523-c65e7bf9200f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '008c04030f194909b9fe5123e012b6dc', 'request_id': 'req-d4314137-ea96-4dba-8523-c65e7bf9200f'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:51.715463 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-d4314137-ea96-4dba-8523-c65e7bf9200f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '008c04030f194909b9fe5123e012b6dc', 'request_id': 'req-d4314137-ea96-4dba-8523-c65e7bf9200f'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:51.728563 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-d4314137-ea96-4dba-8523-c65e7bf9200f admin admin] The token cache is being invalidate because project 008c04030f194909b9fe5123e012b6dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:55:51.728819 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-d4314137-ea96-4dba-8523-c65e7bf9200f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:51.729509 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-d4314137-ea96-4dba-8523-c65e7bf9200f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:55:51.731487 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1125/2261] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:55:51 2022] DELETE /identity/v3/projects/008c04030f194909b9fe5123e012b6dc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:51.737308 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e11a45-8f5e-4add-99e1-97cde5025fd4 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:51.737838 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e11a45-8f5e-4add-99e1-97cde5025fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:51.737838 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e11a45-8f5e-4add-99e1-97cde5025fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:51.767179 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-64e11a45-8f5e-4add-99e1-97cde5025fd4 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:51.768401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-64e11a45-8f5e-4add-99e1-97cde5025fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:51.794636 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:51.835575 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1137/2262] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:51.843831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945dd9b-4784-47d5-ab52-4b94320d0c15 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:51.844128 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945dd9b-4784-47d5-ab52-4b94320d0c15 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:51.844408 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945dd9b-4784-47d5-ab52-4b94320d0c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:51.863180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-e945dd9b-4784-47d5-ab52-4b94320d0c15 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:51.864569 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-e945dd9b-4784-47d5-ab52-4b94320d0c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:51.873489 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1126/2263] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:51.878536 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e11a45-8f5e-4add-99e1-97cde5025fd4 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:51.891384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e11a45-8f5e-4add-99e1-97cde5025fd4 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:51.898115 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b885a1a-fa79-41cf-b5c8-90cd655a0fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:51.898906 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b885a1a-fa79-41cf-b5c8-90cd655a0fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:51.899329 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b885a1a-fa79-41cf-b5c8-90cd655a0fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:51.899725 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b885a1a-fa79-41cf-b5c8-90cd655a0fd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:51.904019 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b885a1a-fa79-41cf-b5c8-90cd655a0fd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:55:51.904387 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b885a1a-fa79-41cf-b5c8-90cd655a0fd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:51.906956 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b885a1a-fa79-41cf-b5c8-90cd655a0fd5 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:51.939360 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1138/2264] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:55:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:55:51.940597 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945dd9b-4784-47d5-ab52-4b94320d0c15 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:51.950116 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945dd9b-4784-47d5-ab52-4b94320d0c15 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:51.955118 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dbb30c-47f5-4647-a127-029aef456a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:51.955816 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbb30c-47f5-4647-a127-029aef456a5e admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:51.956097 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbb30c-47f5-4647-a127-029aef456a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:51.956371 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbb30c-47f5-4647-a127-029aef456a5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:51.957075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dbb30c-47f5-4647-a127-029aef456a5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:51.959105 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dbb30c-47f5-4647-a127-029aef456a5e admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:51.991596 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1127/2265] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:55:51 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:55:51.992814 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b885a1a-fa79-41cf-b5c8-90cd655a0fd5 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:52.003819 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b885a1a-fa79-41cf-b5c8-90cd655a0fd5 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:52.065134 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412da52-4e5f-4dcb-8a41-c5d84252c857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:52.065892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412da52-4e5f-4dcb-8a41-c5d84252c857 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:52.066183 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412da52-4e5f-4dcb-8a41-c5d84252c857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:52.066456 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412da52-4e5f-4dcb-8a41-c5d84252c857 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:52.067181 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3412da52-4e5f-4dcb-8a41-c5d84252c857 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:52.069150 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3412da52-4e5f-4dcb-8a41-c5d84252c857 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:52.094237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1139/2266] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:55:51 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:55:52.098863 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dbb30c-47f5-4647-a127-029aef456a5e admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:52.109661 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dbb30c-47f5-4647-a127-029aef456a5e admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:52.114416 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553633e1-e9f3-4e16-92d0-dc1896395d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:52.115142 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553633e1-e9f3-4e16-92d0-dc1896395d4b admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:52.115458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553633e1-e9f3-4e16-92d0-dc1896395d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:52.115923 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553633e1-e9f3-4e16-92d0-dc1896395d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:52.116461 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553633e1-e9f3-4e16-92d0-dc1896395d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:52.118105 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553633e1-e9f3-4e16-92d0-dc1896395d4b admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:52.129748 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1128/2267] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:55:52.133843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412da52-4e5f-4dcb-8a41-c5d84252c857 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:52.144282 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412da52-4e5f-4dcb-8a41-c5d84252c857 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:52.149485 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22675050-820a-42a5-98ca-1c6db9eaee3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:52.150170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22675050-820a-42a5-98ca-1c6db9eaee3f admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:52.150462 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22675050-820a-42a5-98ca-1c6db9eaee3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:52.150776 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22675050-820a-42a5-98ca-1c6db9eaee3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:52.151521 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22675050-820a-42a5-98ca-1c6db9eaee3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:52.153130 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22675050-820a-42a5-98ca-1c6db9eaee3f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:52.163831 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1140/2268] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:55:52.168546 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553633e1-e9f3-4e16-92d0-dc1896395d4b admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:52.179802 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553633e1-e9f3-4e16-92d0-dc1896395d4b admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:52.184351 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3aa73-5ac7-4e55-b3e6-53e2ca015f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:52.185246 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3aa73-5ac7-4e55-b3e6-53e2ca015f74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:52.185528 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3aa73-5ac7-4e55-b3e6-53e2ca015f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:52.185800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3aa73-5ac7-4e55-b3e6-53e2ca015f74 admin admin] PATH_INFO: `/v3/projects/8ac83d6edd244e269722822e0e339f15/users/0e97d164a02b49a79e4299be4debf774/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:52.201551 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3aa73-5ac7-4e55-b3e6-53e2ca015f74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ac83d6edd244e269722822e0e339f15, user_id=0e97d164a02b49a79e4299be4debf774, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:52.204624 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3aa73-5ac7-4e55-b3e6-53e2ca015f74 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:52.225865 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1129/2269] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:55:52 2022] PUT /identity/v3/projects/8ac83d6edd244e269722822e0e339f15/users/0e97d164a02b49a79e4299be4debf774/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:55:52.228382 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9c294-2825-4fc0-852b-26762ecb26d5 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:52.228678 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9c294-2825-4fc0-852b-26762ecb26d5 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:52.228963 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9c294-2825-4fc0-852b-26762ecb26d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:52.249067 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-8cc9c294-2825-4fc0-852b-26762ecb26d5 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:52.250722 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-8cc9c294-2825-4fc0-852b-26762ecb26d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:52.319319 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1141/2270] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:52.329431 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3aa73-5ac7-4e55-b3e6-53e2ca015f74 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:52.331270 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-50f3aa73-5ac7-4e55-b3e6-53e2ca015f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:52.392579 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3aa73-5ac7-4e55-b3e6-53e2ca015f74 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:52.397267 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f676e64-b733-48c9-9d68-7ffc18922d5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:52.398045 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f676e64-b733-48c9-9d68-7ffc18922d5d service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:52.398334 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f676e64-b733-48c9-9d68-7ffc18922d5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:52.398677 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f676e64-b733-48c9-9d68-7ffc18922d5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:52.408867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f676e64-b733-48c9-9d68-7ffc18922d5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:52.410299 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f676e64-b733-48c9-9d68-7ffc18922d5d service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:52.419942 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1130/2271] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:55:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:55:56.558377 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d38377-dc26-487b-8376-010affb12ac3 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:56.558921 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d38377-dc26-487b-8376-010affb12ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:56.559202 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d38377-dc26-487b-8376-010affb12ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:56.588956 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-20d38377-dc26-487b-8376-010affb12ac3 None None] MFA Rules not processed for user `0e97d164a02b49a79e4299be4debf774`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:55:56.590259 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-20d38377-dc26-487b-8376-010affb12ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:55:56.617370 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:56.674407 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1142/2272] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:55:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:55:56.679517 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f676e64-b733-48c9-9d68-7ffc18922d5d service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:56.690406 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f676e64-b733-48c9-9d68-7ffc18922d5d service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:56.695626 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83eb4bb-bfe1-47a2-bff0-14be003e9138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:56.696297 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83eb4bb-bfe1-47a2-bff0-14be003e9138 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:56.696578 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83eb4bb-bfe1-47a2-bff0-14be003e9138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:56.696873 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83eb4bb-bfe1-47a2-bff0-14be003e9138 admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:56.697563 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83eb4bb-bfe1-47a2-bff0-14be003e9138 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:56.699584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83eb4bb-bfe1-47a2-bff0-14be003e9138 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:56.730473 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1131/2273] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:55:56 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:55:56.731804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d38377-dc26-487b-8376-010affb12ac3 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:56.743583 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d38377-dc26-487b-8376-010affb12ac3 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:56.809286 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012cb36-4657-4080-a570-da5f3f2af0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:56.810038 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012cb36-4657-4080-a570-da5f3f2af0c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:56.810348 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012cb36-4657-4080-a570-da5f3f2af0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:56.810630 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012cb36-4657-4080-a570-da5f3f2af0c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:56.811419 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012cb36-4657-4080-a570-da5f3f2af0c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:56.813475 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012cb36-4657-4080-a570-da5f3f2af0c6 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:56.836199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1143/2274] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:55:56 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:55:56.840186 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83eb4bb-bfe1-47a2-bff0-14be003e9138 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:56.852462 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83eb4bb-bfe1-47a2-bff0-14be003e9138 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:56.857913 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d68ad-7572-43bd-aa4a-95e732d6cae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:56.858607 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d68ad-7572-43bd-aa4a-95e732d6cae1 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:56.858978 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d68ad-7572-43bd-aa4a-95e732d6cae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:56.859887 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d68ad-7572-43bd-aa4a-95e732d6cae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:56.860632 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d68ad-7572-43bd-aa4a-95e732d6cae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:56.862283 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d68ad-7572-43bd-aa4a-95e732d6cae1 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:56.863815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:55:56.878627 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1132/2275] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:55:56.879895 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012cb36-4657-4080-a570-da5f3f2af0c6 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:56.891134 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012cb36-4657-4080-a570-da5f3f2af0c6 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:56.896038 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93253d87-9b11-4856-aece-30c39be9693f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:56.896936 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93253d87-9b11-4856-aece-30c39be9693f admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:56.897223 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93253d87-9b11-4856-aece-30c39be9693f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:56.897500 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93253d87-9b11-4856-aece-30c39be9693f admin admin] PATH_INFO: `/v3/projects/0e5e67dae3264723a9d5fffbc85b909b/users/753d97a529664fe39f73e2c66aaacc68/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:56.913987 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93253d87-9b11-4856-aece-30c39be9693f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e5e67dae3264723a9d5fffbc85b909b, user_id=753d97a529664fe39f73e2c66aaacc68, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:56.916693 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93253d87-9b11-4856-aece-30c39be9693f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:56.940408 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1144/2276] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:55:56 2022] PUT /identity/v3/projects/0e5e67dae3264723a9d5fffbc85b909b/users/753d97a529664fe39f73e2c66aaacc68/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:55:56.944565 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d68ad-7572-43bd-aa4a-95e732d6cae1 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:56.963492 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d68ad-7572-43bd-aa4a-95e732d6cae1 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:57.062239 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619924a-4579-4da1-bc75-a2b6d530247e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:57.062959 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619924a-4579-4da1-bc75-a2b6d530247e admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:57.063277 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619924a-4579-4da1-bc75-a2b6d530247e admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:57.063554 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619924a-4579-4da1-bc75-a2b6d530247e admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:57.064300 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e619924a-4579-4da1-bc75-a2b6d530247e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:57.065913 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e619924a-4579-4da1-bc75-a2b6d530247e admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:57.077762 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1133/2277] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:55:57.082164 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93253d87-9b11-4856-aece-30c39be9693f admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:55:57.093557 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93253d87-9b11-4856-aece-30c39be9693f admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:55:57.098924 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c0e10-dd9c-4da3-ac47-fb00703c899a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:55:57.099979 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c0e10-dd9c-4da3-ac47-fb00703c899a admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:55:57.100349 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c0e10-dd9c-4da3-ac47-fb00703c899a admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:55:57.100683 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c0e10-dd9c-4da3-ac47-fb00703c899a admin admin] PATH_INFO: `/v3/projects/0e5e67dae3264723a9d5fffbc85b909b/users/753d97a529664fe39f73e2c66aaacc68/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:55:57.102902 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c0e10-dd9c-4da3-ac47-fb00703c899a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e5e67dae3264723a9d5fffbc85b909b, user_id=753d97a529664fe39f73e2c66aaacc68, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:55:57.105928 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c0e10-dd9c-4da3-ac47-fb00703c899a admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:55:57.118209 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1145/2278] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:55:57 2022] PUT /identity/v3/projects/0e5e67dae3264723a9d5fffbc85b909b/users/753d97a529664fe39f73e2c66aaacc68/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:56:02.519301 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a8b14-040a-48d4-bcdd-2c03ea8d9343 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:02.519859 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a8b14-040a-48d4-bcdd-2c03ea8d9343 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:02.519959 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a8b14-040a-48d4-bcdd-2c03ea8d9343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:02.548253 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-fe7a8b14-040a-48d4-bcdd-2c03ea8d9343 None None] MFA Rules not processed for user `753d97a529664fe39f73e2c66aaacc68`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:56:02.549528 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-fe7a8b14-040a-48d4-bcdd-2c03ea8d9343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:56:02.625382 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1134/2279] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:56:02 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:56:02.639544 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c0e10-dd9c-4da3-ac47-fb00703c899a admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:56:02.641444 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-039c0e10-dd9c-4da3-ac47-fb00703c899a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:56:02.719535 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:56:02.752948 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c0e10-dd9c-4da3-ac47-fb00703c899a admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:56:02.760809 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e6640f-4f7f-4498-a44d-9f4aac68b2ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:56:02.761408 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6640f-4f7f-4498-a44d-9f4aac68b2ed service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:02.761695 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6640f-4f7f-4498-a44d-9f4aac68b2ed service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:02.762059 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6640f-4f7f-4498-a44d-9f4aac68b2ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:02.853034 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e6640f-4f7f-4498-a44d-9f4aac68b2ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:56:02.854771 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e6640f-4f7f-4498-a44d-9f4aac68b2ed service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:56:02.868881 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1146/2280] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:56:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:56:11.512688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52bdbc-c2e3-4b13-aad2-9ce0894968db None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:11.513140 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52bdbc-c2e3-4b13-aad2-9ce0894968db None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:11.513220 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52bdbc-c2e3-4b13-aad2-9ce0894968db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:11.544349 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-fc52bdbc-c2e3-4b13-aad2-9ce0894968db None None] MFA Rules not processed for user `4dfddd72dfa84ce39fe62112224b425d`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:56:11.545776 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-fc52bdbc-c2e3-4b13-aad2-9ce0894968db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:56:11.605318 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1135/2281] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jun 24 10:56:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:56:11.667913 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e6640f-4f7f-4498-a44d-9f4aac68b2ed service nova] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:56:11.672506 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-44e6640f-4f7f-4498-a44d-9f4aac68b2ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:56:11.748263 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e6640f-4f7f-4498-a44d-9f4aac68b2ed service nova] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:56:11.755062 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70bfc75-be03-42a1-8c9a-d0ce5897dd61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff592d9ebd4241019625828ddd41aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:56:11.755774 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bfc75-be03-42a1-8c9a-d0ce5897dd61 service swift] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:11.756059 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bfc75-be03-42a1-8c9a-d0ce5897dd61 service swift] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:11.756341 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bfc75-be03-42a1-8c9a-d0ce5897dd61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:11.765055 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70bfc75-be03-42a1-8c9a-d0ce5897dd61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:56:11.766925 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70bfc75-be03-42a1-8c9a-d0ce5897dd61 service swift] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:56:11.775489 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1147/2282] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jun 24 10:56:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 10:56:12.417427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8648f8-7c38-42df-a526-05d831f908b1 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:12.417722 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8648f8-7c38-42df-a526-05d831f908b1 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:12.418006 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8648f8-7c38-42df-a526-05d831f908b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:12.436504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-bd8648f8-7c38-42df-a526-05d831f908b1 None None] MFA Rules not processed for user `4dfddd72dfa84ce39fe62112224b425d`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:56:12.437741 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-bd8648f8-7c38-42df-a526-05d831f908b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:56:12.445529 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1136/2283] 10.222.0.16 () {58 vars in 967 bytes} [Fri Jun 24 10:56:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:56:12.458508 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70bfc75-be03-42a1-8c9a-d0ce5897dd61 service swift] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:56:12.470000 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70bfc75-be03-42a1-8c9a-d0ce5897dd61 service swift] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:56:12.475614 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9a4e9-3875-4c14-a8f4-38a985dc91b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff592d9ebd4241019625828ddd41aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:56:12.476305 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9a4e9-3875-4c14-a8f4-38a985dc91b2 service swift] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:12.476590 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9a4e9-3875-4c14-a8f4-38a985dc91b2 service swift] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:12.476869 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9a4e9-3875-4c14-a8f4-38a985dc91b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:12.485426 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b9a4e9-3875-4c14-a8f4-38a985dc91b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:56:12.487172 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b9a4e9-3875-4c14-a8f4-38a985dc91b2 service swift] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:56:12.495891 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1148/2284] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jun 24 10:56:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 10:56:12.707055 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f07002-8b3a-40d0-9866-4aa920a70465 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:12.707578 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f07002-8b3a-40d0-9866-4aa920a70465 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:12.707679 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f07002-8b3a-40d0-9866-4aa920a70465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:12.721777 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:56:12.727868 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-11f07002-8b3a-40d0-9866-4aa920a70465 None None] MFA Rules not processed for user `4dfddd72dfa84ce39fe62112224b425d`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:56:12.729198 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-11f07002-8b3a-40d0-9866-4aa920a70465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:56:12.737044 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1137/2285] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jun 24 10:56:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:56:12.749081 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9a4e9-3875-4c14-a8f4-38a985dc91b2 service swift] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:56:12.760776 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9a4e9-3875-4c14-a8f4-38a985dc91b2 service swift] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:56:12.767199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7f401-0252-478d-a07a-9a20d88cf121 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff592d9ebd4241019625828ddd41aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:56:12.767976 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7f401-0252-478d-a07a-9a20d88cf121 service swift] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:12.768243 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7f401-0252-478d-a07a-9a20d88cf121 service swift] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:12.768507 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7f401-0252-478d-a07a-9a20d88cf121 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:12.779092 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7f401-0252-478d-a07a-9a20d88cf121 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:56:12.780938 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7f401-0252-478d-a07a-9a20d88cf121 service swift] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:56:12.789664 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1149/2286] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jun 24 10:56:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 10:56:13.141860 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1645585-c3d5-45eb-900c-42374419d19c None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:13.142151 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1645585-c3d5-45eb-900c-42374419d19c None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:13.142426 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1645585-c3d5-45eb-900c-42374419d19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:13.161422 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-a1645585-c3d5-45eb-900c-42374419d19c None None] MFA Rules not processed for user `4dfddd72dfa84ce39fe62112224b425d`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:56:13.162628 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-a1645585-c3d5-45eb-900c-42374419d19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:56:13.174134 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1138/2287] 10.222.0.16 () {58 vars in 967 bytes} [Fri Jun 24 10:56:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:56:13.192424 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7f401-0252-478d-a07a-9a20d88cf121 service swift] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:56:13.210444 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7f401-0252-478d-a07a-9a20d88cf121 service swift] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:56:13.216169 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051628b-d163-42ee-a20a-1318c296e340 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff592d9ebd4241019625828ddd41aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:56:13.216951 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051628b-d163-42ee-a20a-1318c296e340 service swift] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:13.217243 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051628b-d163-42ee-a20a-1318c296e340 service swift] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:13.217537 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051628b-d163-42ee-a20a-1318c296e340 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:13.232045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051628b-d163-42ee-a20a-1318c296e340 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:56:13.234668 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051628b-d163-42ee-a20a-1318c296e340 service swift] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:56:13.256859 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1150/2288] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jun 24 10:56:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 10:56:15.490722 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1645585-c3d5-45eb-900c-42374419d19c None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:56:15.492389 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-a1645585-c3d5-45eb-900c-42374419d19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:56:15.570368 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1645585-c3d5-45eb-900c-42374419d19c None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:56:15.576070 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36daf95c-78eb-4d9f-b163-4c59f3ca147a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:56:15.576999 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36daf95c-78eb-4d9f-b163-4c59f3ca147a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:15.577289 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36daf95c-78eb-4d9f-b163-4c59f3ca147a admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:15.577614 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36daf95c-78eb-4d9f-b163-4c59f3ca147a admin admin] PATH_INFO: `/v3/users/ce2e58b6744d407a8bdab2634cd67a41` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:15.578990 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36daf95c-78eb-4d9f-b163-4c59f3ca147a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce2e58b6744d407a8bdab2634cd67a41)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:56:15.580976 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36daf95c-78eb-4d9f-b163-4c59f3ca147a admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:56:15.640467 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-36daf95c-78eb-4d9f-b163-4c59f3ca147a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce2e58b6744d407a8bdab2634cd67a41'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:56:15.647680 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-36daf95c-78eb-4d9f-b163-4c59f3ca147a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce2e58b6744d407a8bdab2634cd67a41'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:56:15.657804 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-36daf95c-78eb-4d9f-b163-4c59f3ca147a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce2e58b6744d407a8bdab2634cd67a41'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:56:15.659281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-36daf95c-78eb-4d9f-b163-4c59f3ca147a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce2e58b6744d407a8bdab2634cd67a41'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:56:15.674259 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-36daf95c-78eb-4d9f-b163-4c59f3ca147a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce2e58b6744d407a8bdab2634cd67a41'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:56:15.681511 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1139/2289] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:56:15 2022] DELETE /identity/v3/users/ce2e58b6744d407a8bdab2634cd67a41 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:56:15.687068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028dbcc-2fac-47a7-958d-1bfcea772770 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:15.687591 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028dbcc-2fac-47a7-958d-1bfcea772770 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:15.687681 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028dbcc-2fac-47a7-958d-1bfcea772770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:15.707089 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-3028dbcc-2fac-47a7-958d-1bfcea772770 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:56:15.708498 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-3028dbcc-2fac-47a7-958d-1bfcea772770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:56:15.744662 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:56:15.778887 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1151/2290] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:56:15.789189 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36daf95c-78eb-4d9f-b163-4c59f3ca147a admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:56:15.790794 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-36daf95c-78eb-4d9f-b163-4c59f3ca147a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:56:15.883975 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36daf95c-78eb-4d9f-b163-4c59f3ca147a admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:56:15.888837 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce68a6c-6e7a-45d3-85b3-52a83b4e3d16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:56:15.889954 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce68a6c-6e7a-45d3-85b3-52a83b4e3d16 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:15.890607 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce68a6c-6e7a-45d3-85b3-52a83b4e3d16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:15.890607 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce68a6c-6e7a-45d3-85b3-52a83b4e3d16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:15.901984 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce68a6c-6e7a-45d3-85b3-52a83b4e3d16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:56:15.903640 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce68a6c-6e7a-45d3-85b3-52a83b4e3d16 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:56:15.915971 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1140/2291] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:56:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:56:16.096887 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028dbcc-2fac-47a7-958d-1bfcea772770 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:56:16.098441 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-3028dbcc-2fac-47a7-958d-1bfcea772770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:56:16.135643 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028dbcc-2fac-47a7-958d-1bfcea772770 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:56:16.140875 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be150c12-9c29-4482-9950-a4ed200f3bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:56:16.141738 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be150c12-9c29-4482-9950-a4ed200f3bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:16.142024 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be150c12-9c29-4482-9950-a4ed200f3bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:16.142301 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be150c12-9c29-4482-9950-a4ed200f3bbf admin admin] PATH_INFO: `/v3/projects/9f209054846f4415b7e40dd2d1e5cdc0` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:16.143616 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be150c12-9c29-4482-9950-a4ed200f3bbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f209054846f4415b7e40dd2d1e5cdc0)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:56:16.145550 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be150c12-9c29-4482-9950-a4ed200f3bbf admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:56:16.195928 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-be150c12-9c29-4482-9950-a4ed200f3bbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f209054846f4415b7e40dd2d1e5cdc0', 'request_id': 'req-be150c12-9c29-4482-9950-a4ed200f3bbf'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:56:16.205558 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-be150c12-9c29-4482-9950-a4ed200f3bbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f209054846f4415b7e40dd2d1e5cdc0', 'request_id': 'req-be150c12-9c29-4482-9950-a4ed200f3bbf'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:56:16.212045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-be150c12-9c29-4482-9950-a4ed200f3bbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f209054846f4415b7e40dd2d1e5cdc0', 'request_id': 'req-be150c12-9c29-4482-9950-a4ed200f3bbf'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:56:16.224197 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-be150c12-9c29-4482-9950-a4ed200f3bbf admin admin] The token cache is being invalidate because project 9f209054846f4415b7e40dd2d1e5cdc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:56:16.224509 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-be150c12-9c29-4482-9950-a4ed200f3bbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:56:16.225390 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-be150c12-9c29-4482-9950-a4ed200f3bbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:56:16.227678 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1152/2292] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:56:16 2022] DELETE /identity/v3/projects/9f209054846f4415b7e40dd2d1e5cdc0 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:56:17.614989 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fbb57-71b2-434e-8e27-761586265013 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:17.615589 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fbb57-71b2-434e-8e27-761586265013 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:17.615589 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fbb57-71b2-434e-8e27-761586265013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:17.634270 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-f48fbb57-71b2-434e-8e27-761586265013 None None] MFA Rules not processed for user `5d6f6733e3604ee79f09f177f5e32012`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:56:17.635539 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-f48fbb57-71b2-434e-8e27-761586265013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:56:17.646975 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:56:17.697770 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1141/2293] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:56:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:56:18.086800 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be150c12-9c29-4482-9950-a4ed200f3bbf admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:56:18.088605 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-be150c12-9c29-4482-9950-a4ed200f3bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:56:18.169064 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be150c12-9c29-4482-9950-a4ed200f3bbf admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:56:18.175944 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a91f7-846b-47a7-b5c7-21317ee03d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:56:18.176733 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a91f7-846b-47a7-b5c7-21317ee03d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:18.177017 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a91f7-846b-47a7-b5c7-21317ee03d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:18.177290 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a91f7-846b-47a7-b5c7-21317ee03d7e admin admin] PATH_INFO: `/v3/users/452f11aeadbc4e14a75612a8d3200cb1` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:18.178530 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a91f7-846b-47a7-b5c7-21317ee03d7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=452f11aeadbc4e14a75612a8d3200cb1)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:56:18.180852 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a91f7-846b-47a7-b5c7-21317ee03d7e admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:56:18.234346 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-275a91f7-846b-47a7-b5c7-21317ee03d7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '452f11aeadbc4e14a75612a8d3200cb1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:56:18.259084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-275a91f7-846b-47a7-b5c7-21317ee03d7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '452f11aeadbc4e14a75612a8d3200cb1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:56:18.278038 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-275a91f7-846b-47a7-b5c7-21317ee03d7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '452f11aeadbc4e14a75612a8d3200cb1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:56:18.279561 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-275a91f7-846b-47a7-b5c7-21317ee03d7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '452f11aeadbc4e14a75612a8d3200cb1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:56:18.281239 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:56:18.303540 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-275a91f7-846b-47a7-b5c7-21317ee03d7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '452f11aeadbc4e14a75612a8d3200cb1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:56:18.311239 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1153/2294] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:56:18 2022] DELETE /identity/v3/users/452f11aeadbc4e14a75612a8d3200cb1 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:56:18.315761 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d1631-15fd-4393-b6d1-f0ce2caff234 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:18.316406 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d1631-15fd-4393-b6d1-f0ce2caff234 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:18.316406 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d1631-15fd-4393-b6d1-f0ce2caff234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:18.336008 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-b85d1631-15fd-4393-b6d1-f0ce2caff234 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:56:18.337702 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-b85d1631-15fd-4393-b6d1-f0ce2caff234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:56:18.432211 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1142/2295] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:56:18.441404 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a91f7-846b-47a7-b5c7-21317ee03d7e admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:56:18.444300 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-275a91f7-846b-47a7-b5c7-21317ee03d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:56:18.539231 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a91f7-846b-47a7-b5c7-21317ee03d7e admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:56:18.543078 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad828a6-8840-410a-af35-1b6c4e40538e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:56:18.543685 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad828a6-8840-410a-af35-1b6c4e40538e service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:18.544336 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad828a6-8840-410a-af35-1b6c4e40538e service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:18.544336 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad828a6-8840-410a-af35-1b6c4e40538e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:18.555361 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad828a6-8840-410a-af35-1b6c4e40538e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:56:18.556552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad828a6-8840-410a-af35-1b6c4e40538e service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:56:18.569741 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1154/2296] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:56:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:56:18.949599 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d1631-15fd-4393-b6d1-f0ce2caff234 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:56:18.953334 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-b85d1631-15fd-4393-b6d1-f0ce2caff234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:56:18.970565 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d1631-15fd-4393-b6d1-f0ce2caff234 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:56:18.984273 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d16217-d3e9-4749-a79d-329653cf8751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:56:18.985600 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d16217-d3e9-4749-a79d-329653cf8751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:18.985938 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d16217-d3e9-4749-a79d-329653cf8751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:18.986456 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d16217-d3e9-4749-a79d-329653cf8751 admin admin] PATH_INFO: `/v3/projects/e59ac361b1954e01b4a2233c0c784f5f` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:18.987919 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d16217-d3e9-4749-a79d-329653cf8751 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e59ac361b1954e01b4a2233c0c784f5f)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:56:18.990293 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d16217-d3e9-4749-a79d-329653cf8751 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:56:19.045992 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-e1d16217-d3e9-4749-a79d-329653cf8751 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e59ac361b1954e01b4a2233c0c784f5f', 'request_id': 'req-e1d16217-d3e9-4749-a79d-329653cf8751'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:56:19.055163 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-e1d16217-d3e9-4749-a79d-329653cf8751 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e59ac361b1954e01b4a2233c0c784f5f', 'request_id': 'req-e1d16217-d3e9-4749-a79d-329653cf8751'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:56:19.061678 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-e1d16217-d3e9-4749-a79d-329653cf8751 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e59ac361b1954e01b4a2233c0c784f5f', 'request_id': 'req-e1d16217-d3e9-4749-a79d-329653cf8751'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:56:19.073160 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-e1d16217-d3e9-4749-a79d-329653cf8751 admin admin] The token cache is being invalidate because project e59ac361b1954e01b4a2233c0c784f5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:56:19.073447 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-e1d16217-d3e9-4749-a79d-329653cf8751 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:56:19.074281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-e1d16217-d3e9-4749-a79d-329653cf8751 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:56:19.075894 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1143/2297] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:56:18 2022] DELETE /identity/v3/projects/e59ac361b1954e01b4a2233c0c784f5f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:56:19.081123 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8468e-5924-498a-b4e2-29f676344976 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:19.081495 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8468e-5924-498a-b4e2-29f676344976 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:19.081853 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8468e-5924-498a-b4e2-29f676344976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:19.100765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-5ae8468e-5924-498a-b4e2-29f676344976 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:56:19.101984 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5ae8468e-5924-498a-b4e2-29f676344976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:56:19.166326 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1155/2298] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:56:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:56:19.174247 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bb93a-f34e-496e-9d6c-a60b483c303d None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:19.174710 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bb93a-f34e-496e-9d6c-a60b483c303d None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:19.175478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bb93a-f34e-496e-9d6c-a60b483c303d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:19.193741 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-0e1bb93a-f34e-496e-9d6c-a60b483c303d None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:56:19.195030 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-0e1bb93a-f34e-496e-9d6c-a60b483c303d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:56:19.203270 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1144/2299] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:56:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:56:19.207511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8468e-5924-498a-b4e2-29f676344976 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:56:19.217369 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8468e-5924-498a-b4e2-29f676344976 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:56:19.222085 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1bbad-0a18-4a40-8fc9-a8abd76e8ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:56:19.222829 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1bbad-0a18-4a40-8fc9-a8abd76e8ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:19.223221 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1bbad-0a18-4a40-8fc9-a8abd76e8ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:19.223582 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1bbad-0a18-4a40-8fc9-a8abd76e8ec7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:19.224385 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1bbad-0a18-4a40-8fc9-a8abd76e8ec7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:56:19.224696 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1bbad-0a18-4a40-8fc9-a8abd76e8ec7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:56:19.226365 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1bbad-0a18-4a40-8fc9-a8abd76e8ec7 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:56:19.239915 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1156/2300] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:56:19.244309 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bb93a-f34e-496e-9d6c-a60b483c303d None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:56:19.256272 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bb93a-f34e-496e-9d6c-a60b483c303d None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:56:19.261644 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a656b4-43c4-4f2c-9e39-ca05513bbe87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:56:19.262797 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a656b4-43c4-4f2c-9e39-ca05513bbe87 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:19.263080 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a656b4-43c4-4f2c-9e39-ca05513bbe87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:19.263394 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a656b4-43c4-4f2c-9e39-ca05513bbe87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:19.264344 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a656b4-43c4-4f2c-9e39-ca05513bbe87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:56:19.266255 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a656b4-43c4-4f2c-9e39-ca05513bbe87 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:56:19.299030 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1145/2301] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:56:19 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:56:19.304110 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1bbad-0a18-4a40-8fc9-a8abd76e8ec7 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:56:19.315045 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1bbad-0a18-4a40-8fc9-a8abd76e8ec7 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:56:19.392760 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319eb5d-d111-4f2f-803a-041ebef5e239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:56:19.393877 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319eb5d-d111-4f2f-803a-041ebef5e239 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:19.394391 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319eb5d-d111-4f2f-803a-041ebef5e239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:19.395510 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319eb5d-d111-4f2f-803a-041ebef5e239 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:19.398578 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319eb5d-d111-4f2f-803a-041ebef5e239 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:56:19.400074 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319eb5d-d111-4f2f-803a-041ebef5e239 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:56:19.426975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:56:19.438178 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1157/2302] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:56:19 2022] POST /identity/v3/users => generated 286 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:56:19.439485 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a656b4-43c4-4f2c-9e39-ca05513bbe87 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:56:19.452735 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a656b4-43c4-4f2c-9e39-ca05513bbe87 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:56:19.458479 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec050c-5fd0-406d-bfd3-75d1428a0e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:56:19.459413 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec050c-5fd0-406d-bfd3-75d1428a0e5b admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:19.459900 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec050c-5fd0-406d-bfd3-75d1428a0e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:19.460574 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec050c-5fd0-406d-bfd3-75d1428a0e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:19.462096 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec050c-5fd0-406d-bfd3-75d1428a0e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:56:19.464503 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec050c-5fd0-406d-bfd3-75d1428a0e5b admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:56:19.479197 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1146/2303] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:56:19.482097 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319eb5d-d111-4f2f-803a-041ebef5e239 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:56:19.492849 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319eb5d-d111-4f2f-803a-041ebef5e239 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:56:19.499825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad9258-1331-4b34-ad14-6f2194e907aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:56:19.500055 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad9258-1331-4b34-ad14-6f2194e907aa admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:19.500329 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad9258-1331-4b34-ad14-6f2194e907aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:19.500620 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad9258-1331-4b34-ad14-6f2194e907aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:19.501637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad9258-1331-4b34-ad14-6f2194e907aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:56:19.503840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad9258-1331-4b34-ad14-6f2194e907aa admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:56:19.522872 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1158/2304] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:56:19.527540 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec050c-5fd0-406d-bfd3-75d1428a0e5b admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:56:19.534478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:56:19.540713 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec050c-5fd0-406d-bfd3-75d1428a0e5b admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:56:19.552214 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd537fce-697d-4241-949e-9b4dcb6c55ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:56:19.553406 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd537fce-697d-4241-949e-9b4dcb6c55ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:19.554225 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd537fce-697d-4241-949e-9b4dcb6c55ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:19.554738 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd537fce-697d-4241-949e-9b4dcb6c55ee admin admin] PATH_INFO: `/v3/projects/70593603f64e413eac13a25644cae2dc/users/df139a251b984b599e4534c4b2609ae1/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:19.571637 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd537fce-697d-4241-949e-9b4dcb6c55ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=70593603f64e413eac13a25644cae2dc, user_id=df139a251b984b599e4534c4b2609ae1, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:56:19.574470 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd537fce-697d-4241-949e-9b4dcb6c55ee admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:56:19.595117 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1147/2305] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:56:19 2022] PUT /identity/v3/projects/70593603f64e413eac13a25644cae2dc/users/df139a251b984b599e4534c4b2609ae1/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:56:19.607525 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18dc1a-a89e-41fb-85e7-0228fca11b76 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:19.607914 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18dc1a-a89e-41fb-85e7-0228fca11b76 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:19.608256 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18dc1a-a89e-41fb-85e7-0228fca11b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:19.639589 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-ec18dc1a-a89e-41fb-85e7-0228fca11b76 None None] MFA Rules not processed for user `df139a251b984b599e4534c4b2609ae1`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:56:19.640874 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-ec18dc1a-a89e-41fb-85e7-0228fca11b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:56:19.713572 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1159/2306] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:56:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:56:19.725953 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd537fce-697d-4241-949e-9b4dcb6c55ee admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:56:19.727905 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-dd537fce-697d-4241-949e-9b4dcb6c55ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:56:19.815129 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd537fce-697d-4241-949e-9b4dcb6c55ee admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:56:19.819411 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ca192-b293-4a3f-867b-e0199f244cac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:56:19.820079 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ca192-b293-4a3f-867b-e0199f244cac service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:19.820350 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ca192-b293-4a3f-867b-e0199f244cac service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:19.820646 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ca192-b293-4a3f-867b-e0199f244cac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:19.829915 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ca192-b293-4a3f-867b-e0199f244cac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:56:19.831426 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ca192-b293-4a3f-867b-e0199f244cac service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:56:19.840833 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1148/2307] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:56:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:56:19.877293 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18dc1a-a89e-41fb-85e7-0228fca11b76 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:56:19.944438 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18dc1a-a89e-41fb-85e7-0228fca11b76 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:56:19.949130 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab0346-c955-4443-bdce-5ebf0931e7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:56:19.950043 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab0346-c955-4443-bdce-5ebf0931e7df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:19.950319 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab0346-c955-4443-bdce-5ebf0931e7df admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:19.950591 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab0346-c955-4443-bdce-5ebf0931e7df admin admin] PATH_INFO: `/v3/users/df139a251b984b599e4534c4b2609ae1` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:19.951995 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab0346-c955-4443-bdce-5ebf0931e7df admin admin] RBAC: Authorizing `identity:delete_user(user_id=df139a251b984b599e4534c4b2609ae1)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:56:19.954106 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab0346-c955-4443-bdce-5ebf0931e7df admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:56:20.003984 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b0ab0346-c955-4443-bdce-5ebf0931e7df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df139a251b984b599e4534c4b2609ae1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:56:20.010833 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b0ab0346-c955-4443-bdce-5ebf0931e7df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df139a251b984b599e4534c4b2609ae1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:56:20.020848 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b0ab0346-c955-4443-bdce-5ebf0931e7df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df139a251b984b599e4534c4b2609ae1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:56:20.021586 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b0ab0346-c955-4443-bdce-5ebf0931e7df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df139a251b984b599e4534c4b2609ae1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:56:20.035766 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b0ab0346-c955-4443-bdce-5ebf0931e7df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df139a251b984b599e4534c4b2609ae1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:56:20.038589 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:56:20.043176 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1160/2308] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:56:19 2022] DELETE /identity/v3/users/df139a251b984b599e4534c4b2609ae1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:56:20.047826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c34d0-644a-414d-ba40-de0bf153aa62 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:20.048345 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c34d0-644a-414d-ba40-de0bf153aa62 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:20.048438 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c34d0-644a-414d-ba40-de0bf153aa62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:20.067298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-9f2c34d0-644a-414d-ba40-de0bf153aa62 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:56:20.068764 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-9f2c34d0-644a-414d-ba40-de0bf153aa62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:56:20.130655 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1149/2309] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:56:20.140162 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab0346-c955-4443-bdce-5ebf0931e7df admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:56:20.141648 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b0ab0346-c955-4443-bdce-5ebf0931e7df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:56:20.201873 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab0346-c955-4443-bdce-5ebf0931e7df admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:56:20.205538 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e283a-af61-4044-80cb-7d9973451dce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:56:20.206225 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e283a-af61-4044-80cb-7d9973451dce service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:20.206631 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e283a-af61-4044-80cb-7d9973451dce service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:20.206743 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e283a-af61-4044-80cb-7d9973451dce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:20.216451 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e283a-af61-4044-80cb-7d9973451dce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:56:20.217950 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e283a-af61-4044-80cb-7d9973451dce service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:56:20.228480 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1161/2310] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:56:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:56:20.508578 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c34d0-644a-414d-ba40-de0bf153aa62 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:56:20.511047 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-9f2c34d0-644a-414d-ba40-de0bf153aa62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:56:20.542331 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c34d0-644a-414d-ba40-de0bf153aa62 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:56:20.551979 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b085c-1307-4a2d-b3e6-aa26862c1725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:56:20.552883 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b085c-1307-4a2d-b3e6-aa26862c1725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:20.553132 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b085c-1307-4a2d-b3e6-aa26862c1725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:20.554041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b085c-1307-4a2d-b3e6-aa26862c1725 admin admin] PATH_INFO: `/v3/projects/70593603f64e413eac13a25644cae2dc` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:20.555472 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b085c-1307-4a2d-b3e6-aa26862c1725 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70593603f64e413eac13a25644cae2dc)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:56:20.557809 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b085c-1307-4a2d-b3e6-aa26862c1725 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:56:20.618506 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ff5b085c-1307-4a2d-b3e6-aa26862c1725 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70593603f64e413eac13a25644cae2dc', 'request_id': 'req-ff5b085c-1307-4a2d-b3e6-aa26862c1725'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:56:20.642484 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ff5b085c-1307-4a2d-b3e6-aa26862c1725 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70593603f64e413eac13a25644cae2dc', 'request_id': 'req-ff5b085c-1307-4a2d-b3e6-aa26862c1725'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:56:20.652568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:56:20.659134 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ff5b085c-1307-4a2d-b3e6-aa26862c1725 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70593603f64e413eac13a25644cae2dc', 'request_id': 'req-ff5b085c-1307-4a2d-b3e6-aa26862c1725'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:56:20.673135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ff5b085c-1307-4a2d-b3e6-aa26862c1725 admin admin] The token cache is being invalidate because project 70593603f64e413eac13a25644cae2dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:56:20.673561 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ff5b085c-1307-4a2d-b3e6-aa26862c1725 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:56:20.674264 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ff5b085c-1307-4a2d-b3e6-aa26862c1725 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:56:20.676263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1150/2311] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:56:20 2022] DELETE /identity/v3/projects/70593603f64e413eac13a25644cae2dc => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:56:20.925324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2aeefe-584d-40fa-84c1-92707af72320 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:20.925642 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2aeefe-584d-40fa-84c1-92707af72320 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:20.925928 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2aeefe-584d-40fa-84c1-92707af72320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:20.944107 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-be2aeefe-584d-40fa-84c1-92707af72320 None None] MFA Rules not processed for user `09d927f9878e487b9794113927ab336a`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:56:20.945468 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-be2aeefe-584d-40fa-84c1-92707af72320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:56:21.008141 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1162/2312] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:56:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:56:22.467926 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b085c-1307-4a2d-b3e6-aa26862c1725 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:56:22.469500 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-ff5b085c-1307-4a2d-b3e6-aa26862c1725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:56:22.565362 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b085c-1307-4a2d-b3e6-aa26862c1725 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:56:22.571021 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bbbea-199e-4a6c-a3f4-d85fbfcacd68 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b365d9dd635e4518a41181649c323062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:56:22.571746 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bbbea-199e-4a6c-a3f4-d85fbfcacd68 service placement] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:22.572027 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bbbea-199e-4a6c-a3f4-d85fbfcacd68 service placement] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:22.572301 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bbbea-199e-4a6c-a3f4-d85fbfcacd68 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:22.574297 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-996bbbea-199e-4a6c-a3f4-d85fbfcacd68 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:56:22.586853 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996bbbea-199e-4a6c-a3f4-d85fbfcacd68 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:56:22.588558 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996bbbea-199e-4a6c-a3f4-d85fbfcacd68 service placement] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:56:22.599750 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1151/2313] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:56:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:56:30.996474 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=52 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:56:31.288646 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92053877-cea0-495f-aee5-646e41a28d2a None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:31.288939 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92053877-cea0-495f-aee5-646e41a28d2a None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:31.289220 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92053877-cea0-495f-aee5-646e41a28d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:31.308461 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-92053877-cea0-495f-aee5-646e41a28d2a None None] MFA Rules not processed for user `0e97d164a02b49a79e4299be4debf774`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:56:31.309742 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-92053877-cea0-495f-aee5-646e41a28d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:56:31.376699 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1163/2314] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:56:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:56:32.595623 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=46,keystone:DELETE=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:56:41.368453 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=25 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:56:47.370415 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba14967-507d-477b-9c37-9ba235dc076f None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:47.370905 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba14967-507d-477b-9c37-9ba235dc076f None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:47.370999 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba14967-507d-477b-9c37-9ba235dc076f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:47.422897 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-dba14967-507d-477b-9c37-9ba235dc076f None None] MFA Rules not processed for user `4dfddd72dfa84ce39fe62112224b425d`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:56:47.424144 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-dba14967-507d-477b-9c37-9ba235dc076f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:56:47.494040 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1152/2315] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jun 24 10:56:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:56:47.506119 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92053877-cea0-495f-aee5-646e41a28d2a None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:56:47.507601 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-92053877-cea0-495f-aee5-646e41a28d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:56:47.605769 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92053877-cea0-495f-aee5-646e41a28d2a None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:56:47.612893 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fcb1f1-5563-4b51-ab57-42f846ced6bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff592d9ebd4241019625828ddd41aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:56:47.613564 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcb1f1-5563-4b51-ab57-42f846ced6bf service swift] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:47.613852 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcb1f1-5563-4b51-ab57-42f846ced6bf service swift] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:47.614134 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcb1f1-5563-4b51-ab57-42f846ced6bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:47.626541 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fcb1f1-5563-4b51-ab57-42f846ced6bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:56:47.628250 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fcb1f1-5563-4b51-ab57-42f846ced6bf service swift] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:56:47.639806 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1164/2316] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jun 24 10:56:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 10:56:55.555979 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba14967-507d-477b-9c37-9ba235dc076f None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:56:55.558016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-dba14967-507d-477b-9c37-9ba235dc076f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:56:55.621640 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba14967-507d-477b-9c37-9ba235dc076f None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:56:55.628498 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910c34e-b180-421d-9af8-88eb7fb156bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:56:55.629265 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910c34e-b180-421d-9af8-88eb7fb156bc service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:56:55.629607 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910c34e-b180-421d-9af8-88eb7fb156bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:56:55.629926 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910c34e-b180-421d-9af8-88eb7fb156bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:56:55.631836 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-8910c34e-b180-421d-9af8-88eb7fb156bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:56:55.716723 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910c34e-b180-421d-9af8-88eb7fb156bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:56:55.718321 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910c34e-b180-421d-9af8-88eb7fb156bc service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:56:55.735333 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1153/2317] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:56:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:56:57.636675 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=41 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:57:03.525311 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07b90e-e674-4029-8bbf-fbefa06c1626 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:03.525903 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07b90e-e674-4029-8bbf-fbefa06c1626 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:03.526012 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07b90e-e674-4029-8bbf-fbefa06c1626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:03.546863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-cc07b90e-e674-4029-8bbf-fbefa06c1626 None None] MFA Rules not processed for user `4dfddd72dfa84ce39fe62112224b425d`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:57:03.548184 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-cc07b90e-e674-4029-8bbf-fbefa06c1626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:57:03.557734 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1165/2318] 10.222.0.16 () {58 vars in 967 bytes} [Fri Jun 24 10:57:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:57:03.571142 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910c34e-b180-421d-9af8-88eb7fb156bc service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:57:03.589187 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910c34e-b180-421d-9af8-88eb7fb156bc service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:57:03.595753 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c28628-5aa7-41fb-bd04-df14390115a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff592d9ebd4241019625828ddd41aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:57:03.596406 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c28628-5aa7-41fb-bd04-df14390115a2 service swift] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:03.596686 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c28628-5aa7-41fb-bd04-df14390115a2 service swift] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:03.596959 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c28628-5aa7-41fb-bd04-df14390115a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:03.605910 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c28628-5aa7-41fb-bd04-df14390115a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:57:03.607541 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c28628-5aa7-41fb-bd04-df14390115a2 service swift] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:57:03.616126 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1154/2319] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jun 24 10:57:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 10:57:05.624800 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07b90e-e674-4029-8bbf-fbefa06c1626 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:57:05.625229 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-cc07b90e-e674-4029-8bbf-fbefa06c1626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:57:05.693887 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07b90e-e674-4029-8bbf-fbefa06c1626 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:57:05.698818 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf00f7-a7f5-4078-b2bd-4f8bc63486a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:57:05.699956 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf00f7-a7f5-4078-b2bd-4f8bc63486a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:05.700248 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf00f7-a7f5-4078-b2bd-4f8bc63486a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:05.700557 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf00f7-a7f5-4078-b2bd-4f8bc63486a5 admin admin] PATH_INFO: `/v3/users/5d6f6733e3604ee79f09f177f5e32012` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:05.702097 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf00f7-a7f5-4078-b2bd-4f8bc63486a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d6f6733e3604ee79f09f177f5e32012)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:57:05.704297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf00f7-a7f5-4078-b2bd-4f8bc63486a5 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:57:05.757523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-0bdf00f7-a7f5-4078-b2bd-4f8bc63486a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d6f6733e3604ee79f09f177f5e32012'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:57:05.765365 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-0bdf00f7-a7f5-4078-b2bd-4f8bc63486a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d6f6733e3604ee79f09f177f5e32012'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:57:05.777235 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-0bdf00f7-a7f5-4078-b2bd-4f8bc63486a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d6f6733e3604ee79f09f177f5e32012'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:57:05.778114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-0bdf00f7-a7f5-4078-b2bd-4f8bc63486a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d6f6733e3604ee79f09f177f5e32012'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:57:05.796006 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-0bdf00f7-a7f5-4078-b2bd-4f8bc63486a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d6f6733e3604ee79f09f177f5e32012'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:57:05.804824 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1166/2320] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:57:05 2022] DELETE /identity/v3/users/5d6f6733e3604ee79f09f177f5e32012 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:57:05.990219 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c28628-5aa7-41fb-bd04-df14390115a2 service swift] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:57:06.006563 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c28628-5aa7-41fb-bd04-df14390115a2 service swift] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:57:06.012264 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:57:06.067339 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb22044-8063-4e23-90e9-a09b0944f703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:57:06.068221 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb22044-8063-4e23-90e9-a09b0944f703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:06.068506 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb22044-8063-4e23-90e9-a09b0944f703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:06.068783 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb22044-8063-4e23-90e9-a09b0944f703 admin admin] PATH_INFO: `/v3/projects/6f318448901f482c9e445f9a6d3f20f2` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:06.069981 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb22044-8063-4e23-90e9-a09b0944f703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f318448901f482c9e445f9a6d3f20f2)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:57:06.071941 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb22044-8063-4e23-90e9-a09b0944f703 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:57:06.132416 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ceb22044-8063-4e23-90e9-a09b0944f703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f318448901f482c9e445f9a6d3f20f2', 'request_id': 'req-ceb22044-8063-4e23-90e9-a09b0944f703'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:57:06.142755 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ceb22044-8063-4e23-90e9-a09b0944f703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f318448901f482c9e445f9a6d3f20f2', 'request_id': 'req-ceb22044-8063-4e23-90e9-a09b0944f703'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:57:06.148806 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ceb22044-8063-4e23-90e9-a09b0944f703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f318448901f482c9e445f9a6d3f20f2', 'request_id': 'req-ceb22044-8063-4e23-90e9-a09b0944f703'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:57:06.160216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ceb22044-8063-4e23-90e9-a09b0944f703 admin admin] The token cache is being invalidate because project 6f318448901f482c9e445f9a6d3f20f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:57:06.160505 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ceb22044-8063-4e23-90e9-a09b0944f703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:57:06.161206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ceb22044-8063-4e23-90e9-a09b0944f703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:57:06.162930 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1155/2321] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:57:05 2022] DELETE /identity/v3/projects/6f318448901f482c9e445f9a6d3f20f2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:57:06.168354 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec171e7c-6e36-4c7a-a218-beda0f4a9468 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:06.168675 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec171e7c-6e36-4c7a-a218-beda0f4a9468 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:06.168986 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec171e7c-6e36-4c7a-a218-beda0f4a9468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:06.189895 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-ec171e7c-6e36-4c7a-a218-beda0f4a9468 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:57:06.191109 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-ec171e7c-6e36-4c7a-a218-beda0f4a9468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:57:06.257024 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1167/2322] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:57:06.264947 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae3063-77fa-4dc0-bfa9-1bc5fe10f9d1 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:06.265243 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae3063-77fa-4dc0-bfa9-1bc5fe10f9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:06.265558 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae3063-77fa-4dc0-bfa9-1bc5fe10f9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:06.285235 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-86ae3063-77fa-4dc0-bfa9-1bc5fe10f9d1 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:57:06.286422 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-86ae3063-77fa-4dc0-bfa9-1bc5fe10f9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:57:06.295651 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1156/2323] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:57:06.300104 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec171e7c-6e36-4c7a-a218-beda0f4a9468 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:57:06.311350 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec171e7c-6e36-4c7a-a218-beda0f4a9468 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:57:06.317073 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2db83-20a0-49a3-a1be-6934017ab60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:57:06.317729 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2db83-20a0-49a3-a1be-6934017ab60a admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:06.318007 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2db83-20a0-49a3-a1be-6934017ab60a admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:06.318287 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2db83-20a0-49a3-a1be-6934017ab60a admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:06.319022 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2db83-20a0-49a3-a1be-6934017ab60a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:57:06.319360 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2db83-20a0-49a3-a1be-6934017ab60a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:57:06.320956 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2db83-20a0-49a3-a1be-6934017ab60a admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:57:06.329957 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:57:06.333337 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1168/2324] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:57:06.338014 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae3063-77fa-4dc0-bfa9-1bc5fe10f9d1 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:57:06.348049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae3063-77fa-4dc0-bfa9-1bc5fe10f9d1 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:57:06.353019 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c122ae-6688-416a-a70b-64149967815e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:57:06.353694 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c122ae-6688-416a-a70b-64149967815e admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:06.353958 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c122ae-6688-416a-a70b-64149967815e admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:06.354233 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c122ae-6688-416a-a70b-64149967815e admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:06.355504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c122ae-6688-416a-a70b-64149967815e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:57:06.357601 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c122ae-6688-416a-a70b-64149967815e admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:57:06.386676 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1157/2325] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:57:06 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:57:06.391527 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2db83-20a0-49a3-a1be-6934017ab60a admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:57:06.403504 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2db83-20a0-49a3-a1be-6934017ab60a admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:57:06.460763 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d1595-1314-4fe7-aa77-290f49a6f213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:57:06.461425 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d1595-1314-4fe7-aa77-290f49a6f213 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:06.461712 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d1595-1314-4fe7-aa77-290f49a6f213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:06.461983 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d1595-1314-4fe7-aa77-290f49a6f213 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:06.462668 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d1595-1314-4fe7-aa77-290f49a6f213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:57:06.466221 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d1595-1314-4fe7-aa77-290f49a6f213 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:57:06.491663 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1169/2326] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:57:06 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:57:06.497375 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c122ae-6688-416a-a70b-64149967815e admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:57:06.507959 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c122ae-6688-416a-a70b-64149967815e admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:57:06.513519 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37070959-44d4-4fea-8fdc-bb0b77904e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:57:06.514183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37070959-44d4-4fea-8fdc-bb0b77904e3a admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:06.514478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37070959-44d4-4fea-8fdc-bb0b77904e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:06.514734 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37070959-44d4-4fea-8fdc-bb0b77904e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:06.515502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37070959-44d4-4fea-8fdc-bb0b77904e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:57:06.517098 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37070959-44d4-4fea-8fdc-bb0b77904e3a admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:57:06.528019 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1158/2327] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:57:06.532593 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d1595-1314-4fe7-aa77-290f49a6f213 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:57:06.547678 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d1595-1314-4fe7-aa77-290f49a6f213 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:57:06.556357 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5ccdb-9500-463b-bad0-1601cc264b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:57:06.557316 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5ccdb-9500-463b-bad0-1601cc264b80 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:06.557674 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5ccdb-9500-463b-bad0-1601cc264b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:06.558076 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5ccdb-9500-463b-bad0-1601cc264b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:06.558771 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5ccdb-9500-463b-bad0-1601cc264b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:57:06.560410 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5ccdb-9500-463b-bad0-1601cc264b80 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:57:06.571195 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1170/2328] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:57:06.575749 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37070959-44d4-4fea-8fdc-bb0b77904e3a admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:57:06.586179 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37070959-44d4-4fea-8fdc-bb0b77904e3a admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:57:06.591756 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8abd8-2ddd-41f1-8566-e84747c95498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:57:06.592637 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8abd8-2ddd-41f1-8566-e84747c95498 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:06.592918 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8abd8-2ddd-41f1-8566-e84747c95498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:06.593188 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8abd8-2ddd-41f1-8566-e84747c95498 admin admin] PATH_INFO: `/v3/projects/7c7d8651cb924d96bf70244a9d749255/users/fef879b061ed47038602391afd07111f/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:06.609907 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e8abd8-2ddd-41f1-8566-e84747c95498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c7d8651cb924d96bf70244a9d749255, user_id=fef879b061ed47038602391afd07111f, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:57:06.612657 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e8abd8-2ddd-41f1-8566-e84747c95498 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:57:06.629524 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1159/2329] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:57:06 2022] PUT /identity/v3/projects/7c7d8651cb924d96bf70244a9d749255/users/fef879b061ed47038602391afd07111f/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:57:06.641781 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fe8b2-bb76-464c-9f44-67043853a86d None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:06.642268 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fe8b2-bb76-464c-9f44-67043853a86d None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:06.642268 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fe8b2-bb76-464c-9f44-67043853a86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:06.674513 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-bf9fe8b2-bb76-464c-9f44-67043853a86d None None] MFA Rules not processed for user `fef879b061ed47038602391afd07111f`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:57:06.675749 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-bf9fe8b2-bb76-464c-9f44-67043853a86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:57:06.746551 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1171/2330] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:57:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:57:06.758258 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8abd8-2ddd-41f1-8566-e84747c95498 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:57:06.760388 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-27e8abd8-2ddd-41f1-8566-e84747c95498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:57:06.802687 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:57:06.822904 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8abd8-2ddd-41f1-8566-e84747c95498 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:57:06.827126 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3ad7d-192a-4110-8142-53ab1b5d845b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:57:06.827795 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3ad7d-192a-4110-8142-53ab1b5d845b service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:06.828074 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3ad7d-192a-4110-8142-53ab1b5d845b service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:06.828352 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3ad7d-192a-4110-8142-53ab1b5d845b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:06.836771 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3ad7d-192a-4110-8142-53ab1b5d845b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:57:06.838176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3ad7d-192a-4110-8142-53ab1b5d845b service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:57:06.847833 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1160/2331] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:57:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:57:09.575817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9fe8b2-bb76-464c-9f44-67043853a86d None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:57:09.640577 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9fe8b2-bb76-464c-9f44-67043853a86d None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:57:09.645677 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3464a3-005c-4e9a-b325-b98372518062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:57:09.646564 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3464a3-005c-4e9a-b325-b98372518062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:09.646850 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3464a3-005c-4e9a-b325-b98372518062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:09.647124 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3464a3-005c-4e9a-b325-b98372518062 admin admin] PATH_INFO: `/v3/users/fef879b061ed47038602391afd07111f` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:09.648417 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3464a3-005c-4e9a-b325-b98372518062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fef879b061ed47038602391afd07111f)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:57:09.650347 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3464a3-005c-4e9a-b325-b98372518062 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:57:09.663746 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:57:09.703120 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3b3464a3-005c-4e9a-b325-b98372518062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fef879b061ed47038602391afd07111f'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:57:09.710037 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3b3464a3-005c-4e9a-b325-b98372518062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fef879b061ed47038602391afd07111f'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:57:09.720492 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3b3464a3-005c-4e9a-b325-b98372518062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fef879b061ed47038602391afd07111f'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:57:09.721117 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3b3464a3-005c-4e9a-b325-b98372518062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fef879b061ed47038602391afd07111f'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:57:09.733353 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3b3464a3-005c-4e9a-b325-b98372518062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fef879b061ed47038602391afd07111f'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:57:09.739752 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1172/2332] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:57:09 2022] DELETE /identity/v3/users/fef879b061ed47038602391afd07111f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:57:09.744338 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406c451-97f7-4573-af9d-62d6575175ee None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:09.744763 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406c451-97f7-4573-af9d-62d6575175ee None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:09.744949 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406c451-97f7-4573-af9d-62d6575175ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:09.762803 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-c406c451-97f7-4573-af9d-62d6575175ee None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:57:09.764066 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-c406c451-97f7-4573-af9d-62d6575175ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:57:09.827266 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1161/2333] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:57:09.836878 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3464a3-005c-4e9a-b325-b98372518062 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:57:09.838242 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-3b3464a3-005c-4e9a-b325-b98372518062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:57:09.895673 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3464a3-005c-4e9a-b325-b98372518062 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:57:09.899593 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c70c96-fe68-4b55-9449-ba20dbe144b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:57:09.900243 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c70c96-fe68-4b55-9449-ba20dbe144b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:09.900523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c70c96-fe68-4b55-9449-ba20dbe144b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:09.900799 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c70c96-fe68-4b55-9449-ba20dbe144b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:09.914108 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c70c96-fe68-4b55-9449-ba20dbe144b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:57:09.915972 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c70c96-fe68-4b55-9449-ba20dbe144b0 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:57:09.929041 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1173/2334] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:57:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:57:10.235906 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406c451-97f7-4573-af9d-62d6575175ee None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:57:10.237394 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-c406c451-97f7-4573-af9d-62d6575175ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:57:10.249644 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406c451-97f7-4573-af9d-62d6575175ee None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:57:10.255368 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16495e-2bc9-4c88-9e8b-ac9389a114ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:57:10.256261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16495e-2bc9-4c88-9e8b-ac9389a114ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:10.256536 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16495e-2bc9-4c88-9e8b-ac9389a114ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:10.257152 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16495e-2bc9-4c88-9e8b-ac9389a114ac admin admin] PATH_INFO: `/v3/projects/7c7d8651cb924d96bf70244a9d749255` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:10.258091 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16495e-2bc9-4c88-9e8b-ac9389a114ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c7d8651cb924d96bf70244a9d749255)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:57:10.260051 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16495e-2bc9-4c88-9e8b-ac9389a114ac admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:57:10.315031 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-cf16495e-2bc9-4c88-9e8b-ac9389a114ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c7d8651cb924d96bf70244a9d749255', 'request_id': 'req-cf16495e-2bc9-4c88-9e8b-ac9389a114ac'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:57:10.326915 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-cf16495e-2bc9-4c88-9e8b-ac9389a114ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c7d8651cb924d96bf70244a9d749255', 'request_id': 'req-cf16495e-2bc9-4c88-9e8b-ac9389a114ac'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:57:10.332557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-cf16495e-2bc9-4c88-9e8b-ac9389a114ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c7d8651cb924d96bf70244a9d749255', 'request_id': 'req-cf16495e-2bc9-4c88-9e8b-ac9389a114ac'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:57:10.344223 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-cf16495e-2bc9-4c88-9e8b-ac9389a114ac admin admin] The token cache is being invalidate because project 7c7d8651cb924d96bf70244a9d749255 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:57:10.344574 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-cf16495e-2bc9-4c88-9e8b-ac9389a114ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:57:10.345251 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-cf16495e-2bc9-4c88-9e8b-ac9389a114ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:57:10.346830 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1162/2335] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:57:10 2022] DELETE /identity/v3/projects/7c7d8651cb924d96bf70244a9d749255 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:57:10.352913 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e3fb4-9acf-4195-9120-bddaebc06971 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:10.353364 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e3fb4-9acf-4195-9120-bddaebc06971 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:10.353757 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e3fb4-9acf-4195-9120-bddaebc06971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:10.378664 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-7d3e3fb4-9acf-4195-9120-bddaebc06971 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:57:10.379919 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-7d3e3fb4-9acf-4195-9120-bddaebc06971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:57:10.440410 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1174/2336] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:57:10.448343 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65573a-2f38-48d7-9754-87adcef66e82 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:10.448638 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65573a-2f38-48d7-9754-87adcef66e82 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:10.448915 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65573a-2f38-48d7-9754-87adcef66e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:10.468625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-6b65573a-2f38-48d7-9754-87adcef66e82 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:57:10.469866 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-6b65573a-2f38-48d7-9754-87adcef66e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:57:10.478547 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1163/2337] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:57:10.483232 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e3fb4-9acf-4195-9120-bddaebc06971 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:57:10.493517 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e3fb4-9acf-4195-9120-bddaebc06971 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:57:10.499115 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aab47f-5ebb-41f5-a9ec-a4e99ea4ee34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:57:10.499735 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aab47f-5ebb-41f5-a9ec-a4e99ea4ee34 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:10.500020 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aab47f-5ebb-41f5-a9ec-a4e99ea4ee34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:10.500319 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aab47f-5ebb-41f5-a9ec-a4e99ea4ee34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:10.501032 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aab47f-5ebb-41f5-a9ec-a4e99ea4ee34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:57:10.501343 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aab47f-5ebb-41f5-a9ec-a4e99ea4ee34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:57:10.502943 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aab47f-5ebb-41f5-a9ec-a4e99ea4ee34 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:57:10.515197 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1175/2338] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 10:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:57:10.519563 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65573a-2f38-48d7-9754-87adcef66e82 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:57:10.529162 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65573a-2f38-48d7-9754-87adcef66e82 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:57:10.534117 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e00b9c-dd68-49f6-9885-f1c9302c48d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:57:10.534769 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e00b9c-dd68-49f6-9885-f1c9302c48d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:10.535050 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e00b9c-dd68-49f6-9885-f1c9302c48d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:10.535357 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e00b9c-dd68-49f6-9885-f1c9302c48d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:10.536048 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e00b9c-dd68-49f6-9885-f1c9302c48d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:57:10.537935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e00b9c-dd68-49f6-9885-f1c9302c48d4 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:57:10.566584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1164/2339] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 10:57:10 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:57:10.570758 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aab47f-5ebb-41f5-a9ec-a4e99ea4ee34 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:57:10.581118 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aab47f-5ebb-41f5-a9ec-a4e99ea4ee34 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:57:10.595108 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:57:10.650817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0c422-f6a7-4265-863e-ffe78bbb261c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:57:10.651531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0c422-f6a7-4265-863e-ffe78bbb261c admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:10.651818 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0c422-f6a7-4265-863e-ffe78bbb261c admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:10.652113 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0c422-f6a7-4265-863e-ffe78bbb261c admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:10.652846 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee0c422-f6a7-4265-863e-ffe78bbb261c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:57:10.654834 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee0c422-f6a7-4265-863e-ffe78bbb261c admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:57:10.676874 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1176/2340] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 10:57:10 2022] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:57:10.681409 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e00b9c-dd68-49f6-9885-f1c9302c48d4 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:57:10.692183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e00b9c-dd68-49f6-9885-f1c9302c48d4 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:57:10.698189 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc77d77-da2f-4db3-b009-3b752f0ebde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:57:10.698957 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc77d77-da2f-4db3-b009-3b752f0ebde3 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:10.699308 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc77d77-da2f-4db3-b009-3b752f0ebde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:10.699582 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc77d77-da2f-4db3-b009-3b752f0ebde3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:10.700406 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc77d77-da2f-4db3-b009-3b752f0ebde3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:57:10.701995 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc77d77-da2f-4db3-b009-3b752f0ebde3 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:57:10.712770 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1165/2341] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:57:10.717090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0c422-f6a7-4265-863e-ffe78bbb261c admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:57:10.727328 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0c422-f6a7-4265-863e-ffe78bbb261c admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:57:10.733551 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d7de7-8a6e-4a97-92d8-e32dafe77369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:57:10.734200 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d7de7-8a6e-4a97-92d8-e32dafe77369 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:10.734483 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d7de7-8a6e-4a97-92d8-e32dafe77369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:10.734756 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d7de7-8a6e-4a97-92d8-e32dafe77369 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:10.735510 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d7de7-8a6e-4a97-92d8-e32dafe77369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:57:10.737080 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d7de7-8a6e-4a97-92d8-e32dafe77369 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:57:10.747847 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1177/2342] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 10:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:57:10.752087 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc77d77-da2f-4db3-b009-3b752f0ebde3 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:57:10.763430 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc77d77-da2f-4db3-b009-3b752f0ebde3 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:57:10.768494 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34adb2fc-4275-43d1-acee-c936167bc86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:57:10.769371 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adb2fc-4275-43d1-acee-c936167bc86f admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:10.769649 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adb2fc-4275-43d1-acee-c936167bc86f admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:10.769920 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adb2fc-4275-43d1-acee-c936167bc86f admin admin] PATH_INFO: `/v3/projects/63fc406a84f448a7a49a167ab8e62c5d/users/72527545dc064eb58434da566151f7e1/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:10.786136 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34adb2fc-4275-43d1-acee-c936167bc86f admin admin] RBAC: Authorizing `identity:create_grant(project_id=63fc406a84f448a7a49a167ab8e62c5d, user_id=72527545dc064eb58434da566151f7e1, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:57:10.788859 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34adb2fc-4275-43d1-acee-c936167bc86f admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:57:10.799222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:57:10.806268 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1166/2343] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 10:57:10 2022] PUT /identity/v3/projects/63fc406a84f448a7a49a167ab8e62c5d/users/72527545dc064eb58434da566151f7e1/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:57:10.817277 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ad57b-411f-456c-831e-0cba4224d5b7 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:10.817543 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ad57b-411f-456c-831e-0cba4224d5b7 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:10.817811 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ad57b-411f-456c-831e-0cba4224d5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:10.845678 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-be4ad57b-411f-456c-831e-0cba4224d5b7 None None] MFA Rules not processed for user `72527545dc064eb58434da566151f7e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:57:10.846884 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-be4ad57b-411f-456c-831e-0cba4224d5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:57:10.916176 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1178/2344] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:57:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:57:10.928562 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34adb2fc-4275-43d1-acee-c936167bc86f admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:57:10.930558 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-34adb2fc-4275-43d1-acee-c936167bc86f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:57:10.990359 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34adb2fc-4275-43d1-acee-c936167bc86f admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:57:10.994827 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704eeb99-0051-48ba-88ba-bde1023de4d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:57:10.995521 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704eeb99-0051-48ba-88ba-bde1023de4d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:10.995813 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704eeb99-0051-48ba-88ba-bde1023de4d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:10.996068 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704eeb99-0051-48ba-88ba-bde1023de4d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:11.004932 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704eeb99-0051-48ba-88ba-bde1023de4d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:57:11.006298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704eeb99-0051-48ba-88ba-bde1023de4d2 service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:57:11.015642 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1167/2345] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:57:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:57:20.913288 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=58,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:57:21.011480 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=27 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:57:34.524853 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ad57b-411f-456c-831e-0cba4224d5b7 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:57:34.604646 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ad57b-411f-456c-831e-0cba4224d5b7 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:57:34.610291 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa69489-4092-44f5-86aa-fd8e4afaa704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:57:34.611309 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa69489-4092-44f5-86aa-fd8e4afaa704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:34.612076 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa69489-4092-44f5-86aa-fd8e4afaa704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:34.612356 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa69489-4092-44f5-86aa-fd8e4afaa704 admin admin] PATH_INFO: `/v3/users/72527545dc064eb58434da566151f7e1` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:34.616471 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa69489-4092-44f5-86aa-fd8e4afaa704 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72527545dc064eb58434da566151f7e1)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:57:34.618399 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa69489-4092-44f5-86aa-fd8e4afaa704 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:57:34.672745 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-4fa69489-4092-44f5-86aa-fd8e4afaa704 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72527545dc064eb58434da566151f7e1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:57:34.680101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-4fa69489-4092-44f5-86aa-fd8e4afaa704 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72527545dc064eb58434da566151f7e1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:57:34.689361 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-4fa69489-4092-44f5-86aa-fd8e4afaa704 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72527545dc064eb58434da566151f7e1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:57:34.689928 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-4fa69489-4092-44f5-86aa-fd8e4afaa704 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72527545dc064eb58434da566151f7e1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:57:34.702425 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-4fa69489-4092-44f5-86aa-fd8e4afaa704 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72527545dc064eb58434da566151f7e1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:57:34.708699 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1179/2346] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 10:57:34 2022] DELETE /identity/v3/users/72527545dc064eb58434da566151f7e1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:57:34.713261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87cefd-df6f-4b18-8554-fb26bd8d7045 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:34.713757 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87cefd-df6f-4b18-8554-fb26bd8d7045 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:34.713865 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87cefd-df6f-4b18-8554-fb26bd8d7045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:34.731696 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-2c87cefd-df6f-4b18-8554-fb26bd8d7045 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:57:34.732909 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-2c87cefd-df6f-4b18-8554-fb26bd8d7045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:57:34.793075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1168/2347] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:57:34.803463 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa69489-4092-44f5-86aa-fd8e4afaa704 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:57:34.805096 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-4fa69489-4092-44f5-86aa-fd8e4afaa704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:57:34.869750 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa69489-4092-44f5-86aa-fd8e4afaa704 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:57:34.873627 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c5486-fb5c-470f-837b-8e688c83b05a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:57:34.874289 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c5486-fb5c-470f-837b-8e688c83b05a service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:34.874627 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c5486-fb5c-470f-837b-8e688c83b05a service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:34.874892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c5486-fb5c-470f-837b-8e688c83b05a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:34.884418 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c5486-fb5c-470f-837b-8e688c83b05a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:57:34.885848 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c5486-fb5c-470f-837b-8e688c83b05a service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:57:34.896125 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1180/2348] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:57:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:57:35.191359 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87cefd-df6f-4b18-8554-fb26bd8d7045 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:57:35.192913 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-2c87cefd-df6f-4b18-8554-fb26bd8d7045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:57:35.205491 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87cefd-df6f-4b18-8554-fb26bd8d7045 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:57:35.212346 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77ce1f-7502-4c99-b798-b79583e4d1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:57:35.213232 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77ce1f-7502-4c99-b798-b79583e4d1a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:35.213519 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77ce1f-7502-4c99-b798-b79583e4d1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:35.213937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77ce1f-7502-4c99-b798-b79583e4d1a1 admin admin] PATH_INFO: `/v3/projects/63fc406a84f448a7a49a167ab8e62c5d` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:35.215298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77ce1f-7502-4c99-b798-b79583e4d1a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63fc406a84f448a7a49a167ab8e62c5d)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:57:35.217523 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77ce1f-7502-4c99-b798-b79583e4d1a1 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:57:35.271222 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-8f77ce1f-7502-4c99-b798-b79583e4d1a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63fc406a84f448a7a49a167ab8e62c5d', 'request_id': 'req-8f77ce1f-7502-4c99-b798-b79583e4d1a1'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:57:35.279493 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-8f77ce1f-7502-4c99-b798-b79583e4d1a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63fc406a84f448a7a49a167ab8e62c5d', 'request_id': 'req-8f77ce1f-7502-4c99-b798-b79583e4d1a1'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:57:35.285215 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-8f77ce1f-7502-4c99-b798-b79583e4d1a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63fc406a84f448a7a49a167ab8e62c5d', 'request_id': 'req-8f77ce1f-7502-4c99-b798-b79583e4d1a1'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:57:35.296233 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-8f77ce1f-7502-4c99-b798-b79583e4d1a1 admin admin] The token cache is being invalidate because project 63fc406a84f448a7a49a167ab8e62c5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:57:35.296465 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-8f77ce1f-7502-4c99-b798-b79583e4d1a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:57:35.297097 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-8f77ce1f-7502-4c99-b798-b79583e4d1a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:57:35.298953 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1169/2349] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 10:57:35 2022] DELETE /identity/v3/projects/63fc406a84f448a7a49a167ab8e62c5d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:57:43.137083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a06920-3a6a-4634-9adf-e108d60b966a None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:43.137628 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a06920-3a6a-4634-9adf-e108d60b966a None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:43.137723 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a06920-3a6a-4634-9adf-e108d60b966a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:43.156038 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-48a06920-3a6a-4634-9adf-e108d60b966a None None] MFA Rules not processed for user `4dfddd72dfa84ce39fe62112224b425d`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:57:43.157424 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-48a06920-3a6a-4634-9adf-e108d60b966a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:57:43.174680 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:57:43.215136 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1181/2350] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jun 24 10:57:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:57:43.237958 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77ce1f-7502-4c99-b798-b79583e4d1a1 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:57:43.239593 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-8f77ce1f-7502-4c99-b798-b79583e4d1a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:57:43.313439 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77ce1f-7502-4c99-b798-b79583e4d1a1 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:57:43.319416 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e47953-a205-4650-8459-15d53be9ef58 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff592d9ebd4241019625828ddd41aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:57:43.320128 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e47953-a205-4650-8459-15d53be9ef58 service swift] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:43.320566 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e47953-a205-4650-8459-15d53be9ef58 service swift] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:43.321072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e47953-a205-4650-8459-15d53be9ef58 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:43.332174 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e47953-a205-4650-8459-15d53be9ef58 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:57:43.333698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e47953-a205-4650-8459-15d53be9ef58 service swift] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:57:43.342201 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1170/2351] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jun 24 10:57:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 10:57:53.207853 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=15 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:57:53.338968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:57:58.196350 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61590e77-75da-4083-a642-eefb016ca980 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:58.196931 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61590e77-75da-4083-a642-eefb016ca980 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:58.196931 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61590e77-75da-4083-a642-eefb016ca980 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:58.198635 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1182/2352] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jun 24 10:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:57:58.204464 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbcf85-ebed-45c4-9e11-1cbfa62e7398 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:58.204925 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbcf85-ebed-45c4-9e11-1cbfa62e7398 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:58.205250 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbcf85-ebed-45c4-9e11-1cbfa62e7398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:58.244502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-fdfbcf85-ebed-45c4-9e11-1cbfa62e7398 None None] MFA Rules not processed for user `e8034bad51144002a7386c975e412992`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:57:58.246541 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-fdfbcf85-ebed-45c4-9e11-1cbfa62e7398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:57:58.317822 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1171/2353] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jun 24 10:57:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:57:58.329755 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61590e77-75da-4083-a642-eefb016ca980 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:57:58.331625 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-61590e77-75da-4083-a642-eefb016ca980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:57:58.412547 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61590e77-75da-4083-a642-eefb016ca980 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:57:58.416667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c966586-4ea3-4a8d-a5b0-2b00bc465a88 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcba737e66244fe2b5b6ec3dd17dabd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:57:58.417362 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c966586-4ea3-4a8d-a5b0-2b00bc465a88 service glance] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:58.417646 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c966586-4ea3-4a8d-a5b0-2b00bc465a88 service glance] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:58.417921 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c966586-4ea3-4a8d-a5b0-2b00bc465a88 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:58.428735 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c966586-4ea3-4a8d-a5b0-2b00bc465a88 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:57:58.430162 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c966586-4ea3-4a8d-a5b0-2b00bc465a88 service glance] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:57:58.441046 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1183/2354] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:57:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:57:58.512886 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327fb87a-c7e2-44a0-b1ba-7119ef624356 None None] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:58.513180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327fb87a-c7e2-44a0-b1ba-7119ef624356 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:58.513480 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327fb87a-c7e2-44a0-b1ba-7119ef624356 None None] PATH_INFO: `/` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:58.514862 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1172/2355] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jun 24 10:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:57:58.520626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2830e0f-0036-4c5f-853c-2c0ad24cd7b5 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:58.520967 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2830e0f-0036-4c5f-853c-2c0ad24cd7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:58.521366 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2830e0f-0036-4c5f-853c-2c0ad24cd7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:58.548372 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-a2830e0f-0036-4c5f-853c-2c0ad24cd7b5 None None] MFA Rules not processed for user `9c20321abda7406c843b4ee691da2106`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:57:58.549575 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a2830e0f-0036-4c5f-853c-2c0ad24cd7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:57:58.605992 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1184/2356] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jun 24 10:57:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:57:58.618507 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327fb87a-c7e2-44a0-b1ba-7119ef624356 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:57:58.621104 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-327fb87a-c7e2-44a0-b1ba-7119ef624356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:57:58.635169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327fb87a-c7e2-44a0-b1ba-7119ef624356 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:57:58.639810 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d55658-a655-4fe3-8ec2-ba0e6b314f6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:57:58.640518 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d55658-a655-4fe3-8ec2-ba0e6b314f6a service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:58.640823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d55658-a655-4fe3-8ec2-ba0e6b314f6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:58.641084 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d55658-a655-4fe3-8ec2-ba0e6b314f6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:58.648871 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d55658-a655-4fe3-8ec2-ba0e6b314f6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:57:58.650401 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d55658-a655-4fe3-8ec2-ba0e6b314f6a service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:57:58.658817 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1173/2357] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:57:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:57:58.746894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf1327-1712-45c1-a8cf-8f244f62dd1d None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:58.747249 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf1327-1712-45c1-a8cf-8f244f62dd1d None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:58.747557 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf1327-1712-45c1-a8cf-8f244f62dd1d None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:58.749645 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1185/2358] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jun 24 10:57:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:57:58.755262 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98418b-fc17-403d-9309-3344a6746697 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:58.755562 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98418b-fc17-403d-9309-3344a6746697 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:58.755840 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98418b-fc17-403d-9309-3344a6746697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:58.777596 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-ef98418b-fc17-403d-9309-3344a6746697 None None] MFA Rules not processed for user `e8034bad51144002a7386c975e412992`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:57:58.778808 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-ef98418b-fc17-403d-9309-3344a6746697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:57:58.789992 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1174/2359] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jun 24 10:57:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:57:58.801323 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf1327-1712-45c1-a8cf-8f244f62dd1d None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:57:58.819612 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf1327-1712-45c1-a8cf-8f244f62dd1d None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:57:58.825231 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17648b89-f3c0-4167-a940-47c1eb53b8dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:57:58.825887 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17648b89-f3c0-4167-a940-47c1eb53b8dd service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:57:58.826171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17648b89-f3c0-4167-a940-47c1eb53b8dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:57:58.826449 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17648b89-f3c0-4167-a940-47c1eb53b8dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:57:58.838113 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17648b89-f3c0-4167-a940-47c1eb53b8dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:57:58.839662 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17648b89-f3c0-4167-a940-47c1eb53b8dd service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:57:58.851489 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1186/2360] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:57:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:58:01.184766 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2fca4-c11c-4ab5-abc3-f4c96ec7c144 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:58:01.185278 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2fca4-c11c-4ab5-abc3-f4c96ec7c144 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:58:01.185278 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2fca4-c11c-4ab5-abc3-f4c96ec7c144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:58:01.204027 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-7fa2fca4-c11c-4ab5-abc3-f4c96ec7c144 None None] MFA Rules not processed for user `4dfddd72dfa84ce39fe62112224b425d`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:58:01.205232 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-7fa2fca4-c11c-4ab5-abc3-f4c96ec7c144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:58:01.213038 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1175/2361] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jun 24 10:58:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:58:01.225300 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17648b89-f3c0-4167-a940-47c1eb53b8dd service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:58:01.239402 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17648b89-f3c0-4167-a940-47c1eb53b8dd service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:58:01.247391 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c907891-58b6-4cfb-9934-0800e249a268 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff592d9ebd4241019625828ddd41aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:58:01.248041 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c907891-58b6-4cfb-9934-0800e249a268 service swift] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:58:01.248324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c907891-58b6-4cfb-9934-0800e249a268 service swift] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:58:01.248622 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c907891-58b6-4cfb-9934-0800e249a268 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:58:01.257074 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c907891-58b6-4cfb-9934-0800e249a268 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:58:01.258692 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c907891-58b6-4cfb-9934-0800e249a268 service swift] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:58:01.268102 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1187/2362] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jun 24 10:58:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 10:58:11.198421 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=49 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:58:11.264168 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=70 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:58:13.679412 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2fca4-c11c-4ab5-abc3-f4c96ec7c144 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:58:13.689565 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2fca4-c11c-4ab5-abc3-f4c96ec7c144 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:58:13.693761 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45b22d-edba-4bdd-9f4b-f328d259c392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:58:13.694414 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45b22d-edba-4bdd-9f4b-f328d259c392 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:58:13.694680 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45b22d-edba-4bdd-9f4b-f328d259c392 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:58:13.695278 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45b22d-edba-4bdd-9f4b-f328d259c392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:58:13.697391 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-1a45b22d-edba-4bdd-9f4b-f328d259c392 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:58:13.710978 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45b22d-edba-4bdd-9f4b-f328d259c392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:58:13.712449 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45b22d-edba-4bdd-9f4b-f328d259c392 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:58:13.723412 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1176/2363] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:58:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:58:14.925775 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c907891-58b6-4cfb-9934-0800e249a268 service swift] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:58:14.937405 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c907891-58b6-4cfb-9934-0800e249a268 service swift] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:58:14.942228 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50c7db-5b04-417e-8842-f59e5eba4e4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:58:14.942871 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50c7db-5b04-417e-8842-f59e5eba4e4d service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:58:14.943173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50c7db-5b04-417e-8842-f59e5eba4e4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:58:14.943435 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50c7db-5b04-417e-8842-f59e5eba4e4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:58:14.945891 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-7f50c7db-5b04-417e-8842-f59e5eba4e4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:58:14.960515 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f50c7db-5b04-417e-8842-f59e5eba4e4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:58:14.961928 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f50c7db-5b04-417e-8842-f59e5eba4e4d service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:58:14.974051 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1188/2364] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:58:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:58:23.718785 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=6 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:58:24.432507 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45b22d-edba-4bdd-9f4b-f328d259c392 service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:58:24.434172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-1a45b22d-edba-4bdd-9f4b-f328d259c392 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:58:24.450895 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45b22d-edba-4bdd-9f4b-f328d259c392 service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:58:24.457469 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636200aa-f35a-4f95-ade9-df3f69c4e27d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:58:24.458090 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636200aa-f35a-4f95-ade9-df3f69c4e27d service nova] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:58:24.458399 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636200aa-f35a-4f95-ade9-df3f69c4e27d service nova] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:58:24.458670 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636200aa-f35a-4f95-ade9-df3f69c4e27d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:58:24.460545 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-636200aa-f35a-4f95-ade9-df3f69c4e27d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:58:24.522042 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636200aa-f35a-4f95-ade9-df3f69c4e27d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:58:24.523142 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636200aa-f35a-4f95-ade9-df3f69c4e27d service nova] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:58:24.533028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1177/2365] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:58:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:58:24.968046 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=6 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:58:28.812711 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50c7db-5b04-417e-8842-f59e5eba4e4d service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:58:28.815301 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-7f50c7db-5b04-417e-8842-f59e5eba4e4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:58:28.832514 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50c7db-5b04-417e-8842-f59e5eba4e4d service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:58:28.840003 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc48fd-e6b9-4095-89d4-c3a745f8b269 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:58:28.840651 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc48fd-e6b9-4095-89d4-c3a745f8b269 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:58:28.840917 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc48fd-e6b9-4095-89d4-c3a745f8b269 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:58:28.841207 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc48fd-e6b9-4095-89d4-c3a745f8b269 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:58:28.843239 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-0bcc48fd-e6b9-4095-89d4-c3a745f8b269 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:58:28.907224 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc48fd-e6b9-4095-89d4-c3a745f8b269 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:58:28.908838 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc48fd-e6b9-4095-89d4-c3a745f8b269 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:58:28.918859 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1189/2366] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:58:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:58:30.058905 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c296dde-0cb6-40b8-b04c-e13f42ab9697 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:58:30.059457 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c296dde-0cb6-40b8-b04c-e13f42ab9697 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:58:30.059564 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c296dde-0cb6-40b8-b04c-e13f42ab9697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:58:30.081377 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-3c296dde-0cb6-40b8-b04c-e13f42ab9697 None None] MFA Rules not processed for user `4dfddd72dfa84ce39fe62112224b425d`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:58:30.082613 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-3c296dde-0cb6-40b8-b04c-e13f42ab9697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:58:30.090689 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1178/2367] 10.222.0.16 () {58 vars in 967 bytes} [Fri Jun 24 10:58:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:58:30.103081 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc48fd-e6b9-4095-89d4-c3a745f8b269 service nova] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:58:30.115117 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc48fd-e6b9-4095-89d4-c3a745f8b269 service nova] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:58:30.120243 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda96d5-9fe0-4adc-897b-703d59947efe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff592d9ebd4241019625828ddd41aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:58:30.120907 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda96d5-9fe0-4adc-897b-703d59947efe service swift] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:58:30.121190 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda96d5-9fe0-4adc-897b-703d59947efe service swift] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:58:30.121469 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda96d5-9fe0-4adc-897b-703d59947efe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:58:30.129775 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda96d5-9fe0-4adc-897b-703d59947efe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:58:30.131405 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda96d5-9fe0-4adc-897b-703d59947efe service swift] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:58:30.139756 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1190/2368] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jun 24 10:58:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 10:58:37.460745 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c296dde-0cb6-40b8-b04c-e13f42ab9697 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:58:37.471025 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c296dde-0cb6-40b8-b04c-e13f42ab9697 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:58:37.475409 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa07f55a-c9bb-4255-81b9-140d67c21ab7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:58:37.476210 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07f55a-c9bb-4255-81b9-140d67c21ab7 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:58:37.476496 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07f55a-c9bb-4255-81b9-140d67c21ab7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:58:37.476773 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07f55a-c9bb-4255-81b9-140d67c21ab7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:58:37.478695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-aa07f55a-c9bb-4255-81b9-140d67c21ab7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:58:37.489828 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa07f55a-c9bb-4255-81b9-140d67c21ab7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:58:37.491351 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa07f55a-c9bb-4255-81b9-140d67c21ab7 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:58:37.500141 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1179/2369] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:58:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:58:40.136843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=34 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:58:47.496603 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=37 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:58:51.863473 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa2f0c-6c9d-44f8-83db-2bcfb41549ed None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:58:51.863971 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa2f0c-6c9d-44f8-83db-2bcfb41549ed None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:58:51.864084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa2f0c-6c9d-44f8-83db-2bcfb41549ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:58:51.882872 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-6caa2f0c-6c9d-44f8-83db-2bcfb41549ed None None] MFA Rules not processed for user `09d927f9878e487b9794113927ab336a`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:58:51.884128 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6caa2f0c-6c9d-44f8-83db-2bcfb41549ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:58:51.892412 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1191/2370] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:58:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:58:57.384279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa07f55a-c9bb-4255-81b9-140d67c21ab7 service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:58:57.398821 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa07f55a-c9bb-4255-81b9-140d67c21ab7 service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:58:57.410872 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4510341-08f5-44ea-b9a3-a748f8db901f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:58:57.410872 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4510341-08f5-44ea-b9a3-a748f8db901f service nova] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:58:57.410872 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4510341-08f5-44ea-b9a3-a748f8db901f service nova] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:58:57.410872 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4510341-08f5-44ea-b9a3-a748f8db901f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:58:57.412460 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-d4510341-08f5-44ea-b9a3-a748f8db901f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:58:57.426058 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4510341-08f5-44ea-b9a3-a748f8db901f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:58:57.428144 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4510341-08f5-44ea-b9a3-a748f8db901f service nova] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:58:57.438926 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1180/2371] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:58:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:59:01.877848 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:59:02.074257 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa2f0c-6c9d-44f8-83db-2bcfb41549ed None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:59:02.089275 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa2f0c-6c9d-44f8-83db-2bcfb41549ed None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:59:02.096781 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1050ee-056b-4108-85fb-82d47441d00c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:59:02.097437 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1050ee-056b-4108-85fb-82d47441d00c service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:59:02.097729 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1050ee-056b-4108-85fb-82d47441d00c service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:59:02.098012 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1050ee-056b-4108-85fb-82d47441d00c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:59:02.100715 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-dd1050ee-056b-4108-85fb-82d47441d00c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:59:02.163141 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1050ee-056b-4108-85fb-82d47441d00c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:59:02.164674 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1050ee-056b-4108-85fb-82d47441d00c service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:59:02.174777 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1192/2372] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:59:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:59:07.434597 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=6 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:59:12.170088 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=28 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:59:37.487986 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b7d59-4f14-4c9d-84de-4c687a2d5c30 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:59:37.488519 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b7d59-4f14-4c9d-84de-4c687a2d5c30 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:59:37.488622 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b7d59-4f14-4c9d-84de-4c687a2d5c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:59:37.507009 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-ce1b7d59-4f14-4c9d-84de-4c687a2d5c30 None None] MFA Rules not processed for user `25281e85b31b47d9889838ba5a65c328`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:59:37.508250 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-ce1b7d59-4f14-4c9d-84de-4c687a2d5c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:59:37.515343 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1181/2373] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:59:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:59:37.825121 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1050ee-056b-4108-85fb-82d47441d00c service nova] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:59:37.835973 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1050ee-056b-4108-85fb-82d47441d00c service nova] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:59:37.841506 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4f569-1e03-40e1-9691-edc00f4360f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:59:37.842552 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4f569-1e03-40e1-9691-edc00f4360f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:59:37.843594 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4f569-1e03-40e1-9691-edc00f4360f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:59:37.843879 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4f569-1e03-40e1-9691-edc00f4360f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:59:37.845844 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-8ec4f569-1e03-40e1-9691-edc00f4360f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:59:37.856235 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec4f569-1e03-40e1-9691-edc00f4360f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:59:37.857658 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec4f569-1e03-40e1-9691-edc00f4360f9 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:59:37.866344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1193/2374] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:59:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:59:38.199373 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b7d59-4f14-4c9d-84de-4c687a2d5c30 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:59:38.201153 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-ce1b7d59-4f14-4c9d-84de-4c687a2d5c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:59:38.280438 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b7d59-4f14-4c9d-84de-4c687a2d5c30 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:59:38.285456 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2cea37-0e30-4675-b175-d654a9522bac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b365d9dd635e4518a41181649c323062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:59:38.286129 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2cea37-0e30-4675-b175-d654a9522bac service placement] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:59:38.286412 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2cea37-0e30-4675-b175-d654a9522bac service placement] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:59:38.286690 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2cea37-0e30-4675-b175-d654a9522bac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:59:38.288531 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-9f2cea37-0e30-4675-b175-d654a9522bac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:59:38.300030 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2cea37-0e30-4675-b175-d654a9522bac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:59:38.301974 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2cea37-0e30-4675-b175-d654a9522bac service placement] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:59:38.311955 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1182/2375] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:59:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:59:44.427603 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c25db-fdfb-44bf-a00d-b504a6e515fc None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:59:44.428453 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c25db-fdfb-44bf-a00d-b504a6e515fc None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:59:44.428453 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c25db-fdfb-44bf-a00d-b504a6e515fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:59:44.446555 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-614c25db-fdfb-44bf-a00d-b504a6e515fc None None] MFA Rules not processed for user `0e97d164a02b49a79e4299be4debf774`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:59:44.447790 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-614c25db-fdfb-44bf-a00d-b504a6e515fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:59:44.512972 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1194/2376] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 10:59:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:59:44.836642 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2cea37-0e30-4675-b175-d654a9522bac service placement] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:59:44.846884 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2cea37-0e30-4675-b175-d654a9522bac service placement] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:59:44.850874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140f3dd-d509-4e08-965c-356165400f47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:59:44.851555 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140f3dd-d509-4e08-965c-356165400f47 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:59:44.851838 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140f3dd-d509-4e08-965c-356165400f47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:59:44.852115 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140f3dd-d509-4e08-965c-356165400f47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:59:44.854095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-2140f3dd-d509-4e08-965c-356165400f47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:59:44.864441 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2140f3dd-d509-4e08-965c-356165400f47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:59:44.865869 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2140f3dd-d509-4e08-965c-356165400f47 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:59:44.874006 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1183/2377] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:59:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:59:48.266888 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c25db-fdfb-44bf-a00d-b504a6e515fc None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:59:48.283284 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c25db-fdfb-44bf-a00d-b504a6e515fc None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:59:48.289194 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c226e-2dfb-40ec-be06-7fb3e2facfea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:59:48.289952 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c226e-2dfb-40ec-be06-7fb3e2facfea service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:59:48.290291 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c226e-2dfb-40ec-be06-7fb3e2facfea service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:59:48.290572 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c226e-2dfb-40ec-be06-7fb3e2facfea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:59:48.292400 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-602c226e-2dfb-40ec-be06-7fb3e2facfea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:59:48.306457 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c226e-2dfb-40ec-be06-7fb3e2facfea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:59:48.308304 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c226e-2dfb-40ec-be06-7fb3e2facfea service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:59:48.320929 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1195/2378] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:59:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:59:52.825561 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140f3dd-d509-4e08-965c-356165400f47 service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:59:52.839835 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140f3dd-d509-4e08-965c-356165400f47 service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:59:52.845724 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043aa57-e3ba-4a27-a07d-7ff602ba6b1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:59:52.846398 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043aa57-e3ba-4a27-a07d-7ff602ba6b1d service nova] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:59:52.847137 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043aa57-e3ba-4a27-a07d-7ff602ba6b1d service nova] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:59:52.847137 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043aa57-e3ba-4a27-a07d-7ff602ba6b1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:59:52.848827 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-4043aa57-e3ba-4a27-a07d-7ff602ba6b1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:59:52.863479 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043aa57-e3ba-4a27-a07d-7ff602ba6b1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:59:52.865268 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043aa57-e3ba-4a27-a07d-7ff602ba6b1d service nova] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:59:52.887342 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1184/2379] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 10:59:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:59:58.316393 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=37 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:00:02.872213 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=47 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:00:12.553632 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c226e-2dfb-40ec-be06-7fb3e2facfea service nova] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:12.564406 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c226e-2dfb-40ec-be06-7fb3e2facfea service nova] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:12.568985 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2bd35e-8da2-4225-9b33-ad363666718e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:12.569679 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bd35e-8da2-4225-9b33-ad363666718e service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:12.570355 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bd35e-8da2-4225-9b33-ad363666718e service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:12.570626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bd35e-8da2-4225-9b33-ad363666718e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:12.572813 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-8d2bd35e-8da2-4225-9b33-ad363666718e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:12.649641 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2bd35e-8da2-4225-9b33-ad363666718e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:12.651077 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2bd35e-8da2-4225-9b33-ad363666718e service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:12.661705 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1196/2380] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:00:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:00:15.917021 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043aa57-e3ba-4a27-a07d-7ff602ba6b1d service nova] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:15.931025 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043aa57-e3ba-4a27-a07d-7ff602ba6b1d service nova] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:15.936022 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2a19b-13f3-444e-89a8-bc8ad8d6d338 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b365d9dd635e4518a41181649c323062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:15.936683 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2a19b-13f3-444e-89a8-bc8ad8d6d338 service placement] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:15.936962 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2a19b-13f3-444e-89a8-bc8ad8d6d338 service placement] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:15.937231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2a19b-13f3-444e-89a8-bc8ad8d6d338 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:15.939011 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-e2a2a19b-13f3-444e-89a8-bc8ad8d6d338 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:15.951850 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2a19b-13f3-444e-89a8-bc8ad8d6d338 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:15.953446 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2a19b-13f3-444e-89a8-bc8ad8d6d338 service placement] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:15.963419 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1185/2381] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:00:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:00:16.012381 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2bd35e-8da2-4225-9b33-ad363666718e service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:16.013924 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-8d2bd35e-8da2-4225-9b33-ad363666718e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:16.026193 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2bd35e-8da2-4225-9b33-ad363666718e service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:16.031753 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de296b2c-aeef-47a6-afe7-6f7ec8205b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:16.032684 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de296b2c-aeef-47a6-afe7-6f7ec8205b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:16.032966 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de296b2c-aeef-47a6-afe7-6f7ec8205b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:16.033238 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de296b2c-aeef-47a6-afe7-6f7ec8205b42 admin admin] PATH_INFO: `/v3/users/09d927f9878e487b9794113927ab336a` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:16.034839 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de296b2c-aeef-47a6-afe7-6f7ec8205b42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09d927f9878e487b9794113927ab336a)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:16.036854 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de296b2c-aeef-47a6-afe7-6f7ec8205b42 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:16.092541 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-de296b2c-aeef-47a6-afe7-6f7ec8205b42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09d927f9878e487b9794113927ab336a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:16.099419 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-de296b2c-aeef-47a6-afe7-6f7ec8205b42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09d927f9878e487b9794113927ab336a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:16.108134 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-de296b2c-aeef-47a6-afe7-6f7ec8205b42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09d927f9878e487b9794113927ab336a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:16.108800 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-de296b2c-aeef-47a6-afe7-6f7ec8205b42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09d927f9878e487b9794113927ab336a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:16.120959 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-de296b2c-aeef-47a6-afe7-6f7ec8205b42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09d927f9878e487b9794113927ab336a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:16.127042 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1197/2382] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:00:16 2022] DELETE /identity/v3/users/09d927f9878e487b9794113927ab336a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:00:16.314078 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2a19b-13f3-444e-89a8-bc8ad8d6d338 service placement] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:16.326443 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2a19b-13f3-444e-89a8-bc8ad8d6d338 service placement] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:16.388301 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3239a1d-ca20-4531-8c57-d641cf1109cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:16.389184 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3239a1d-ca20-4531-8c57-d641cf1109cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:16.389461 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3239a1d-ca20-4531-8c57-d641cf1109cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:16.389733 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3239a1d-ca20-4531-8c57-d641cf1109cc admin admin] PATH_INFO: `/v3/projects/f397f419e5064e888cba221d1c356266` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:16.390959 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3239a1d-ca20-4531-8c57-d641cf1109cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f397f419e5064e888cba221d1c356266)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:16.392918 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3239a1d-ca20-4531-8c57-d641cf1109cc admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:16.445252 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-d3239a1d-ca20-4531-8c57-d641cf1109cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f397f419e5064e888cba221d1c356266', 'request_id': 'req-d3239a1d-ca20-4531-8c57-d641cf1109cc'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:16.454668 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-d3239a1d-ca20-4531-8c57-d641cf1109cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f397f419e5064e888cba221d1c356266', 'request_id': 'req-d3239a1d-ca20-4531-8c57-d641cf1109cc'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:16.461760 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-d3239a1d-ca20-4531-8c57-d641cf1109cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f397f419e5064e888cba221d1c356266', 'request_id': 'req-d3239a1d-ca20-4531-8c57-d641cf1109cc'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:16.473260 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-d3239a1d-ca20-4531-8c57-d641cf1109cc admin admin] The token cache is being invalidate because project f397f419e5064e888cba221d1c356266 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:00:16.473546 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-d3239a1d-ca20-4531-8c57-d641cf1109cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:16.474185 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-d3239a1d-ca20-4531-8c57-d641cf1109cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:16.475793 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1186/2383] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:00:16 2022] DELETE /identity/v3/projects/f397f419e5064e888cba221d1c356266 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:00:16.481154 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cbc5d-92cb-42f6-8500-a01fd4a5e465 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:16.481378 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cbc5d-92cb-42f6-8500-a01fd4a5e465 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:16.481653 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cbc5d-92cb-42f6-8500-a01fd4a5e465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:16.503475 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-970cbc5d-92cb-42f6-8500-a01fd4a5e465 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:00:16.504821 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-970cbc5d-92cb-42f6-8500-a01fd4a5e465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:16.569998 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1198/2384] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:00:16.579012 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46129570-1703-4bf5-8e8e-8f054afe6895 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:16.579507 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46129570-1703-4bf5-8e8e-8f054afe6895 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:16.579963 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46129570-1703-4bf5-8e8e-8f054afe6895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:16.606630 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-46129570-1703-4bf5-8e8e-8f054afe6895 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:00:16.607880 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-46129570-1703-4bf5-8e8e-8f054afe6895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:16.616307 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1187/2385] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 11:00:16.621316 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970cbc5d-92cb-42f6-8500-a01fd4a5e465 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:16.631918 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970cbc5d-92cb-42f6-8500-a01fd4a5e465 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:16.638600 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226a69a-dbf3-4e77-aa9c-ba6f44f2b513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:16.639295 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226a69a-dbf3-4e77-aa9c-ba6f44f2b513 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:16.639580 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226a69a-dbf3-4e77-aa9c-ba6f44f2b513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:16.639852 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226a69a-dbf3-4e77-aa9c-ba6f44f2b513 admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:16.640619 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226a69a-dbf3-4e77-aa9c-ba6f44f2b513 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 11:00:16.640912 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226a69a-dbf3-4e77-aa9c-ba6f44f2b513 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:16.642517 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226a69a-dbf3-4e77-aa9c-ba6f44f2b513 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:16.644083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:00:16.656830 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1199/2386] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 11:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 11:00:16.660503 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46129570-1703-4bf5-8e8e-8f054afe6895 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:16.670440 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46129570-1703-4bf5-8e8e-8f054afe6895 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:16.675700 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b399b1-d890-4437-9db3-82e4deae19a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:16.676359 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b399b1-d890-4437-9db3-82e4deae19a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:16.676640 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b399b1-d890-4437-9db3-82e4deae19a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:16.676908 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b399b1-d890-4437-9db3-82e4deae19a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:16.677593 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b399b1-d890-4437-9db3-82e4deae19a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:16.679556 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b399b1-d890-4437-9db3-82e4deae19a1 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:16.723318 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1188/2387] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:00:16 2022] POST /identity/v3/projects => generated 355 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:00:16.728868 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226a69a-dbf3-4e77-aa9c-ba6f44f2b513 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:16.741707 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226a69a-dbf3-4e77-aa9c-ba6f44f2b513 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:16.810741 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a642b-9f3a-4320-b778-d30ebd8acd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:16.811895 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a642b-9f3a-4320-b778-d30ebd8acd82 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:16.812218 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a642b-9f3a-4320-b778-d30ebd8acd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:16.812494 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a642b-9f3a-4320-b778-d30ebd8acd82 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:16.813200 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a642b-9f3a-4320-b778-d30ebd8acd82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:16.815194 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a642b-9f3a-4320-b778-d30ebd8acd82 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:16.835963 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1200/2388] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:00:16 2022] POST /identity/v3/users => generated 278 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:00:16.840745 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b399b1-d890-4437-9db3-82e4deae19a1 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:16.851893 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b399b1-d890-4437-9db3-82e4deae19a1 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:16.856856 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcccdb38-5359-4d3e-a341-000c0ff1597e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:16.857550 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccdb38-5359-4d3e-a341-000c0ff1597e admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:16.857836 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccdb38-5359-4d3e-a341-000c0ff1597e admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:16.858129 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccdb38-5359-4d3e-a341-000c0ff1597e admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:16.858845 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcccdb38-5359-4d3e-a341-000c0ff1597e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:16.860536 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcccdb38-5359-4d3e-a341-000c0ff1597e admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:16.871399 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1189/2389] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:00:16.875654 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a642b-9f3a-4320-b778-d30ebd8acd82 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:16.886479 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a642b-9f3a-4320-b778-d30ebd8acd82 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:16.892137 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3caab3-06c6-4768-ba42-01827e660969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:16.892820 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3caab3-06c6-4768-ba42-01827e660969 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:16.893100 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3caab3-06c6-4768-ba42-01827e660969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:16.893403 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3caab3-06c6-4768-ba42-01827e660969 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:16.894172 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3caab3-06c6-4768-ba42-01827e660969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:16.895903 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3caab3-06c6-4768-ba42-01827e660969 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:16.908755 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1201/2390] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:00:16.912816 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcccdb38-5359-4d3e-a341-000c0ff1597e admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:16.923537 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcccdb38-5359-4d3e-a341-000c0ff1597e admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:16.929192 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91da0a-c8f4-493d-bad6-17b0f2928a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:16.930212 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91da0a-c8f4-493d-bad6-17b0f2928a4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:16.930496 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91da0a-c8f4-493d-bad6-17b0f2928a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:16.930775 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91da0a-c8f4-493d-bad6-17b0f2928a4c admin admin] PATH_INFO: `/v3/projects/3fb586802a3a45db8e3a41b2088e609f/users/89ee2cbd1a8249e3b2bf0e4c13f6fc87/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:16.945941 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91da0a-c8f4-493d-bad6-17b0f2928a4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fb586802a3a45db8e3a41b2088e609f, user_id=89ee2cbd1a8249e3b2bf0e4c13f6fc87, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:16.948713 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91da0a-c8f4-493d-bad6-17b0f2928a4c admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:16.964672 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1190/2391] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:00:16 2022] PUT /identity/v3/projects/3fb586802a3a45db8e3a41b2088e609f/users/89ee2cbd1a8249e3b2bf0e4c13f6fc87/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:00:16.974972 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860d442-bb9c-4ad2-8d5e-1f46998fbfc3 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:16.975297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860d442-bb9c-4ad2-8d5e-1f46998fbfc3 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:16.975578 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860d442-bb9c-4ad2-8d5e-1f46998fbfc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:17.003990 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-2860d442-bb9c-4ad2-8d5e-1f46998fbfc3 None None] MFA Rules not processed for user `89ee2cbd1a8249e3b2bf0e4c13f6fc87`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:00:17.005144 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-2860d442-bb9c-4ad2-8d5e-1f46998fbfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:17.070899 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1202/2392] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:00:16 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:00:17.077625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91da0a-c8f4-493d-bad6-17b0f2928a4c admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:17.086649 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:00:17.148912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91da0a-c8f4-493d-bad6-17b0f2928a4c admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:17.154392 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695538a1-f93c-45b4-8e5c-9ee5547260df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:17.155073 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695538a1-f93c-45b4-8e5c-9ee5547260df admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:17.155490 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695538a1-f93c-45b4-8e5c-9ee5547260df admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:17.155786 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695538a1-f93c-45b4-8e5c-9ee5547260df admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:17.156501 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695538a1-f93c-45b4-8e5c-9ee5547260df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:17.158431 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695538a1-f93c-45b4-8e5c-9ee5547260df admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:17.194390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1191/2393] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:00:17 2022] POST /identity/v3/projects => generated 355 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:00:17.195615 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2860d442-bb9c-4ad2-8d5e-1f46998fbfc3 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:17.208929 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2860d442-bb9c-4ad2-8d5e-1f46998fbfc3 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:17.268266 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0fa5e-2d90-413c-b1e4-6887cd1896e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:17.268855 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0fa5e-2d90-413c-b1e4-6887cd1896e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:17.269120 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0fa5e-2d90-413c-b1e4-6887cd1896e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:17.269397 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0fa5e-2d90-413c-b1e4-6887cd1896e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:17.270090 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd0fa5e-2d90-413c-b1e4-6887cd1896e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:17.272212 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd0fa5e-2d90-413c-b1e4-6887cd1896e5 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:17.280507 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:00:17.295795 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1203/2394] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:00:17 2022] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:00:17.299959 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695538a1-f93c-45b4-8e5c-9ee5547260df admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:17.313956 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695538a1-f93c-45b4-8e5c-9ee5547260df admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:17.326279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35f518-4b98-49ce-9ea7-89e3cff8fcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:17.326989 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35f518-4b98-49ce-9ea7-89e3cff8fcf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:17.327318 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35f518-4b98-49ce-9ea7-89e3cff8fcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:17.327601 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35f518-4b98-49ce-9ea7-89e3cff8fcf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:17.328410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35f518-4b98-49ce-9ea7-89e3cff8fcf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:17.330062 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35f518-4b98-49ce-9ea7-89e3cff8fcf2 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:17.341883 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1192/2395] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:00:17.346264 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0fa5e-2d90-413c-b1e4-6887cd1896e5 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:17.357272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0fa5e-2d90-413c-b1e4-6887cd1896e5 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:17.362690 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e9363-1a97-41bd-934d-b9149d0eee35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:17.363701 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e9363-1a97-41bd-934d-b9149d0eee35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:17.363987 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e9363-1a97-41bd-934d-b9149d0eee35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:17.364261 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e9363-1a97-41bd-934d-b9149d0eee35 admin admin] PATH_INFO: `/v3/projects/c127b26707f54f0980bc4cb566946d30/users/b913df594be04c13bb8d3f1318d0e026/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:17.380531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e9363-1a97-41bd-934d-b9149d0eee35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c127b26707f54f0980bc4cb566946d30, user_id=b913df594be04c13bb8d3f1318d0e026, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:17.383367 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e9363-1a97-41bd-934d-b9149d0eee35 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:17.397344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1204/2396] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:00:17 2022] PUT /identity/v3/projects/c127b26707f54f0980bc4cb566946d30/users/b913df594be04c13bb8d3f1318d0e026/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 11:00:17.401887 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35f518-4b98-49ce-9ea7-89e3cff8fcf2 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:17.412493 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35f518-4b98-49ce-9ea7-89e3cff8fcf2 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:17.474772 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737955ca-29a1-453a-a938-ab1abb734371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:17.475578 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737955ca-29a1-453a-a938-ab1abb734371 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:17.475859 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737955ca-29a1-453a-a938-ab1abb734371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:17.476136 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737955ca-29a1-453a-a938-ab1abb734371 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:17.477005 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737955ca-29a1-453a-a938-ab1abb734371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:17.478663 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737955ca-29a1-453a-a938-ab1abb734371 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:17.490678 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1193/2397] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:00:17.495301 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e9363-1a97-41bd-934d-b9149d0eee35 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:17.506471 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e9363-1a97-41bd-934d-b9149d0eee35 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:17.511609 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd88ca-7577-4611-bcbb-4accc461d3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:17.512580 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd88ca-7577-4611-bcbb-4accc461d3cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:17.512788 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd88ca-7577-4611-bcbb-4accc461d3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:17.513068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd88ca-7577-4611-bcbb-4accc461d3cb admin admin] PATH_INFO: `/v3/projects/c127b26707f54f0980bc4cb566946d30/users/b913df594be04c13bb8d3f1318d0e026/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:17.515273 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd88ca-7577-4611-bcbb-4accc461d3cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c127b26707f54f0980bc4cb566946d30, user_id=b913df594be04c13bb8d3f1318d0e026, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:17.517942 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd88ca-7577-4611-bcbb-4accc461d3cb admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:17.529180 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1205/2398] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:00:17 2022] PUT /identity/v3/projects/c127b26707f54f0980bc4cb566946d30/users/b913df594be04c13bb8d3f1318d0e026/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:00:17.540623 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7c4b4-68c8-4c03-b6be-2ba77e629223 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:17.540906 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7c4b4-68c8-4c03-b6be-2ba77e629223 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:17.541181 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7c4b4-68c8-4c03-b6be-2ba77e629223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:17.569392 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-8ab7c4b4-68c8-4c03-b6be-2ba77e629223 None None] MFA Rules not processed for user `b913df594be04c13bb8d3f1318d0e026`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:00:17.570749 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-8ab7c4b4-68c8-4c03-b6be-2ba77e629223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:17.641501 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:00:17.645576 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1194/2399] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:00:17 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:00:17.659038 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd88ca-7577-4611-bcbb-4accc461d3cb admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:17.660903 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-f2cd88ca-7577-4611-bcbb-4accc461d3cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:17.720522 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd88ca-7577-4611-bcbb-4accc461d3cb admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:17.724463 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8cad0-3ec7-40d7-8948-a7cb76b232f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:17.725106 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8cad0-3ec7-40d7-8948-a7cb76b232f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:17.725393 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8cad0-3ec7-40d7-8948-a7cb76b232f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:17.725670 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8cad0-3ec7-40d7-8948-a7cb76b232f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:17.735670 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8cad0-3ec7-40d7-8948-a7cb76b232f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:17.737109 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8cad0-3ec7-40d7-8948-a7cb76b232f5 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:17.746847 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1206/2400] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:00:17 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:00:17.825813 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7c4b4-68c8-4c03-b6be-2ba77e629223 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:17.838653 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7c4b4-68c8-4c03-b6be-2ba77e629223 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:17.842919 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d5895-c793-4b77-b990-da0cb84b6094 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:17.843636 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d5895-c793-4b77-b990-da0cb84b6094 service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:17.843923 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d5895-c793-4b77-b990-da0cb84b6094 service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:17.844196 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d5895-c793-4b77-b990-da0cb84b6094 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:17.903467 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d5895-c793-4b77-b990-da0cb84b6094 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:17.905039 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d5895-c793-4b77-b990-da0cb84b6094 service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:17.914627 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1195/2401] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:00:17 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:00:21.506298 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1512600-d394-4708-883a-c4b2d0194d92 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:21.506816 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1512600-d394-4708-883a-c4b2d0194d92 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:21.506911 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1512600-d394-4708-883a-c4b2d0194d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:21.525260 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-b1512600-d394-4708-883a-c4b2d0194d92 None None] MFA Rules not processed for user `94d5d8610e67494dbebf53c4ed560504`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:00:21.526470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b1512600-d394-4708-883a-c4b2d0194d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:21.583464 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1207/2402] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:00:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:00:27.910276 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=28 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:00:31.576034 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:INSERT=4,keystone:SELECT=68 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:00:33.070614 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d5895-c793-4b77-b990-da0cb84b6094 service cinder] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:33.135858 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d5895-c793-4b77-b990-da0cb84b6094 service cinder] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:33.142815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380175ad-b02d-4606-ae70-fcbbe890d98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:33.143742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380175ad-b02d-4606-ae70-fcbbe890d98c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:33.144025 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380175ad-b02d-4606-ae70-fcbbe890d98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:33.144299 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380175ad-b02d-4606-ae70-fcbbe890d98c admin admin] PATH_INFO: `/v3/users/89ee2cbd1a8249e3b2bf0e4c13f6fc87` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:33.145512 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380175ad-b02d-4606-ae70-fcbbe890d98c admin admin] RBAC: Authorizing `identity:delete_user(user_id=89ee2cbd1a8249e3b2bf0e4c13f6fc87)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:33.147576 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380175ad-b02d-4606-ae70-fcbbe890d98c admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:33.199991 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-380175ad-b02d-4606-ae70-fcbbe890d98c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89ee2cbd1a8249e3b2bf0e4c13f6fc87'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:33.206959 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-380175ad-b02d-4606-ae70-fcbbe890d98c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89ee2cbd1a8249e3b2bf0e4c13f6fc87'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:33.215073 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-380175ad-b02d-4606-ae70-fcbbe890d98c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89ee2cbd1a8249e3b2bf0e4c13f6fc87'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:33.215770 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-380175ad-b02d-4606-ae70-fcbbe890d98c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89ee2cbd1a8249e3b2bf0e4c13f6fc87'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:33.229326 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-380175ad-b02d-4606-ae70-fcbbe890d98c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89ee2cbd1a8249e3b2bf0e4c13f6fc87'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:33.235345 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1196/2403] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:00:33 2022] DELETE /identity/v3/users/89ee2cbd1a8249e3b2bf0e4c13f6fc87 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:00:33.240073 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbeab2-87b3-4ee6-9824-19358462af79 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:33.240545 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbeab2-87b3-4ee6-9824-19358462af79 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:33.240643 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbeab2-87b3-4ee6-9824-19358462af79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:33.258457 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-a4cbeab2-87b3-4ee6-9824-19358462af79 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:00:33.259729 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a4cbeab2-87b3-4ee6-9824-19358462af79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:33.322163 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1208/2404] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:00:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 11:00:33.332053 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380175ad-b02d-4606-ae70-fcbbe890d98c admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:33.333504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-380175ad-b02d-4606-ae70-fcbbe890d98c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:33.395259 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380175ad-b02d-4606-ae70-fcbbe890d98c admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:33.399215 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760114bd-d465-4c50-aec8-d8bf98f2c031 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:33.399909 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760114bd-d465-4c50-aec8-d8bf98f2c031 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:33.400191 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760114bd-d465-4c50-aec8-d8bf98f2c031 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:33.400470 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760114bd-d465-4c50-aec8-d8bf98f2c031 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:33.410347 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760114bd-d465-4c50-aec8-d8bf98f2c031 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:33.411851 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760114bd-d465-4c50-aec8-d8bf98f2c031 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:33.421814 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1197/2405] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:00:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:00:33.708247 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbeab2-87b3-4ee6-9824-19358462af79 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:33.709787 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a4cbeab2-87b3-4ee6-9824-19358462af79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:33.724115 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbeab2-87b3-4ee6-9824-19358462af79 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:33.728936 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f407cb-2257-4411-8044-6d43e84167a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:33.730488 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f407cb-2257-4411-8044-6d43e84167a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:33.730815 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f407cb-2257-4411-8044-6d43e84167a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:33.731278 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f407cb-2257-4411-8044-6d43e84167a3 admin admin] PATH_INFO: `/v3/projects/3fb586802a3a45db8e3a41b2088e609f` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:33.732592 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f407cb-2257-4411-8044-6d43e84167a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fb586802a3a45db8e3a41b2088e609f)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:33.734589 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f407cb-2257-4411-8044-6d43e84167a3 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:33.783521 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d8f407cb-2257-4411-8044-6d43e84167a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fb586802a3a45db8e3a41b2088e609f', 'request_id': 'req-d8f407cb-2257-4411-8044-6d43e84167a3'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:33.793612 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d8f407cb-2257-4411-8044-6d43e84167a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fb586802a3a45db8e3a41b2088e609f', 'request_id': 'req-d8f407cb-2257-4411-8044-6d43e84167a3'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:33.800309 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d8f407cb-2257-4411-8044-6d43e84167a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fb586802a3a45db8e3a41b2088e609f', 'request_id': 'req-d8f407cb-2257-4411-8044-6d43e84167a3'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:33.812306 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d8f407cb-2257-4411-8044-6d43e84167a3 admin admin] The token cache is being invalidate because project 3fb586802a3a45db8e3a41b2088e609f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:00:33.812595 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d8f407cb-2257-4411-8044-6d43e84167a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:33.813309 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d8f407cb-2257-4411-8044-6d43e84167a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:33.814910 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1209/2406] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:00:33 2022] DELETE /identity/v3/projects/3fb586802a3a45db8e3a41b2088e609f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:00:33.818996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760114bd-d465-4c50-aec8-d8bf98f2c031 service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:33.829447 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760114bd-d465-4c50-aec8-d8bf98f2c031 service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:33.848125 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:00:33.889415 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f83d5-73f8-4009-84ef-fcbb77999e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:33.890317 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f83d5-73f8-4009-84ef-fcbb77999e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:33.890597 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f83d5-73f8-4009-84ef-fcbb77999e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:33.890878 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f83d5-73f8-4009-84ef-fcbb77999e7d admin admin] PATH_INFO: `/v3/users/b913df594be04c13bb8d3f1318d0e026` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:33.892099 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f83d5-73f8-4009-84ef-fcbb77999e7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b913df594be04c13bb8d3f1318d0e026)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:33.894068 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f83d5-73f8-4009-84ef-fcbb77999e7d admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:33.944018 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-f34f83d5-73f8-4009-84ef-fcbb77999e7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b913df594be04c13bb8d3f1318d0e026'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:33.950733 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-f34f83d5-73f8-4009-84ef-fcbb77999e7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b913df594be04c13bb8d3f1318d0e026'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:33.958372 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-f34f83d5-73f8-4009-84ef-fcbb77999e7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b913df594be04c13bb8d3f1318d0e026'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:33.959117 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-f34f83d5-73f8-4009-84ef-fcbb77999e7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b913df594be04c13bb8d3f1318d0e026'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:33.971697 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-f34f83d5-73f8-4009-84ef-fcbb77999e7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b913df594be04c13bb8d3f1318d0e026'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:33.977782 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1198/2407] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:00:33 2022] DELETE /identity/v3/users/b913df594be04c13bb8d3f1318d0e026 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:00:34.298156 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f407cb-2257-4411-8044-6d43e84167a3 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:34.299742 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-d8f407cb-2257-4411-8044-6d43e84167a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:34.316126 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f407cb-2257-4411-8044-6d43e84167a3 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:34.378875 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc544ec-004d-42a5-bb0e-d34eb8006230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:34.380847 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc544ec-004d-42a5-bb0e-d34eb8006230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:34.381219 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc544ec-004d-42a5-bb0e-d34eb8006230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:34.381633 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc544ec-004d-42a5-bb0e-d34eb8006230 admin admin] PATH_INFO: `/v3/projects/c127b26707f54f0980bc4cb566946d30` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:34.383505 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc544ec-004d-42a5-bb0e-d34eb8006230 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c127b26707f54f0980bc4cb566946d30)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:34.385587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc544ec-004d-42a5-bb0e-d34eb8006230 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:34.424566 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:00:34.446803 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-ecc544ec-004d-42a5-bb0e-d34eb8006230 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c127b26707f54f0980bc4cb566946d30', 'request_id': 'req-ecc544ec-004d-42a5-bb0e-d34eb8006230'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:34.457073 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-ecc544ec-004d-42a5-bb0e-d34eb8006230 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c127b26707f54f0980bc4cb566946d30', 'request_id': 'req-ecc544ec-004d-42a5-bb0e-d34eb8006230'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:34.465353 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-ecc544ec-004d-42a5-bb0e-d34eb8006230 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c127b26707f54f0980bc4cb566946d30', 'request_id': 'req-ecc544ec-004d-42a5-bb0e-d34eb8006230'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:34.478864 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-ecc544ec-004d-42a5-bb0e-d34eb8006230 admin admin] The token cache is being invalidate because project c127b26707f54f0980bc4cb566946d30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:00:34.479343 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-ecc544ec-004d-42a5-bb0e-d34eb8006230 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:34.480592 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-ecc544ec-004d-42a5-bb0e-d34eb8006230 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:34.482211 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1210/2408] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:00:34 2022] DELETE /identity/v3/projects/c127b26707f54f0980bc4cb566946d30 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:00:34.487372 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a7f5c-0d51-4b2f-a9c2-8b502e7b3922 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:34.487910 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a7f5c-0d51-4b2f-a9c2-8b502e7b3922 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:34.487997 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a7f5c-0d51-4b2f-a9c2-8b502e7b3922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:34.507812 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-de7a7f5c-0d51-4b2f-a9c2-8b502e7b3922 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:00:34.509349 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-de7a7f5c-0d51-4b2f-a9c2-8b502e7b3922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:34.591269 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1199/2409] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:00:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:00:34.598714 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e643e-f7b7-47a5-a8fd-b2d8bc51d0e2 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:34.599068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e643e-f7b7-47a5-a8fd-b2d8bc51d0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:34.599432 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e643e-f7b7-47a5-a8fd-b2d8bc51d0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:34.627344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-a83e643e-f7b7-47a5-a8fd-b2d8bc51d0e2 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:00:34.628631 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a83e643e-f7b7-47a5-a8fd-b2d8bc51d0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:34.639228 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1211/2410] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:00:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 11:00:34.641889 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a7f5c-0d51-4b2f-a9c2-8b502e7b3922 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:34.651979 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a7f5c-0d51-4b2f-a9c2-8b502e7b3922 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:34.659893 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f18f9-f029-45b9-8bf0-ef8586cfb20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:34.660595 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f18f9-f029-45b9-8bf0-ef8586cfb20f admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:34.660888 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f18f9-f029-45b9-8bf0-ef8586cfb20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:34.661170 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f18f9-f029-45b9-8bf0-ef8586cfb20f admin admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:34.661923 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f18f9-f029-45b9-8bf0-ef8586cfb20f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 11:00:34.662233 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f18f9-f029-45b9-8bf0-ef8586cfb20f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:34.664064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f18f9-f029-45b9-8bf0-ef8586cfb20f admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:34.677185 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1200/2411] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 11:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 11:00:34.681846 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e643e-f7b7-47a5-a8fd-b2d8bc51d0e2 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:34.691454 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e643e-f7b7-47a5-a8fd-b2d8bc51d0e2 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:34.702594 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5876bb4-f1d5-4e0b-8368-1239d573a2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:34.703358 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5876bb4-f1d5-4e0b-8368-1239d573a2ee admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:34.703616 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5876bb4-f1d5-4e0b-8368-1239d573a2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:34.704156 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5876bb4-f1d5-4e0b-8368-1239d573a2ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:34.705274 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5876bb4-f1d5-4e0b-8368-1239d573a2ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:34.706782 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5876bb4-f1d5-4e0b-8368-1239d573a2ee admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:34.739089 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1212/2412] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:00:34 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:00:34.743121 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f18f9-f029-45b9-8bf0-ef8586cfb20f admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:34.753499 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f18f9-f029-45b9-8bf0-ef8586cfb20f admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:34.779876 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:00:34.815468 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64e8f9-ac48-4d6a-9a14-310276a581f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:34.816158 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64e8f9-ac48-4d6a-9a14-310276a581f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:34.816444 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64e8f9-ac48-4d6a-9a14-310276a581f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:34.816834 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64e8f9-ac48-4d6a-9a14-310276a581f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:34.817549 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64e8f9-ac48-4d6a-9a14-310276a581f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:34.819559 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64e8f9-ac48-4d6a-9a14-310276a581f8 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:34.842147 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1201/2413] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:00:34 2022] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:00:34.846307 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5876bb4-f1d5-4e0b-8368-1239d573a2ee admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:34.857297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5876bb4-f1d5-4e0b-8368-1239d573a2ee admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:34.862272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c507fd6-67de-457b-8cab-a01297c43bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:34.862976 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c507fd6-67de-457b-8cab-a01297c43bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:34.863329 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c507fd6-67de-457b-8cab-a01297c43bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:34.863606 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c507fd6-67de-457b-8cab-a01297c43bf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:34.864341 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c507fd6-67de-457b-8cab-a01297c43bf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:34.866022 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c507fd6-67de-457b-8cab-a01297c43bf3 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:34.877638 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1213/2414] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:00:34.881877 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64e8f9-ac48-4d6a-9a14-310276a581f8 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:34.892553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64e8f9-ac48-4d6a-9a14-310276a581f8 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:34.897166 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fe883-d2cd-44ff-a2da-058bec1fbcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:34.897837 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fe883-d2cd-44ff-a2da-058bec1fbcfd admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:34.898119 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fe883-d2cd-44ff-a2da-058bec1fbcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:34.898397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fe883-d2cd-44ff-a2da-058bec1fbcfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:34.899121 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74fe883-d2cd-44ff-a2da-058bec1fbcfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:34.900804 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74fe883-d2cd-44ff-a2da-058bec1fbcfd admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:34.913162 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1202/2415] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:00:34.917701 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c507fd6-67de-457b-8cab-a01297c43bf3 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:34.928060 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c507fd6-67de-457b-8cab-a01297c43bf3 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:34.932951 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96572c-cbff-43fe-af59-55b30bdedf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:34.934024 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96572c-cbff-43fe-af59-55b30bdedf48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:34.934110 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96572c-cbff-43fe-af59-55b30bdedf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:34.934396 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96572c-cbff-43fe-af59-55b30bdedf48 admin admin] PATH_INFO: `/v3/projects/262309677fb941fbaf785b409d00cdb4/users/4af618b8f99647a08116aeef753035ec/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:34.952336 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96572c-cbff-43fe-af59-55b30bdedf48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=262309677fb941fbaf785b409d00cdb4, user_id=4af618b8f99647a08116aeef753035ec, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:34.955087 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96572c-cbff-43fe-af59-55b30bdedf48 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:34.972157 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1214/2416] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:00:34 2022] PUT /identity/v3/projects/262309677fb941fbaf785b409d00cdb4/users/4af618b8f99647a08116aeef753035ec/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:00:34.983585 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8e103-7fb9-4b0f-ba1a-e894ec0ef24f None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:34.983880 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8e103-7fb9-4b0f-ba1a-e894ec0ef24f None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:34.984155 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8e103-7fb9-4b0f-ba1a-e894ec0ef24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:35.013370 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-3ac8e103-7fb9-4b0f-ba1a-e894ec0ef24f None None] MFA Rules not processed for user `4af618b8f99647a08116aeef753035ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:00:35.014592 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-3ac8e103-7fb9-4b0f-ba1a-e894ec0ef24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:35.089470 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1203/2417] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:00:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:00:35.090260 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96572c-cbff-43fe-af59-55b30bdedf48 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:35.156903 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96572c-cbff-43fe-af59-55b30bdedf48 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:35.161697 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d8bde-b367-40f3-83ea-fa93fdc8dc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:35.162381 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d8bde-b367-40f3-83ea-fa93fdc8dc6b admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:35.162705 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d8bde-b367-40f3-83ea-fa93fdc8dc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:35.162989 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d8bde-b367-40f3-83ea-fa93fdc8dc6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:35.163809 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814d8bde-b367-40f3-83ea-fa93fdc8dc6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:35.165741 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814d8bde-b367-40f3-83ea-fa93fdc8dc6b admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:35.192737 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1215/2418] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:00:35 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 11:00:35.197079 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8e103-7fb9-4b0f-ba1a-e894ec0ef24f None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:35.213314 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8e103-7fb9-4b0f-ba1a-e894ec0ef24f None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:35.276079 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb44d0-48dd-4b99-92bb-d002ae3d4bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:35.278744 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb44d0-48dd-4b99-92bb-d002ae3d4bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:35.279206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb44d0-48dd-4b99-92bb-d002ae3d4bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:35.279489 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb44d0-48dd-4b99-92bb-d002ae3d4bd6 admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:35.280381 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb44d0-48dd-4b99-92bb-d002ae3d4bd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:35.282336 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb44d0-48dd-4b99-92bb-d002ae3d4bd6 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:35.307049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1204/2419] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:00:35 2022] POST /identity/v3/users => generated 290 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 11:00:35.311142 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d8bde-b367-40f3-83ea-fa93fdc8dc6b admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:35.322777 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d8bde-b367-40f3-83ea-fa93fdc8dc6b admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:35.328257 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e6cc3-831e-433e-a9f8-55f70449a236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:35.328968 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e6cc3-831e-433e-a9f8-55f70449a236 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:35.329249 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e6cc3-831e-433e-a9f8-55f70449a236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:35.329524 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e6cc3-831e-433e-a9f8-55f70449a236 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:35.330251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e6cc3-831e-433e-a9f8-55f70449a236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:35.331909 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e6cc3-831e-433e-a9f8-55f70449a236 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:35.343117 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1216/2420] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:00:35.347652 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb44d0-48dd-4b99-92bb-d002ae3d4bd6 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:35.358332 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb44d0-48dd-4b99-92bb-d002ae3d4bd6 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:35.363548 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34980d-8896-4153-a115-ff9dc9526654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:35.364449 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34980d-8896-4153-a115-ff9dc9526654 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:35.364737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34980d-8896-4153-a115-ff9dc9526654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:35.365016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34980d-8896-4153-a115-ff9dc9526654 admin admin] PATH_INFO: `/v3/projects/160b77db81a14a589086d543baf003cb/users/64a9cf9be06640d2ad0a073e83ac6880/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:35.381606 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34980d-8896-4153-a115-ff9dc9526654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=160b77db81a14a589086d543baf003cb, user_id=64a9cf9be06640d2ad0a073e83ac6880, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:35.384347 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34980d-8896-4153-a115-ff9dc9526654 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:35.399295 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1205/2421] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:00:35 2022] PUT /identity/v3/projects/160b77db81a14a589086d543baf003cb/users/64a9cf9be06640d2ad0a073e83ac6880/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:00:35.404036 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e6cc3-831e-433e-a9f8-55f70449a236 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:35.418630 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e6cc3-831e-433e-a9f8-55f70449a236 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:35.440399 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:00:35.485069 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cad7a3-d763-4516-aaa7-3e503d11e300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:35.485763 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cad7a3-d763-4516-aaa7-3e503d11e300 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:35.486043 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cad7a3-d763-4516-aaa7-3e503d11e300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:35.486435 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cad7a3-d763-4516-aaa7-3e503d11e300 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:35.487575 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cad7a3-d763-4516-aaa7-3e503d11e300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:35.489287 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cad7a3-d763-4516-aaa7-3e503d11e300 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:35.500393 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1217/2422] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:00:35.504828 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34980d-8896-4153-a115-ff9dc9526654 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:35.510788 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:00:35.519288 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34980d-8896-4153-a115-ff9dc9526654 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:35.526382 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b3eba-7911-4baa-8952-8ab8eba838ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:35.527695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b3eba-7911-4baa-8952-8ab8eba838ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:35.528095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b3eba-7911-4baa-8952-8ab8eba838ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:35.528488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b3eba-7911-4baa-8952-8ab8eba838ba admin admin] PATH_INFO: `/v3/projects/160b77db81a14a589086d543baf003cb/users/64a9cf9be06640d2ad0a073e83ac6880/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:35.531429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b3eba-7911-4baa-8952-8ab8eba838ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=160b77db81a14a589086d543baf003cb, user_id=64a9cf9be06640d2ad0a073e83ac6880, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:35.535220 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b3eba-7911-4baa-8952-8ab8eba838ba admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:35.547855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1206/2423] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:00:35 2022] PUT /identity/v3/projects/160b77db81a14a589086d543baf003cb/users/64a9cf9be06640d2ad0a073e83ac6880/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:00:35.558726 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5c398-06d0-41d7-b75d-01b98c57ab18 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:35.558998 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5c398-06d0-41d7-b75d-01b98c57ab18 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:35.559318 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5c398-06d0-41d7-b75d-01b98c57ab18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:35.590847 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-2ba5c398-06d0-41d7-b75d-01b98c57ab18 None None] MFA Rules not processed for user `64a9cf9be06640d2ad0a073e83ac6880`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:00:35.592497 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-2ba5c398-06d0-41d7-b75d-01b98c57ab18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:35.679515 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1218/2424] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:00:35 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:00:35.691759 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b3eba-7911-4baa-8952-8ab8eba838ba admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:35.693874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-030b3eba-7911-4baa-8952-8ab8eba838ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:35.755299 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b3eba-7911-4baa-8952-8ab8eba838ba admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:35.761020 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3d772-b174-43e4-a0a5-2fe5e5d9e2c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:35.761940 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3d772-b174-43e4-a0a5-2fe5e5d9e2c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:35.762347 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3d772-b174-43e4-a0a5-2fe5e5d9e2c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:35.762650 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3d772-b174-43e4-a0a5-2fe5e5d9e2c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:35.777454 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e3d772-b174-43e4-a0a5-2fe5e5d9e2c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:35.778890 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e3d772-b174-43e4-a0a5-2fe5e5d9e2c4 service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:35.788849 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1207/2425] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:00:35 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:00:35.833824 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5c398-06d0-41d7-b75d-01b98c57ab18 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:35.835500 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-2ba5c398-06d0-41d7-b75d-01b98c57ab18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:35.849077 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5c398-06d0-41d7-b75d-01b98c57ab18 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:35.853412 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b68dfb-0fce-484c-bdbf-e732961af4c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:35.854094 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b68dfb-0fce-484c-bdbf-e732961af4c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:35.854524 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b68dfb-0fce-484c-bdbf-e732961af4c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:35.854632 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b68dfb-0fce-484c-bdbf-e732961af4c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:35.915730 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b68dfb-0fce-484c-bdbf-e732961af4c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:35.917741 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b68dfb-0fce-484c-bdbf-e732961af4c6 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:35.927423 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1219/2426] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:00:35 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:00:39.302129 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3d772-b174-43e4-a0a5-2fe5e5d9e2c4 service cinder] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:39.371549 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3d772-b174-43e4-a0a5-2fe5e5d9e2c4 service cinder] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:39.376765 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e79297-c4bb-4b84-b6f0-9998b9cbf0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:39.377647 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e79297-c4bb-4b84-b6f0-9998b9cbf0b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:39.377938 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e79297-c4bb-4b84-b6f0-9998b9cbf0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:39.378193 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e79297-c4bb-4b84-b6f0-9998b9cbf0b0 admin admin] PATH_INFO: `/v3/users/4af618b8f99647a08116aeef753035ec` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:39.379448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e79297-c4bb-4b84-b6f0-9998b9cbf0b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4af618b8f99647a08116aeef753035ec)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:39.381381 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e79297-c4bb-4b84-b6f0-9998b9cbf0b0 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:39.432797 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-59e79297-c4bb-4b84-b6f0-9998b9cbf0b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4af618b8f99647a08116aeef753035ec'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:39.440158 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-59e79297-c4bb-4b84-b6f0-9998b9cbf0b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4af618b8f99647a08116aeef753035ec'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:39.448429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-59e79297-c4bb-4b84-b6f0-9998b9cbf0b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4af618b8f99647a08116aeef753035ec'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:39.449067 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-59e79297-c4bb-4b84-b6f0-9998b9cbf0b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4af618b8f99647a08116aeef753035ec'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:39.461157 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-59e79297-c4bb-4b84-b6f0-9998b9cbf0b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4af618b8f99647a08116aeef753035ec'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:39.467452 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1208/2427] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:00:39 2022] DELETE /identity/v3/users/4af618b8f99647a08116aeef753035ec => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:00:39.472037 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7aa63-b9a3-4b83-b369-e6de51e3c86b None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:39.472528 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7aa63-b9a3-4b83-b369-e6de51e3c86b None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:39.472643 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7aa63-b9a3-4b83-b369-e6de51e3c86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:39.496251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-0ff7aa63-b9a3-4b83-b369-e6de51e3c86b None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:00:39.497482 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-0ff7aa63-b9a3-4b83-b369-e6de51e3c86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:39.547128 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:00:39.573031 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1220/2428] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 11:00:39.585731 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e79297-c4bb-4b84-b6f0-9998b9cbf0b0 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:39.587284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-59e79297-c4bb-4b84-b6f0-9998b9cbf0b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:39.603908 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:00:39.653216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e79297-c4bb-4b84-b6f0-9998b9cbf0b0 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:39.657161 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91a53c-2b2e-4a00-8045-e3832319d79c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:39.657824 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91a53c-2b2e-4a00-8045-e3832319d79c service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:39.658123 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91a53c-2b2e-4a00-8045-e3832319d79c service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:39.658370 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91a53c-2b2e-4a00-8045-e3832319d79c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:39.668364 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91a53c-2b2e-4a00-8045-e3832319d79c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:39.669800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91a53c-2b2e-4a00-8045-e3832319d79c service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:39.680004 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1209/2429] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:00:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:00:39.978154 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7aa63-b9a3-4b83-b369-e6de51e3c86b None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:39.979989 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-0ff7aa63-b9a3-4b83-b369-e6de51e3c86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:39.996111 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7aa63-b9a3-4b83-b369-e6de51e3c86b None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:40.002330 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7a805-c5f1-4d40-85e9-9fde11f4ae56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:40.003340 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7a805-c5f1-4d40-85e9-9fde11f4ae56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:40.003687 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7a805-c5f1-4d40-85e9-9fde11f4ae56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:40.004102 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7a805-c5f1-4d40-85e9-9fde11f4ae56 admin admin] PATH_INFO: `/v3/projects/262309677fb941fbaf785b409d00cdb4` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:40.011975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d7a805-c5f1-4d40-85e9-9fde11f4ae56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=262309677fb941fbaf785b409d00cdb4)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:40.014758 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d7a805-c5f1-4d40-85e9-9fde11f4ae56 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:40.084169 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d6d7a805-c5f1-4d40-85e9-9fde11f4ae56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '262309677fb941fbaf785b409d00cdb4', 'request_id': 'req-d6d7a805-c5f1-4d40-85e9-9fde11f4ae56'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:40.103007 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d6d7a805-c5f1-4d40-85e9-9fde11f4ae56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '262309677fb941fbaf785b409d00cdb4', 'request_id': 'req-d6d7a805-c5f1-4d40-85e9-9fde11f4ae56'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:40.111380 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d6d7a805-c5f1-4d40-85e9-9fde11f4ae56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '262309677fb941fbaf785b409d00cdb4', 'request_id': 'req-d6d7a805-c5f1-4d40-85e9-9fde11f4ae56'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:40.124233 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d6d7a805-c5f1-4d40-85e9-9fde11f4ae56 admin admin] The token cache is being invalidate because project 262309677fb941fbaf785b409d00cdb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:00:40.124525 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d6d7a805-c5f1-4d40-85e9-9fde11f4ae56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:40.125257 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d6d7a805-c5f1-4d40-85e9-9fde11f4ae56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:40.126921 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1221/2430] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:00:39 2022] DELETE /identity/v3/projects/262309677fb941fbaf785b409d00cdb4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:00:40.131331 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91a53c-2b2e-4a00-8045-e3832319d79c service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:40.141678 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91a53c-2b2e-4a00-8045-e3832319d79c service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:40.209179 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4521e8-1390-4972-bd15-857f88fb30f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:40.210206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4521e8-1390-4972-bd15-857f88fb30f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:40.210727 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4521e8-1390-4972-bd15-857f88fb30f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:40.211080 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4521e8-1390-4972-bd15-857f88fb30f5 admin admin] PATH_INFO: `/v3/users/64a9cf9be06640d2ad0a073e83ac6880` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:40.213027 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4521e8-1390-4972-bd15-857f88fb30f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64a9cf9be06640d2ad0a073e83ac6880)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:40.215825 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4521e8-1390-4972-bd15-857f88fb30f5 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:40.275613 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-fd4521e8-1390-4972-bd15-857f88fb30f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64a9cf9be06640d2ad0a073e83ac6880'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:40.283780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-fd4521e8-1390-4972-bd15-857f88fb30f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64a9cf9be06640d2ad0a073e83ac6880'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:40.293310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-fd4521e8-1390-4972-bd15-857f88fb30f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64a9cf9be06640d2ad0a073e83ac6880'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:40.293958 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-fd4521e8-1390-4972-bd15-857f88fb30f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64a9cf9be06640d2ad0a073e83ac6880'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:40.311115 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-fd4521e8-1390-4972-bd15-857f88fb30f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64a9cf9be06640d2ad0a073e83ac6880'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:40.318716 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1210/2431] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:00:40 2022] DELETE /identity/v3/users/64a9cf9be06640d2ad0a073e83ac6880 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:00:40.615082 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7a805-c5f1-4d40-85e9-9fde11f4ae56 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:40.616810 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-d6d7a805-c5f1-4d40-85e9-9fde11f4ae56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:40.632781 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7a805-c5f1-4d40-85e9-9fde11f4ae56 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:40.696147 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7993da-955c-4d05-8e5f-fac0c57371b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:40.697029 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7993da-955c-4d05-8e5f-fac0c57371b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:40.697316 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7993da-955c-4d05-8e5f-fac0c57371b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:40.697584 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7993da-955c-4d05-8e5f-fac0c57371b4 admin admin] PATH_INFO: `/v3/projects/160b77db81a14a589086d543baf003cb` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:40.699002 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7993da-955c-4d05-8e5f-fac0c57371b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=160b77db81a14a589086d543baf003cb)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:40.700946 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7993da-955c-4d05-8e5f-fac0c57371b4 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:40.766386 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-4f7993da-955c-4d05-8e5f-fac0c57371b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '160b77db81a14a589086d543baf003cb', 'request_id': 'req-4f7993da-955c-4d05-8e5f-fac0c57371b4'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:40.777504 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-4f7993da-955c-4d05-8e5f-fac0c57371b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '160b77db81a14a589086d543baf003cb', 'request_id': 'req-4f7993da-955c-4d05-8e5f-fac0c57371b4'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:40.785877 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-4f7993da-955c-4d05-8e5f-fac0c57371b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '160b77db81a14a589086d543baf003cb', 'request_id': 'req-4f7993da-955c-4d05-8e5f-fac0c57371b4'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:40.795078 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:00:40.801527 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-4f7993da-955c-4d05-8e5f-fac0c57371b4 admin admin] The token cache is being invalidate because project 160b77db81a14a589086d543baf003cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:00:40.801873 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-4f7993da-955c-4d05-8e5f-fac0c57371b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:40.802880 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-4f7993da-955c-4d05-8e5f-fac0c57371b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:40.805218 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1222/2432] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:00:40 2022] DELETE /identity/v3/projects/160b77db81a14a589086d543baf003cb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:00:40.813184 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ab4a0-370d-4aac-8e2a-a440927345f8 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:40.813538 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ab4a0-370d-4aac-8e2a-a440927345f8 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:40.813936 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ab4a0-370d-4aac-8e2a-a440927345f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:40.836345 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-959ab4a0-370d-4aac-8e2a-a440927345f8 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:00:40.838334 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-959ab4a0-370d-4aac-8e2a-a440927345f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:40.877318 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:00:40.911491 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1211/2433] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:00:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 11:00:40.920271 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbeb7c-1cdd-4e39-8d11-bd0b33138dbb None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:40.920646 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbeb7c-1cdd-4e39-8d11-bd0b33138dbb None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:40.921100 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbeb7c-1cdd-4e39-8d11-bd0b33138dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:40.947399 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-befbeb7c-1cdd-4e39-8d11-bd0b33138dbb None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:00:40.948699 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-befbeb7c-1cdd-4e39-8d11-bd0b33138dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:40.957295 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1223/2434] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:00:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:00:40.962308 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ab4a0-370d-4aac-8e2a-a440927345f8 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:40.976943 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ab4a0-370d-4aac-8e2a-a440927345f8 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:40.983087 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e07bf-7b4b-4f6a-9635-da276d8bdfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:40.983796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e07bf-7b4b-4f6a-9635-da276d8bdfd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:40.984111 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e07bf-7b4b-4f6a-9635-da276d8bdfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:40.984487 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e07bf-7b4b-4f6a-9635-da276d8bdfd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:40.985669 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e07bf-7b4b-4f6a-9635-da276d8bdfd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 11:00:40.986120 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e07bf-7b4b-4f6a-9635-da276d8bdfd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:40.988165 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e07bf-7b4b-4f6a-9635-da276d8bdfd5 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:41.008426 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1212/2435] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 11:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 11:00:41.016159 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbeb7c-1cdd-4e39-8d11-bd0b33138dbb None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:41.030136 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbeb7c-1cdd-4e39-8d11-bd0b33138dbb None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:41.036110 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d8320-2715-4a1f-a045-616a4ef709a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:41.036764 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d8320-2715-4a1f-a045-616a4ef709a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:41.037047 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d8320-2715-4a1f-a045-616a4ef709a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:41.037323 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d8320-2715-4a1f-a045-616a4ef709a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:41.037995 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d8320-2715-4a1f-a045-616a4ef709a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:41.039982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d8320-2715-4a1f-a045-616a4ef709a6 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:41.075933 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1224/2436] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:00:41 2022] POST /identity/v3/projects => generated 387 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:00:41.081805 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e07bf-7b4b-4f6a-9635-da276d8bdfd5 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:41.093073 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e07bf-7b4b-4f6a-9635-da276d8bdfd5 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:41.154180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730f8c2-c98a-4643-a9ac-6bc23fc9c295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:41.155060 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730f8c2-c98a-4643-a9ac-6bc23fc9c295 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:41.155388 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730f8c2-c98a-4643-a9ac-6bc23fc9c295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:41.155676 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730f8c2-c98a-4643-a9ac-6bc23fc9c295 admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:41.156373 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4730f8c2-c98a-4643-a9ac-6bc23fc9c295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:41.158310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4730f8c2-c98a-4643-a9ac-6bc23fc9c295 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:41.184981 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1213/2437] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:00:41 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 11:00:41.189699 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d8320-2715-4a1f-a045-616a4ef709a6 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:41.203252 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d8320-2715-4a1f-a045-616a4ef709a6 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:41.208314 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c5eef-dcd5-4d1d-8007-fe718956d0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:41.208960 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c5eef-dcd5-4d1d-8007-fe718956d0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:41.209241 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c5eef-dcd5-4d1d-8007-fe718956d0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:41.209515 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c5eef-dcd5-4d1d-8007-fe718956d0b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:41.210238 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c5eef-dcd5-4d1d-8007-fe718956d0b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:41.211886 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c5eef-dcd5-4d1d-8007-fe718956d0b9 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:41.222255 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1225/2438] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:00:41.226108 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730f8c2-c98a-4643-a9ac-6bc23fc9c295 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:41.236990 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730f8c2-c98a-4643-a9ac-6bc23fc9c295 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:41.241988 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d24df-4745-4228-aafd-edf9b5598235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:41.242682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d24df-4745-4228-aafd-edf9b5598235 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:41.242964 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d24df-4745-4228-aafd-edf9b5598235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:41.243275 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d24df-4745-4228-aafd-edf9b5598235 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:41.244008 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d24df-4745-4228-aafd-edf9b5598235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:41.245732 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d24df-4745-4228-aafd-edf9b5598235 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:41.257111 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1214/2439] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:00:41.261568 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c5eef-dcd5-4d1d-8007-fe718956d0b9 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:41.273411 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c5eef-dcd5-4d1d-8007-fe718956d0b9 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:41.279205 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259c6da-dab4-4c8b-88cd-21d30a37126b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:41.280201 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259c6da-dab4-4c8b-88cd-21d30a37126b admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:41.280423 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259c6da-dab4-4c8b-88cd-21d30a37126b admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:41.280705 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259c6da-dab4-4c8b-88cd-21d30a37126b admin admin] PATH_INFO: `/v3/projects/62442f4a4537474dae93485faba69d4e/users/d3a0fb405e1b408cb55a7576ab113a57/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:41.298434 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259c6da-dab4-4c8b-88cd-21d30a37126b admin admin] RBAC: Authorizing `identity:create_grant(project_id=62442f4a4537474dae93485faba69d4e, user_id=d3a0fb405e1b408cb55a7576ab113a57, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:41.301545 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259c6da-dab4-4c8b-88cd-21d30a37126b admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:41.318203 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1226/2440] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:00:41 2022] PUT /identity/v3/projects/62442f4a4537474dae93485faba69d4e/users/d3a0fb405e1b408cb55a7576ab113a57/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 11:00:41.330067 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab1d72-5010-4487-bf06-c8b1464979a4 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:41.330620 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab1d72-5010-4487-bf06-c8b1464979a4 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:41.330620 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab1d72-5010-4487-bf06-c8b1464979a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:41.359639 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-3aab1d72-5010-4487-bf06-c8b1464979a4 None None] MFA Rules not processed for user `d3a0fb405e1b408cb55a7576ab113a57`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:00:41.361544 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-3aab1d72-5010-4487-bf06-c8b1464979a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:41.438312 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1215/2441] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:00:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:00:41.442962 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259c6da-dab4-4c8b-88cd-21d30a37126b admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:41.512342 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259c6da-dab4-4c8b-88cd-21d30a37126b admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:41.518054 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c5217-9879-47d7-8c45-56a0cfd135cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:41.519008 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c5217-9879-47d7-8c45-56a0cfd135cb admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:41.519402 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c5217-9879-47d7-8c45-56a0cfd135cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:41.519789 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c5217-9879-47d7-8c45-56a0cfd135cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:41.520882 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c5217-9879-47d7-8c45-56a0cfd135cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:41.523932 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c5217-9879-47d7-8c45-56a0cfd135cb admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:41.556028 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1227/2442] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:00:41 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 11:00:41.560798 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab1d72-5010-4487-bf06-c8b1464979a4 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:41.572054 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab1d72-5010-4487-bf06-c8b1464979a4 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:41.599095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:00:41.632223 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4ab35-c9b5-4655-ab14-1c3358514e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:41.632918 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4ab35-c9b5-4655-ab14-1c3358514e2a admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:41.633198 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4ab35-c9b5-4655-ab14-1c3358514e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:41.633455 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4ab35-c9b5-4655-ab14-1c3358514e2a admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:41.634142 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4ab35-c9b5-4655-ab14-1c3358514e2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:41.636122 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4ab35-c9b5-4655-ab14-1c3358514e2a admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:41.658784 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1216/2443] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:00:41 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 11:00:41.661841 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c5217-9879-47d7-8c45-56a0cfd135cb admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:41.673539 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c5217-9879-47d7-8c45-56a0cfd135cb admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:41.679140 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2ab2f-6a85-4518-a5ee-1c7a65b5e303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:41.679882 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2ab2f-6a85-4518-a5ee-1c7a65b5e303 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:41.680206 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2ab2f-6a85-4518-a5ee-1c7a65b5e303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:41.680418 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2ab2f-6a85-4518-a5ee-1c7a65b5e303 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:41.681217 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2ab2f-6a85-4518-a5ee-1c7a65b5e303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:41.683091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2ab2f-6a85-4518-a5ee-1c7a65b5e303 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:41.693901 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1228/2444] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:00:41.698210 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4ab35-c9b5-4655-ab14-1c3358514e2a admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:41.708426 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4ab35-c9b5-4655-ab14-1c3358514e2a admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:41.713265 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a630a70-efeb-41bc-b361-69ea02b72f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:41.714547 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a630a70-efeb-41bc-b361-69ea02b72f76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:41.714547 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a630a70-efeb-41bc-b361-69ea02b72f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:41.714791 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a630a70-efeb-41bc-b361-69ea02b72f76 admin admin] PATH_INFO: `/v3/projects/e94e8e40556d40b382582d15d1dc0eb7/users/23fe3139eaf6405cbd4bc009e500765e/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:41.730161 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a630a70-efeb-41bc-b361-69ea02b72f76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e94e8e40556d40b382582d15d1dc0eb7, user_id=23fe3139eaf6405cbd4bc009e500765e, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:41.732718 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a630a70-efeb-41bc-b361-69ea02b72f76 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:41.748698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1217/2445] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:00:41 2022] PUT /identity/v3/projects/e94e8e40556d40b382582d15d1dc0eb7/users/23fe3139eaf6405cbd4bc009e500765e/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 11:00:41.753499 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2ab2f-6a85-4518-a5ee-1c7a65b5e303 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:41.770549 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2ab2f-6a85-4518-a5ee-1c7a65b5e303 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:41.843459 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225c412-3180-4e26-a869-a8ec3d8f7919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:41.844130 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225c412-3180-4e26-a869-a8ec3d8f7919 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:41.844409 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225c412-3180-4e26-a869-a8ec3d8f7919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:41.844683 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225c412-3180-4e26-a869-a8ec3d8f7919 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:41.845401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225c412-3180-4e26-a869-a8ec3d8f7919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:41.846993 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225c412-3180-4e26-a869-a8ec3d8f7919 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:41.857211 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1229/2446] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:00:41.861521 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a630a70-efeb-41bc-b361-69ea02b72f76 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:41.872722 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a630a70-efeb-41bc-b361-69ea02b72f76 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:41.877965 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e0c80-75ff-47b0-823a-5d937b4a6c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:41.878904 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e0c80-75ff-47b0-823a-5d937b4a6c39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:41.879199 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e0c80-75ff-47b0-823a-5d937b4a6c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:41.879500 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e0c80-75ff-47b0-823a-5d937b4a6c39 admin admin] PATH_INFO: `/v3/projects/e94e8e40556d40b382582d15d1dc0eb7/users/23fe3139eaf6405cbd4bc009e500765e/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:41.881584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e0c80-75ff-47b0-823a-5d937b4a6c39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e94e8e40556d40b382582d15d1dc0eb7, user_id=23fe3139eaf6405cbd4bc009e500765e, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:41.884286 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e0c80-75ff-47b0-823a-5d937b4a6c39 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:41.895284 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1218/2447] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:00:41 2022] PUT /identity/v3/projects/e94e8e40556d40b382582d15d1dc0eb7/users/23fe3139eaf6405cbd4bc009e500765e/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:00:41.905614 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d009c-0030-4d48-b64e-c6363c5a02f5 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:41.905909 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d009c-0030-4d48-b64e-c6363c5a02f5 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:41.906189 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d009c-0030-4d48-b64e-c6363c5a02f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:41.913689 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:00:41.936177 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-218d009c-0030-4d48-b64e-c6363c5a02f5 None None] MFA Rules not processed for user `23fe3139eaf6405cbd4bc009e500765e`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:00:41.937392 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-218d009c-0030-4d48-b64e-c6363c5a02f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:42.010467 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1230/2448] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:00:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:00:42.022662 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e0c80-75ff-47b0-823a-5d937b4a6c39 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:42.024861 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-aa8e0c80-75ff-47b0-823a-5d937b4a6c39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:42.088327 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e0c80-75ff-47b0-823a-5d937b4a6c39 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:42.092714 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58b335-7986-4cd3-ba76-3b4d1d791fb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:42.093373 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58b335-7986-4cd3-ba76-3b4d1d791fb6 service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:42.093722 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58b335-7986-4cd3-ba76-3b4d1d791fb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:42.093903 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58b335-7986-4cd3-ba76-3b4d1d791fb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:42.103836 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58b335-7986-4cd3-ba76-3b4d1d791fb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:42.105700 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58b335-7986-4cd3-ba76-3b4d1d791fb6 service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:42.115414 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1219/2449] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:00:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:00:42.143139 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d009c-0030-4d48-b64e-c6363c5a02f5 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:42.209643 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d009c-0030-4d48-b64e-c6363c5a02f5 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:42.214735 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95ba02-9a9d-44d7-816e-58065635af18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:42.215641 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95ba02-9a9d-44d7-816e-58065635af18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:42.215924 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95ba02-9a9d-44d7-816e-58065635af18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:42.216194 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95ba02-9a9d-44d7-816e-58065635af18 admin admin] PATH_INFO: `/v3/users/d3a0fb405e1b408cb55a7576ab113a57` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:42.217431 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95ba02-9a9d-44d7-816e-58065635af18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3a0fb405e1b408cb55a7576ab113a57)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:42.219370 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95ba02-9a9d-44d7-816e-58065635af18 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:42.270238 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6b95ba02-9a9d-44d7-816e-58065635af18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3a0fb405e1b408cb55a7576ab113a57'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:42.276960 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6b95ba02-9a9d-44d7-816e-58065635af18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3a0fb405e1b408cb55a7576ab113a57'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:42.284730 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6b95ba02-9a9d-44d7-816e-58065635af18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3a0fb405e1b408cb55a7576ab113a57'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:42.285364 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6b95ba02-9a9d-44d7-816e-58065635af18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3a0fb405e1b408cb55a7576ab113a57'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:42.297593 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6b95ba02-9a9d-44d7-816e-58065635af18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3a0fb405e1b408cb55a7576ab113a57'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:42.304015 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1231/2450] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:00:42 2022] DELETE /identity/v3/users/d3a0fb405e1b408cb55a7576ab113a57 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:00:42.308768 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbe444-660e-497c-ac41-970dc4780860 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:42.309057 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbe444-660e-497c-ac41-970dc4780860 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:42.309340 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbe444-660e-497c-ac41-970dc4780860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:42.333508 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-81bbe444-660e-497c-ac41-970dc4780860 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:00:42.334991 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-81bbe444-660e-497c-ac41-970dc4780860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:42.400888 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1220/2451] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:00:42.411083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95ba02-9a9d-44d7-816e-58065635af18 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:42.412809 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6b95ba02-9a9d-44d7-816e-58065635af18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:42.425260 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:00:42.477199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95ba02-9a9d-44d7-816e-58065635af18 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:42.481606 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7e0f8-1080-403c-bf7e-bd7a9484a89a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:42.482261 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7e0f8-1080-403c-bf7e-bd7a9484a89a service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:42.482553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7e0f8-1080-403c-bf7e-bd7a9484a89a service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:42.482810 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7e0f8-1080-403c-bf7e-bd7a9484a89a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:42.492537 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7e0f8-1080-403c-bf7e-bd7a9484a89a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:42.493964 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7e0f8-1080-403c-bf7e-bd7a9484a89a service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:42.504001 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1232/2452] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:00:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:00:42.782738 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bbe444-660e-497c-ac41-970dc4780860 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:42.784486 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-81bbe444-660e-497c-ac41-970dc4780860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:42.801182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bbe444-660e-497c-ac41-970dc4780860 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:42.807850 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56305d9-2e7a-4e77-ad81-9fde68bafcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:42.809022 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56305d9-2e7a-4e77-ad81-9fde68bafcb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:42.809310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56305d9-2e7a-4e77-ad81-9fde68bafcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:42.809601 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56305d9-2e7a-4e77-ad81-9fde68bafcb7 admin admin] PATH_INFO: `/v3/projects/62442f4a4537474dae93485faba69d4e` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:42.810796 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56305d9-2e7a-4e77-ad81-9fde68bafcb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62442f4a4537474dae93485faba69d4e)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:42.812743 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56305d9-2e7a-4e77-ad81-9fde68bafcb7 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:42.834380 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:00:42.861431 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-b56305d9-2e7a-4e77-ad81-9fde68bafcb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62442f4a4537474dae93485faba69d4e', 'request_id': 'req-b56305d9-2e7a-4e77-ad81-9fde68bafcb7'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:42.871701 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-b56305d9-2e7a-4e77-ad81-9fde68bafcb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62442f4a4537474dae93485faba69d4e', 'request_id': 'req-b56305d9-2e7a-4e77-ad81-9fde68bafcb7'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:42.878681 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-b56305d9-2e7a-4e77-ad81-9fde68bafcb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62442f4a4537474dae93485faba69d4e', 'request_id': 'req-b56305d9-2e7a-4e77-ad81-9fde68bafcb7'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:42.891888 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-b56305d9-2e7a-4e77-ad81-9fde68bafcb7 admin admin] The token cache is being invalidate because project 62442f4a4537474dae93485faba69d4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:00:42.892172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-b56305d9-2e7a-4e77-ad81-9fde68bafcb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:42.892928 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-b56305d9-2e7a-4e77-ad81-9fde68bafcb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:42.894599 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1221/2453] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:00:42 2022] DELETE /identity/v3/projects/62442f4a4537474dae93485faba69d4e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:00:42.898919 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7e0f8-1080-403c-bf7e-bd7a9484a89a service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:42.908896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7e0f8-1080-403c-bf7e-bd7a9484a89a service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:42.970523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236857f-f718-47a2-b487-87137a710100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:42.971448 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236857f-f718-47a2-b487-87137a710100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:42.971727 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236857f-f718-47a2-b487-87137a710100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:42.972003 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236857f-f718-47a2-b487-87137a710100 admin admin] PATH_INFO: `/v3/users/23fe3139eaf6405cbd4bc009e500765e` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:42.973243 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236857f-f718-47a2-b487-87137a710100 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23fe3139eaf6405cbd4bc009e500765e)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:42.975179 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236857f-f718-47a2-b487-87137a710100 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:43.024441 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7236857f-f718-47a2-b487-87137a710100 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23fe3139eaf6405cbd4bc009e500765e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:43.031820 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7236857f-f718-47a2-b487-87137a710100 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23fe3139eaf6405cbd4bc009e500765e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:43.041126 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7236857f-f718-47a2-b487-87137a710100 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23fe3139eaf6405cbd4bc009e500765e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:43.041730 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7236857f-f718-47a2-b487-87137a710100 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23fe3139eaf6405cbd4bc009e500765e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:43.055272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7236857f-f718-47a2-b487-87137a710100 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23fe3139eaf6405cbd4bc009e500765e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:43.061631 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1233/2454] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:00:42 2022] DELETE /identity/v3/users/23fe3139eaf6405cbd4bc009e500765e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:00:43.351601 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56305d9-2e7a-4e77-ad81-9fde68bafcb7 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:43.353112 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-b56305d9-2e7a-4e77-ad81-9fde68bafcb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:43.369563 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56305d9-2e7a-4e77-ad81-9fde68bafcb7 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:43.436662 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a0df9-2347-4877-893a-6d5edbe7a8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:43.437574 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a0df9-2347-4877-893a-6d5edbe7a8e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:43.437861 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a0df9-2347-4877-893a-6d5edbe7a8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:43.438139 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a0df9-2347-4877-893a-6d5edbe7a8e8 admin admin] PATH_INFO: `/v3/projects/e94e8e40556d40b382582d15d1dc0eb7` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:43.439413 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a0df9-2347-4877-893a-6d5edbe7a8e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e94e8e40556d40b382582d15d1dc0eb7)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:43.441350 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a0df9-2347-4877-893a-6d5edbe7a8e8 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:43.490208 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-088a0df9-2347-4877-893a-6d5edbe7a8e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e94e8e40556d40b382582d15d1dc0eb7', 'request_id': 'req-088a0df9-2347-4877-893a-6d5edbe7a8e8'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:43.499361 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-088a0df9-2347-4877-893a-6d5edbe7a8e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e94e8e40556d40b382582d15d1dc0eb7', 'request_id': 'req-088a0df9-2347-4877-893a-6d5edbe7a8e8'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:43.505283 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-088a0df9-2347-4877-893a-6d5edbe7a8e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e94e8e40556d40b382582d15d1dc0eb7', 'request_id': 'req-088a0df9-2347-4877-893a-6d5edbe7a8e8'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:43.517298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-088a0df9-2347-4877-893a-6d5edbe7a8e8 admin admin] The token cache is being invalidate because project e94e8e40556d40b382582d15d1dc0eb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:00:43.517591 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-088a0df9-2347-4877-893a-6d5edbe7a8e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:43.518398 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-088a0df9-2347-4877-893a-6d5edbe7a8e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:43.520182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1222/2455] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:00:43 2022] DELETE /identity/v3/projects/e94e8e40556d40b382582d15d1dc0eb7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:00:43.526966 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b5186-1cba-4ac1-a51c-99bcc657d7b3 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:43.527400 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b5186-1cba-4ac1-a51c-99bcc657d7b3 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:43.527689 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b5186-1cba-4ac1-a51c-99bcc657d7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:43.545359 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-a67b5186-1cba-4ac1-a51c-99bcc657d7b3 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:00:43.546605 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a67b5186-1cba-4ac1-a51c-99bcc657d7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:43.574586 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:00:43.610394 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1234/2456] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:00:43.619487 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8a1a4-3857-4bab-bb92-705ffd00d312 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:43.619774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8a1a4-3857-4bab-bb92-705ffd00d312 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:43.620054 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8a1a4-3857-4bab-bb92-705ffd00d312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:43.641446 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-02c8a1a4-3857-4bab-bb92-705ffd00d312 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:00:43.642657 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-02c8a1a4-3857-4bab-bb92-705ffd00d312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:43.652056 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1223/2457] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:00:43.656581 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b5186-1cba-4ac1-a51c-99bcc657d7b3 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:43.667002 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b5186-1cba-4ac1-a51c-99bcc657d7b3 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:43.672324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72c157-bcb5-4173-a0d1-48f964e64d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:43.672984 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72c157-bcb5-4173-a0d1-48f964e64d83 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:43.673266 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72c157-bcb5-4173-a0d1-48f964e64d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:43.673541 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72c157-bcb5-4173-a0d1-48f964e64d83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:43.674272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72c157-bcb5-4173-a0d1-48f964e64d83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 11:00:43.674573 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72c157-bcb5-4173-a0d1-48f964e64d83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:43.676617 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72c157-bcb5-4173-a0d1-48f964e64d83 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:43.688450 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1235/2458] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 11:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 11:00:43.692908 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8a1a4-3857-4bab-bb92-705ffd00d312 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:43.702873 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8a1a4-3857-4bab-bb92-705ffd00d312 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:43.708560 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfff393-8985-4b0c-828f-3632c802c196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:43.709256 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfff393-8985-4b0c-828f-3632c802c196 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:43.709538 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfff393-8985-4b0c-828f-3632c802c196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:43.709812 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfff393-8985-4b0c-828f-3632c802c196 admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:43.710504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfff393-8985-4b0c-828f-3632c802c196 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:43.712454 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfff393-8985-4b0c-828f-3632c802c196 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:43.744373 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1224/2459] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:00:43 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:00:43.749009 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72c157-bcb5-4173-a0d1-48f964e64d83 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:43.760308 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72c157-bcb5-4173-a0d1-48f964e64d83 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:43.819119 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d935797-a0dd-463a-a8da-31cada0ec9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:43.819817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d935797-a0dd-463a-a8da-31cada0ec9da admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:43.820098 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d935797-a0dd-463a-a8da-31cada0ec9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:43.820446 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d935797-a0dd-463a-a8da-31cada0ec9da admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:43.821129 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d935797-a0dd-463a-a8da-31cada0ec9da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:43.823073 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d935797-a0dd-463a-a8da-31cada0ec9da admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:43.848666 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1236/2460] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:00:43 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:00:43.853418 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfff393-8985-4b0c-828f-3632c802c196 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:43.870059 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfff393-8985-4b0c-828f-3632c802c196 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:43.876265 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df8b86-f657-4d94-913c-4d1e6ff3bda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:43.876940 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df8b86-f657-4d94-913c-4d1e6ff3bda1 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:43.877225 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df8b86-f657-4d94-913c-4d1e6ff3bda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:43.877504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df8b86-f657-4d94-913c-4d1e6ff3bda1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:43.878239 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df8b86-f657-4d94-913c-4d1e6ff3bda1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:43.879914 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df8b86-f657-4d94-913c-4d1e6ff3bda1 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:43.882462 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:00:43.893399 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1225/2461] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:00:43.897682 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d935797-a0dd-463a-a8da-31cada0ec9da admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:43.908262 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d935797-a0dd-463a-a8da-31cada0ec9da admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:43.916909 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204005d0-7aae-4a0d-9f53-ff4102b32d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:43.918733 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204005d0-7aae-4a0d-9f53-ff4102b32d93 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:43.919101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204005d0-7aae-4a0d-9f53-ff4102b32d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:43.919509 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204005d0-7aae-4a0d-9f53-ff4102b32d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:43.920622 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204005d0-7aae-4a0d-9f53-ff4102b32d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:43.922979 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204005d0-7aae-4a0d-9f53-ff4102b32d93 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:43.937423 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1237/2462] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:00:43.942157 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df8b86-f657-4d94-913c-4d1e6ff3bda1 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:43.953259 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df8b86-f657-4d94-913c-4d1e6ff3bda1 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:43.959279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b095504-c964-4266-87e9-a60cba1fb1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:43.960178 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b095504-c964-4266-87e9-a60cba1fb1ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:43.960459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b095504-c964-4266-87e9-a60cba1fb1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:43.960733 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b095504-c964-4266-87e9-a60cba1fb1ee admin admin] PATH_INFO: `/v3/projects/907db8aaa0b747bea6d1a675ab1a8876/users/de6737b01b3b475799d2a69a8e302cb7/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:43.976394 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b095504-c964-4266-87e9-a60cba1fb1ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=907db8aaa0b747bea6d1a675ab1a8876, user_id=de6737b01b3b475799d2a69a8e302cb7, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:43.979050 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b095504-c964-4266-87e9-a60cba1fb1ee admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:43.994654 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1226/2463] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:00:43 2022] PUT /identity/v3/projects/907db8aaa0b747bea6d1a675ab1a8876/users/de6737b01b3b475799d2a69a8e302cb7/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:00:44.004986 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c8a38-139f-4f56-873b-9b672e0aa202 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:44.005296 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c8a38-139f-4f56-873b-9b672e0aa202 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:44.005565 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c8a38-139f-4f56-873b-9b672e0aa202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:44.032323 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-221c8a38-139f-4f56-873b-9b672e0aa202 None None] MFA Rules not processed for user `de6737b01b3b475799d2a69a8e302cb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:00:44.033516 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-221c8a38-139f-4f56-873b-9b672e0aa202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:44.114268 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1238/2464] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:00:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:00:44.119031 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b095504-c964-4266-87e9-a60cba1fb1ee admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:44.186007 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b095504-c964-4266-87e9-a60cba1fb1ee admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:44.190938 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed30024-6907-460f-a974-e81522b1246c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:44.191676 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed30024-6907-460f-a974-e81522b1246c admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:44.191963 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed30024-6907-460f-a974-e81522b1246c admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:44.192238 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed30024-6907-460f-a974-e81522b1246c admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:44.192956 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed30024-6907-460f-a974-e81522b1246c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:44.194874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed30024-6907-460f-a974-e81522b1246c admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:44.221885 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1227/2465] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:00:44 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:00:44.227910 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c8a38-139f-4f56-873b-9b672e0aa202 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:44.240407 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c8a38-139f-4f56-873b-9b672e0aa202 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:44.266153 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:00:44.301316 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f405f-8067-4e17-8a8a-25d91d6d7822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:44.302000 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f405f-8067-4e17-8a8a-25d91d6d7822 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:44.302286 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f405f-8067-4e17-8a8a-25d91d6d7822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:44.302570 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f405f-8067-4e17-8a8a-25d91d6d7822 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:44.303325 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f405f-8067-4e17-8a8a-25d91d6d7822 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:44.305240 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f405f-8067-4e17-8a8a-25d91d6d7822 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:44.330311 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1239/2466] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:00:44 2022] POST /identity/v3/users => generated 298 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:00:44.333242 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed30024-6907-460f-a974-e81522b1246c admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:44.346007 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed30024-6907-460f-a974-e81522b1246c admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:44.352116 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34311d13-2a57-405c-9ffa-f49c394f4027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:44.352786 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34311d13-2a57-405c-9ffa-f49c394f4027 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:44.353066 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34311d13-2a57-405c-9ffa-f49c394f4027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:44.353338 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34311d13-2a57-405c-9ffa-f49c394f4027 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:44.354065 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34311d13-2a57-405c-9ffa-f49c394f4027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:44.355902 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34311d13-2a57-405c-9ffa-f49c394f4027 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:44.367462 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1228/2467] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:00:44.372508 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f405f-8067-4e17-8a8a-25d91d6d7822 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:44.383749 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f405f-8067-4e17-8a8a-25d91d6d7822 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:44.389309 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d298963-088b-4e5f-98cf-1e900c790fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:44.390236 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d298963-088b-4e5f-98cf-1e900c790fed admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:44.390523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d298963-088b-4e5f-98cf-1e900c790fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:44.390941 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d298963-088b-4e5f-98cf-1e900c790fed admin admin] PATH_INFO: `/v3/projects/a891a57b1adf46e486e8f48181353635/users/3deab370fde945bd84ce803b9db0ec11/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:44.406583 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d298963-088b-4e5f-98cf-1e900c790fed admin admin] RBAC: Authorizing `identity:create_grant(project_id=a891a57b1adf46e486e8f48181353635, user_id=3deab370fde945bd84ce803b9db0ec11, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:44.409305 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d298963-088b-4e5f-98cf-1e900c790fed admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:44.428332 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1240/2468] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:00:44 2022] PUT /identity/v3/projects/a891a57b1adf46e486e8f48181353635/users/3deab370fde945bd84ce803b9db0ec11/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:00:44.433592 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34311d13-2a57-405c-9ffa-f49c394f4027 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:44.444593 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34311d13-2a57-405c-9ffa-f49c394f4027 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:44.512334 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809f4af-6520-42f7-9d1d-0f61b2f172c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:44.513024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809f4af-6520-42f7-9d1d-0f61b2f172c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:44.513310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809f4af-6520-42f7-9d1d-0f61b2f172c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:44.513602 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809f4af-6520-42f7-9d1d-0f61b2f172c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:44.514326 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809f4af-6520-42f7-9d1d-0f61b2f172c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:44.515980 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809f4af-6520-42f7-9d1d-0f61b2f172c9 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:44.526082 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1229/2469] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 11:00:44.530386 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d298963-088b-4e5f-98cf-1e900c790fed admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:44.541811 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d298963-088b-4e5f-98cf-1e900c790fed admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:44.547119 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9995b3f-8649-4126-b3de-4463e02c039b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:44.548055 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9995b3f-8649-4126-b3de-4463e02c039b admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:44.548324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9995b3f-8649-4126-b3de-4463e02c039b admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:44.548602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9995b3f-8649-4126-b3de-4463e02c039b admin admin] PATH_INFO: `/v3/projects/a891a57b1adf46e486e8f48181353635/users/3deab370fde945bd84ce803b9db0ec11/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:44.551016 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9995b3f-8649-4126-b3de-4463e02c039b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a891a57b1adf46e486e8f48181353635, user_id=3deab370fde945bd84ce803b9db0ec11, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:44.553666 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9995b3f-8649-4126-b3de-4463e02c039b admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:44.564142 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1241/2470] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:00:44 2022] PUT /identity/v3/projects/a891a57b1adf46e486e8f48181353635/users/3deab370fde945bd84ce803b9db0ec11/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:00:44.574758 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0b270-52a8-464e-aad4-43c3c3fb9563 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:44.575056 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0b270-52a8-464e-aad4-43c3c3fb9563 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:44.575379 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0b270-52a8-464e-aad4-43c3c3fb9563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:44.603669 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-90b0b270-52a8-464e-aad4-43c3c3fb9563 None None] MFA Rules not processed for user `3deab370fde945bd84ce803b9db0ec11`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:00:44.604900 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-90b0b270-52a8-464e-aad4-43c3c3fb9563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:44.639277 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:00:44.682696 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1230/2471] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:00:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:00:44.696152 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9995b3f-8649-4126-b3de-4463e02c039b admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:44.698053 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a9995b3f-8649-4126-b3de-4463e02c039b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:44.766989 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9995b3f-8649-4126-b3de-4463e02c039b admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:44.773835 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b9ee4-8450-4f6d-8b97-c11a9b259c6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:44.774809 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b9ee4-8450-4f6d-8b97-c11a9b259c6c service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:44.775218 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b9ee4-8450-4f6d-8b97-c11a9b259c6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:44.775579 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b9ee4-8450-4f6d-8b97-c11a9b259c6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:44.787194 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b9ee4-8450-4f6d-8b97-c11a9b259c6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:44.788553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b9ee4-8450-4f6d-8b97-c11a9b259c6c service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:44.799024 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1242/2472] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:00:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:00:44.909388 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b0b270-52a8-464e-aad4-43c3c3fb9563 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:44.920112 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b0b270-52a8-464e-aad4-43c3c3fb9563 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:44.924011 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e45425-c0fd-4e12-a5ff-017153965656 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:44.924996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e45425-c0fd-4e12-a5ff-017153965656 service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:44.925306 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e45425-c0fd-4e12-a5ff-017153965656 service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:44.925587 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e45425-c0fd-4e12-a5ff-017153965656 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:44.983741 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e45425-c0fd-4e12-a5ff-017153965656 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:44.985176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e45425-c0fd-4e12-a5ff-017153965656 service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:44.994412 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1231/2473] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:00:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:00:47.632929 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b9ee4-8450-4f6d-8b97-c11a9b259c6c service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:47.697592 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b9ee4-8450-4f6d-8b97-c11a9b259c6c service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:47.703390 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e60f7-7bbd-439f-8b6f-58cd0cf558ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:47.704285 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e60f7-7bbd-439f-8b6f-58cd0cf558ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:47.704577 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e60f7-7bbd-439f-8b6f-58cd0cf558ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:47.704857 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e60f7-7bbd-439f-8b6f-58cd0cf558ec admin admin] PATH_INFO: `/v3/users/de6737b01b3b475799d2a69a8e302cb7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:47.706100 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e60f7-7bbd-439f-8b6f-58cd0cf558ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=de6737b01b3b475799d2a69a8e302cb7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:47.708068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e60f7-7bbd-439f-8b6f-58cd0cf558ec admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:47.732858 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:00:47.757124 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-972e60f7-7bbd-439f-8b6f-58cd0cf558ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de6737b01b3b475799d2a69a8e302cb7'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:47.764027 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-972e60f7-7bbd-439f-8b6f-58cd0cf558ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de6737b01b3b475799d2a69a8e302cb7'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:47.772644 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-972e60f7-7bbd-439f-8b6f-58cd0cf558ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de6737b01b3b475799d2a69a8e302cb7'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:47.773272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-972e60f7-7bbd-439f-8b6f-58cd0cf558ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de6737b01b3b475799d2a69a8e302cb7'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:47.784982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-972e60f7-7bbd-439f-8b6f-58cd0cf558ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de6737b01b3b475799d2a69a8e302cb7'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:47.791292 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1243/2474] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:00:47 2022] DELETE /identity/v3/users/de6737b01b3b475799d2a69a8e302cb7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:00:47.796113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321d764-8e29-4ce3-987e-6a3c0fb9524d None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:47.796616 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321d764-8e29-4ce3-987e-6a3c0fb9524d None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:47.796761 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321d764-8e29-4ce3-987e-6a3c0fb9524d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:47.815449 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-9321d764-8e29-4ce3-987e-6a3c0fb9524d None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:00:47.816660 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-9321d764-8e29-4ce3-987e-6a3c0fb9524d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:47.893238 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1232/2475] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:00:47.904491 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e60f7-7bbd-439f-8b6f-58cd0cf558ec admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:47.906190 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-972e60f7-7bbd-439f-8b6f-58cd0cf558ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:47.967482 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e60f7-7bbd-439f-8b6f-58cd0cf558ec admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:47.971398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91fd09-4a4d-44f7-bd71-14347465d196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:47.972050 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91fd09-4a4d-44f7-bd71-14347465d196 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:47.972336 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91fd09-4a4d-44f7-bd71-14347465d196 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:47.972614 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91fd09-4a4d-44f7-bd71-14347465d196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:47.981957 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91fd09-4a4d-44f7-bd71-14347465d196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:47.983413 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91fd09-4a4d-44f7-bd71-14347465d196 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:47.992966 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1244/2476] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:00:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:00:48.275490 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321d764-8e29-4ce3-987e-6a3c0fb9524d None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:48.277047 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-9321d764-8e29-4ce3-987e-6a3c0fb9524d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:48.296182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321d764-8e29-4ce3-987e-6a3c0fb9524d None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:48.302721 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff90a1e-2433-4555-9649-43456535a67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:48.303880 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff90a1e-2433-4555-9649-43456535a67d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:48.304244 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff90a1e-2433-4555-9649-43456535a67d admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:48.304606 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff90a1e-2433-4555-9649-43456535a67d admin admin] PATH_INFO: `/v3/projects/907db8aaa0b747bea6d1a675ab1a8876` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:48.305991 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff90a1e-2433-4555-9649-43456535a67d admin admin] RBAC: Authorizing `identity:delete_project(project_id=907db8aaa0b747bea6d1a675ab1a8876)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:48.307999 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff90a1e-2433-4555-9649-43456535a67d admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:48.356603 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-cff90a1e-2433-4555-9649-43456535a67d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '907db8aaa0b747bea6d1a675ab1a8876', 'request_id': 'req-cff90a1e-2433-4555-9649-43456535a67d'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:48.365190 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-cff90a1e-2433-4555-9649-43456535a67d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '907db8aaa0b747bea6d1a675ab1a8876', 'request_id': 'req-cff90a1e-2433-4555-9649-43456535a67d'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:48.369832 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:00:48.371037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-cff90a1e-2433-4555-9649-43456535a67d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '907db8aaa0b747bea6d1a675ab1a8876', 'request_id': 'req-cff90a1e-2433-4555-9649-43456535a67d'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:48.383723 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-cff90a1e-2433-4555-9649-43456535a67d admin admin] The token cache is being invalidate because project 907db8aaa0b747bea6d1a675ab1a8876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:00:48.384301 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-cff90a1e-2433-4555-9649-43456535a67d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:48.385646 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-cff90a1e-2433-4555-9649-43456535a67d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:48.386598 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1233/2477] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:00:48 2022] DELETE /identity/v3/projects/907db8aaa0b747bea6d1a675ab1a8876 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 11:00:48.390975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91fd09-4a4d-44f7-bd71-14347465d196 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:48.401183 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91fd09-4a4d-44f7-bd71-14347465d196 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:48.471319 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0ac45-0f60-4222-a763-6fd343b1f879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:48.472623 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0ac45-0f60-4222-a763-6fd343b1f879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:48.472884 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0ac45-0f60-4222-a763-6fd343b1f879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:48.473297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0ac45-0f60-4222-a763-6fd343b1f879 admin admin] PATH_INFO: `/v3/users/3deab370fde945bd84ce803b9db0ec11` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:48.475255 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae0ac45-0f60-4222-a763-6fd343b1f879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3deab370fde945bd84ce803b9db0ec11)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:48.477911 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae0ac45-0f60-4222-a763-6fd343b1f879 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:48.532351 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:00:48.534509 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-bae0ac45-0f60-4222-a763-6fd343b1f879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3deab370fde945bd84ce803b9db0ec11'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:48.543375 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-bae0ac45-0f60-4222-a763-6fd343b1f879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3deab370fde945bd84ce803b9db0ec11'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:48.552209 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-bae0ac45-0f60-4222-a763-6fd343b1f879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3deab370fde945bd84ce803b9db0ec11'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:48.552817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-bae0ac45-0f60-4222-a763-6fd343b1f879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3deab370fde945bd84ce803b9db0ec11'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:48.565779 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-bae0ac45-0f60-4222-a763-6fd343b1f879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3deab370fde945bd84ce803b9db0ec11'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:48.572103 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1245/2478] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:00:48 2022] DELETE /identity/v3/users/3deab370fde945bd84ce803b9db0ec11 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:00:48.885187 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff90a1e-2433-4555-9649-43456535a67d admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:48.887223 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-cff90a1e-2433-4555-9649-43456535a67d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:48.903046 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff90a1e-2433-4555-9649-43456535a67d admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:48.964748 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ca8a0-2130-4dd9-a028-04de3e4ff5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:48.965625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ca8a0-2130-4dd9-a028-04de3e4ff5e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:48.965913 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ca8a0-2130-4dd9-a028-04de3e4ff5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:48.966192 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ca8a0-2130-4dd9-a028-04de3e4ff5e5 admin admin] PATH_INFO: `/v3/projects/a891a57b1adf46e486e8f48181353635` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:48.967510 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ca8a0-2130-4dd9-a028-04de3e4ff5e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a891a57b1adf46e486e8f48181353635)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:48.969451 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ca8a0-2130-4dd9-a028-04de3e4ff5e5 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:49.018295 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-380ca8a0-2130-4dd9-a028-04de3e4ff5e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a891a57b1adf46e486e8f48181353635', 'request_id': 'req-380ca8a0-2130-4dd9-a028-04de3e4ff5e5'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:49.028193 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-380ca8a0-2130-4dd9-a028-04de3e4ff5e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a891a57b1adf46e486e8f48181353635', 'request_id': 'req-380ca8a0-2130-4dd9-a028-04de3e4ff5e5'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:49.034405 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-380ca8a0-2130-4dd9-a028-04de3e4ff5e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a891a57b1adf46e486e8f48181353635', 'request_id': 'req-380ca8a0-2130-4dd9-a028-04de3e4ff5e5'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:49.045334 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-380ca8a0-2130-4dd9-a028-04de3e4ff5e5 admin admin] The token cache is being invalidate because project a891a57b1adf46e486e8f48181353635 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:00:49.045560 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-380ca8a0-2130-4dd9-a028-04de3e4ff5e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:49.046231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-380ca8a0-2130-4dd9-a028-04de3e4ff5e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:00:49.047852 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1234/2479] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:00:48 2022] DELETE /identity/v3/projects/a891a57b1adf46e486e8f48181353635 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:00:49.053685 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01914e91-ac89-44bc-8b2d-8ff77c0ba981 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:49.054187 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01914e91-ac89-44bc-8b2d-8ff77c0ba981 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:49.054291 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01914e91-ac89-44bc-8b2d-8ff77c0ba981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:49.074355 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-01914e91-ac89-44bc-8b2d-8ff77c0ba981 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:00:49.075623 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-01914e91-ac89-44bc-8b2d-8ff77c0ba981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:49.140278 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1246/2480] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:00:49.149396 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492e1f1-2ada-4932-8ac0-0f6bbb2df262 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:49.149696 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492e1f1-2ada-4932-8ac0-0f6bbb2df262 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:49.149978 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492e1f1-2ada-4932-8ac0-0f6bbb2df262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:49.171687 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-b492e1f1-2ada-4932-8ac0-0f6bbb2df262 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:00:49.172906 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-b492e1f1-2ada-4932-8ac0-0f6bbb2df262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:49.182626 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1235/2481] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:00:49.187249 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01914e91-ac89-44bc-8b2d-8ff77c0ba981 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:49.197234 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01914e91-ac89-44bc-8b2d-8ff77c0ba981 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:49.202662 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1e433-3b4f-45fd-8115-e31f7ade8b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:49.203328 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1e433-3b4f-45fd-8115-e31f7ade8b89 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:49.203615 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1e433-3b4f-45fd-8115-e31f7ade8b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:49.203899 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1e433-3b4f-45fd-8115-e31f7ade8b89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:49.204635 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1e433-3b4f-45fd-8115-e31f7ade8b89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 11:00:49.204945 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1e433-3b4f-45fd-8115-e31f7ade8b89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:49.206558 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1e433-3b4f-45fd-8115-e31f7ade8b89 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:49.218851 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1247/2482] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 11:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 11:00:49.223308 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492e1f1-2ada-4932-8ac0-0f6bbb2df262 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:49.232669 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492e1f1-2ada-4932-8ac0-0f6bbb2df262 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:49.237807 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ee651-5335-49c5-b591-591b087d380d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:49.238464 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ee651-5335-49c5-b591-591b087d380d admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:49.238750 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ee651-5335-49c5-b591-591b087d380d admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:49.239026 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ee651-5335-49c5-b591-591b087d380d admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:49.239768 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ee651-5335-49c5-b591-591b087d380d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:49.241663 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ee651-5335-49c5-b591-591b087d380d admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:49.270536 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1236/2483] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:00:49 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 11:00:49.274756 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1e433-3b4f-45fd-8115-e31f7ade8b89 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:49.285364 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1e433-3b4f-45fd-8115-e31f7ade8b89 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:49.345663 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4cf607-d2ad-4997-bcf5-706ed452c9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:49.346323 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cf607-d2ad-4997-bcf5-706ed452c9a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:49.346601 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cf607-d2ad-4997-bcf5-706ed452c9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:49.346874 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cf607-d2ad-4997-bcf5-706ed452c9a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:49.347594 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4cf607-d2ad-4997-bcf5-706ed452c9a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:49.349483 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4cf607-d2ad-4997-bcf5-706ed452c9a1 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:49.370762 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1248/2484] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:00:49 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:00:49.375065 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ee651-5335-49c5-b591-591b087d380d admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:49.386019 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ee651-5335-49c5-b591-591b087d380d admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:49.391037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5f4d1-ca38-474a-a257-bba9fb9327a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:49.391742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5f4d1-ca38-474a-a257-bba9fb9327a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:49.392025 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5f4d1-ca38-474a-a257-bba9fb9327a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:49.392301 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5f4d1-ca38-474a-a257-bba9fb9327a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:49.393025 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d5f4d1-ca38-474a-a257-bba9fb9327a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:49.394616 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d5f4d1-ca38-474a-a257-bba9fb9327a7 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:49.405239 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1237/2485] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:00:49.409267 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4cf607-d2ad-4997-bcf5-706ed452c9a1 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:49.419232 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4cf607-d2ad-4997-bcf5-706ed452c9a1 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:49.424175 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1eaae-c2a4-4cdf-ac7b-0aa28636782f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:49.425176 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1eaae-c2a4-4cdf-ac7b-0aa28636782f admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:49.425475 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1eaae-c2a4-4cdf-ac7b-0aa28636782f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:49.425747 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1eaae-c2a4-4cdf-ac7b-0aa28636782f admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:49.426468 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1eaae-c2a4-4cdf-ac7b-0aa28636782f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:49.428079 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1eaae-c2a4-4cdf-ac7b-0aa28636782f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:49.438916 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1249/2486] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 11:00:49.443035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5f4d1-ca38-474a-a257-bba9fb9327a7 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:49.453518 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5f4d1-ca38-474a-a257-bba9fb9327a7 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:49.459539 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958d753-918e-4e13-adbc-b222b5009156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:49.460433 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958d753-918e-4e13-adbc-b222b5009156 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:49.460717 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958d753-918e-4e13-adbc-b222b5009156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:49.460994 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958d753-918e-4e13-adbc-b222b5009156 admin admin] PATH_INFO: `/v3/projects/0ddd28693f2d49e7a4fba50d9f2b3e9a/users/697d4a16c5ca40d9bd39bcf65a70ac9b/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:49.476317 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958d753-918e-4e13-adbc-b222b5009156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ddd28693f2d49e7a4fba50d9f2b3e9a, user_id=697d4a16c5ca40d9bd39bcf65a70ac9b, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:49.478998 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958d753-918e-4e13-adbc-b222b5009156 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:49.494954 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1238/2487] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:00:49 2022] PUT /identity/v3/projects/0ddd28693f2d49e7a4fba50d9f2b3e9a/users/697d4a16c5ca40d9bd39bcf65a70ac9b/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:00:49.505884 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fca072-0f8b-4c5f-873c-3dca72e45fc1 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:49.506176 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fca072-0f8b-4c5f-873c-3dca72e45fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:49.506455 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fca072-0f8b-4c5f-873c-3dca72e45fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:49.534168 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-99fca072-0f8b-4c5f-873c-3dca72e45fc1 None None] MFA Rules not processed for user `697d4a16c5ca40d9bd39bcf65a70ac9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:00:49.535487 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-99fca072-0f8b-4c5f-873c-3dca72e45fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:49.553826 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:00:49.606735 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1250/2488] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:00:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 11:00:49.617901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958d753-918e-4e13-adbc-b222b5009156 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:00:49.619798 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-a958d753-918e-4e13-adbc-b222b5009156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:00:49.641711 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:00:49.682162 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958d753-918e-4e13-adbc-b222b5009156 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:00:49.686492 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52223a9-423a-4d30-a627-29d279e5422a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:00:49.687165 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52223a9-423a-4d30-a627-29d279e5422a service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:00:49.687465 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52223a9-423a-4d30-a627-29d279e5422a service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:00:49.687750 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52223a9-423a-4d30-a627-29d279e5422a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:00:49.696446 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52223a9-423a-4d30-a627-29d279e5422a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:00:49.697884 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52223a9-423a-4d30-a627-29d279e5422a service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:00:49.706992 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1239/2489] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:00:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:00:59.603582 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=19 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:00:59.703165 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=18 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:01:12.576296 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fca072-0f8b-4c5f-873c-3dca72e45fc1 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:01:12.648297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fca072-0f8b-4c5f-873c-3dca72e45fc1 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:01:12.653505 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cbafe-5873-4a83-8d57-fdb1c83ba6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:01:12.654395 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cbafe-5873-4a83-8d57-fdb1c83ba6d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:12.654682 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cbafe-5873-4a83-8d57-fdb1c83ba6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:12.654961 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cbafe-5873-4a83-8d57-fdb1c83ba6d2 admin admin] PATH_INFO: `/v3/users/697d4a16c5ca40d9bd39bcf65a70ac9b` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:12.656266 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0cbafe-5873-4a83-8d57-fdb1c83ba6d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=697d4a16c5ca40d9bd39bcf65a70ac9b)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:01:12.658250 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0cbafe-5873-4a83-8d57-fdb1c83ba6d2 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:01:12.713036 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-5c0cbafe-5873-4a83-8d57-fdb1c83ba6d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '697d4a16c5ca40d9bd39bcf65a70ac9b'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:01:12.719890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-5c0cbafe-5873-4a83-8d57-fdb1c83ba6d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '697d4a16c5ca40d9bd39bcf65a70ac9b'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:01:12.729948 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-5c0cbafe-5873-4a83-8d57-fdb1c83ba6d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '697d4a16c5ca40d9bd39bcf65a70ac9b'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:01:12.730705 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-5c0cbafe-5873-4a83-8d57-fdb1c83ba6d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '697d4a16c5ca40d9bd39bcf65a70ac9b'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:01:12.743362 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-5c0cbafe-5873-4a83-8d57-fdb1c83ba6d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '697d4a16c5ca40d9bd39bcf65a70ac9b'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:01:12.749467 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1251/2490] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:01:12 2022] DELETE /identity/v3/users/697d4a16c5ca40d9bd39bcf65a70ac9b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:01:12.754230 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8d1f5-809d-4ba6-8591-f96bcc589111 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:12.754747 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8d1f5-809d-4ba6-8591-f96bcc589111 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:12.754849 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8d1f5-809d-4ba6-8591-f96bcc589111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:12.772153 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-e4f8d1f5-809d-4ba6-8591-f96bcc589111 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:01:12.773479 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-e4f8d1f5-809d-4ba6-8591-f96bcc589111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:01:12.837487 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1240/2491] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:01:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:01:12.847808 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cbafe-5873-4a83-8d57-fdb1c83ba6d2 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:01:12.850093 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5c0cbafe-5873-4a83-8d57-fdb1c83ba6d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:01:12.914330 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cbafe-5873-4a83-8d57-fdb1c83ba6d2 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:01:12.918371 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5298b85-839e-45ad-9c97-d89414c3413e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:01:12.919012 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5298b85-839e-45ad-9c97-d89414c3413e service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:12.919332 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5298b85-839e-45ad-9c97-d89414c3413e service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:12.919603 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5298b85-839e-45ad-9c97-d89414c3413e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:12.929686 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5298b85-839e-45ad-9c97-d89414c3413e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:01:12.931175 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5298b85-839e-45ad-9c97-d89414c3413e service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:01:12.943093 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1252/2492] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:01:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:01:13.221388 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8d1f5-809d-4ba6-8591-f96bcc589111 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:01:13.222972 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-e4f8d1f5-809d-4ba6-8591-f96bcc589111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:01:13.238083 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8d1f5-809d-4ba6-8591-f96bcc589111 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:01:13.243263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869c3e1-1a6a-4cda-9c7a-f091c15db441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:01:13.244188 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869c3e1-1a6a-4cda-9c7a-f091c15db441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:13.244474 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869c3e1-1a6a-4cda-9c7a-f091c15db441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:13.244749 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869c3e1-1a6a-4cda-9c7a-f091c15db441 admin admin] PATH_INFO: `/v3/projects/0ddd28693f2d49e7a4fba50d9f2b3e9a` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:13.245953 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869c3e1-1a6a-4cda-9c7a-f091c15db441 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ddd28693f2d49e7a4fba50d9f2b3e9a)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:01:13.247920 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869c3e1-1a6a-4cda-9c7a-f091c15db441 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:01:13.296027 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-e869c3e1-1a6a-4cda-9c7a-f091c15db441 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ddd28693f2d49e7a4fba50d9f2b3e9a', 'request_id': 'req-e869c3e1-1a6a-4cda-9c7a-f091c15db441'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:01:13.306239 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-e869c3e1-1a6a-4cda-9c7a-f091c15db441 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ddd28693f2d49e7a4fba50d9f2b3e9a', 'request_id': 'req-e869c3e1-1a6a-4cda-9c7a-f091c15db441'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:01:13.311715 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-e869c3e1-1a6a-4cda-9c7a-f091c15db441 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ddd28693f2d49e7a4fba50d9f2b3e9a', 'request_id': 'req-e869c3e1-1a6a-4cda-9c7a-f091c15db441'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:01:13.322599 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-e869c3e1-1a6a-4cda-9c7a-f091c15db441 admin admin] The token cache is being invalidate because project 0ddd28693f2d49e7a4fba50d9f2b3e9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:01:13.322885 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-e869c3e1-1a6a-4cda-9c7a-f091c15db441 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:01:13.323500 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-e869c3e1-1a6a-4cda-9c7a-f091c15db441 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:01:13.325080 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1241/2493] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:01:13 2022] DELETE /identity/v3/projects/0ddd28693f2d49e7a4fba50d9f2b3e9a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:01:13.330313 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d9263-8665-44fd-8f1c-bf3facfb1699 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:13.330685 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d9263-8665-44fd-8f1c-bf3facfb1699 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:13.331047 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d9263-8665-44fd-8f1c-bf3facfb1699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:13.350017 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-908d9263-8665-44fd-8f1c-bf3facfb1699 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:01:13.351337 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-908d9263-8665-44fd-8f1c-bf3facfb1699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:01:13.370135 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:01:13.415305 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1253/2494] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:01:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:01:13.423422 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48f261-c032-4ddd-8fb5-6ae014dfaae0 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:13.423717 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48f261-c032-4ddd-8fb5-6ae014dfaae0 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:13.423997 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48f261-c032-4ddd-8fb5-6ae014dfaae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:13.450055 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-bb48f261-c032-4ddd-8fb5-6ae014dfaae0 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:01:13.451911 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-bb48f261-c032-4ddd-8fb5-6ae014dfaae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:01:13.463936 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1242/2495] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:01:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 11:01:13.469070 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d9263-8665-44fd-8f1c-bf3facfb1699 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:01:13.484972 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d9263-8665-44fd-8f1c-bf3facfb1699 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:01:13.492832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef01c31b-9679-4344-9e55-c54fbc0e684a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:01:13.493495 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01c31b-9679-4344-9e55-c54fbc0e684a admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:13.493815 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01c31b-9679-4344-9e55-c54fbc0e684a admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:13.494083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01c31b-9679-4344-9e55-c54fbc0e684a admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:13.494821 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef01c31b-9679-4344-9e55-c54fbc0e684a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 11:01:13.495133 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef01c31b-9679-4344-9e55-c54fbc0e684a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:01:13.496781 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef01c31b-9679-4344-9e55-c54fbc0e684a admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:01:13.508877 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1254/2496] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 11:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 11:01:13.513353 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48f261-c032-4ddd-8fb5-6ae014dfaae0 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:01:13.523212 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48f261-c032-4ddd-8fb5-6ae014dfaae0 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:01:13.529505 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf30ee-a60f-4c1e-a750-bb856f1bdc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:01:13.530204 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf30ee-a60f-4c1e-a750-bb856f1bdc8d admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:13.530490 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf30ee-a60f-4c1e-a750-bb856f1bdc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:13.530768 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf30ee-a60f-4c1e-a750-bb856f1bdc8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:13.531521 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf30ee-a60f-4c1e-a750-bb856f1bdc8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:01:13.533434 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf30ee-a60f-4c1e-a750-bb856f1bdc8d admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:01:13.563108 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1243/2497] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:01:13 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 11:01:13.568359 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef01c31b-9679-4344-9e55-c54fbc0e684a admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:01:13.579356 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef01c31b-9679-4344-9e55-c54fbc0e684a admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:01:13.648393 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709186e9-7918-4cd0-96d5-160d39365baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:01:13.649087 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709186e9-7918-4cd0-96d5-160d39365baf admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:13.649375 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709186e9-7918-4cd0-96d5-160d39365baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:13.649659 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709186e9-7918-4cd0-96d5-160d39365baf admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:13.650377 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709186e9-7918-4cd0-96d5-160d39365baf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:01:13.652379 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709186e9-7918-4cd0-96d5-160d39365baf admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:01:13.678506 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1255/2498] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:01:13 2022] POST /identity/v3/users => generated 286 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:01:13.682648 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf30ee-a60f-4c1e-a750-bb856f1bdc8d admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:01:13.693370 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf30ee-a60f-4c1e-a750-bb856f1bdc8d admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:01:13.698356 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7de2b-5cc9-41c3-9c14-9fa4c960d2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:01:13.699030 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7de2b-5cc9-41c3-9c14-9fa4c960d2ed admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:13.699349 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7de2b-5cc9-41c3-9c14-9fa4c960d2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:13.699611 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7de2b-5cc9-41c3-9c14-9fa4c960d2ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:13.700438 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7de2b-5cc9-41c3-9c14-9fa4c960d2ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:01:13.702055 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7de2b-5cc9-41c3-9c14-9fa4c960d2ed admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:01:13.712868 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1244/2499] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:01:13.716818 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709186e9-7918-4cd0-96d5-160d39365baf admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:01:13.727659 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709186e9-7918-4cd0-96d5-160d39365baf admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:01:13.734248 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b516a-b853-4258-9c60-fa230e8f0ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:01:13.734921 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b516a-b853-4258-9c60-fa230e8f0ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:13.735256 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b516a-b853-4258-9c60-fa230e8f0ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:13.735530 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b516a-b853-4258-9c60-fa230e8f0ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:13.736266 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b516a-b853-4258-9c60-fa230e8f0ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:01:13.737859 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b516a-b853-4258-9c60-fa230e8f0ae7 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:01:13.749478 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1256/2500] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:01:13.755840 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7de2b-5cc9-41c3-9c14-9fa4c960d2ed admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:01:13.768615 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7de2b-5cc9-41c3-9c14-9fa4c960d2ed admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:01:13.774228 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97860780-89c4-4c6f-a02b-8142a809e854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:01:13.775133 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97860780-89c4-4c6f-a02b-8142a809e854 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:13.775443 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97860780-89c4-4c6f-a02b-8142a809e854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:13.775720 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97860780-89c4-4c6f-a02b-8142a809e854 admin admin] PATH_INFO: `/v3/projects/13772c55e89f4fac90ea7066d896d5e3/users/0fdd18b0eb954145848309052252413e/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:13.792669 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97860780-89c4-4c6f-a02b-8142a809e854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13772c55e89f4fac90ea7066d896d5e3, user_id=0fdd18b0eb954145848309052252413e, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:01:13.795363 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97860780-89c4-4c6f-a02b-8142a809e854 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:01:13.814288 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1245/2501] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:01:13 2022] PUT /identity/v3/projects/13772c55e89f4fac90ea7066d896d5e3/users/0fdd18b0eb954145848309052252413e/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:01:13.825016 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbcba7-4787-4b95-a5b6-809164f60184 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:13.825306 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbcba7-4787-4b95-a5b6-809164f60184 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:13.825587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbcba7-4787-4b95-a5b6-809164f60184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:13.854300 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-1adbcba7-4787-4b95-a5b6-809164f60184 None None] MFA Rules not processed for user `0fdd18b0eb954145848309052252413e`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:01:13.855536 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1adbcba7-4787-4b95-a5b6-809164f60184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:01:13.920858 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1257/2502] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:01:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:01:13.933049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97860780-89c4-4c6f-a02b-8142a809e854 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:01:13.935136 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-97860780-89c4-4c6f-a02b-8142a809e854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:01:13.961691 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:01:14.002415 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97860780-89c4-4c6f-a02b-8142a809e854 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:01:14.006617 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1eeff3-272c-4cbe-9f63-6f6a099ce036 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcba737e66244fe2b5b6ec3dd17dabd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:01:14.007524 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1eeff3-272c-4cbe-9f63-6f6a099ce036 service glance] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:14.007815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1eeff3-272c-4cbe-9f63-6f6a099ce036 service glance] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:14.008115 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1eeff3-272c-4cbe-9f63-6f6a099ce036 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:14.017049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1eeff3-272c-4cbe-9f63-6f6a099ce036 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:01:14.018477 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1eeff3-272c-4cbe-9f63-6f6a099ce036 service glance] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:01:14.027766 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1246/2503] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:01:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:01:23.918119 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:01:24.023460 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=17 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:01:27.582356 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbcba7-4787-4b95-a5b6-809164f60184 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:01:27.584275 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1adbcba7-4787-4b95-a5b6-809164f60184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:01:27.660444 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbcba7-4787-4b95-a5b6-809164f60184 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:01:27.666000 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0fb03-3e06-432c-8e7d-f5aeae0008bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b365d9dd635e4518a41181649c323062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:01:27.666662 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0fb03-3e06-432c-8e7d-f5aeae0008bb service placement] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:27.666948 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0fb03-3e06-432c-8e7d-f5aeae0008bb service placement] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:27.667235 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0fb03-3e06-432c-8e7d-f5aeae0008bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:27.669168 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-29a0fb03-3e06-432c-8e7d-f5aeae0008bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:01:27.681248 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0fb03-3e06-432c-8e7d-f5aeae0008bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:01:27.682823 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0fb03-3e06-432c-8e7d-f5aeae0008bb service placement] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:01:27.692751 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1258/2504] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:01:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:01:37.688505 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=32 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:01:49.318829 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1eeff3-272c-4cbe-9f63-6f6a099ce036 service glance] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:01:49.389593 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1eeff3-272c-4cbe-9f63-6f6a099ce036 service glance] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:01:49.394389 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac52bbd-6780-4167-8d76-325da9b4be3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:01:49.395308 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac52bbd-6780-4167-8d76-325da9b4be3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:49.395594 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac52bbd-6780-4167-8d76-325da9b4be3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:49.395871 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac52bbd-6780-4167-8d76-325da9b4be3f admin admin] PATH_INFO: `/v3/users/0fdd18b0eb954145848309052252413e` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:49.397072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac52bbd-6780-4167-8d76-325da9b4be3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fdd18b0eb954145848309052252413e)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:01:49.399011 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac52bbd-6780-4167-8d76-325da9b4be3f admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:01:49.450948 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-7ac52bbd-6780-4167-8d76-325da9b4be3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fdd18b0eb954145848309052252413e'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:01:49.458152 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-7ac52bbd-6780-4167-8d76-325da9b4be3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fdd18b0eb954145848309052252413e'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:01:49.466577 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-7ac52bbd-6780-4167-8d76-325da9b4be3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fdd18b0eb954145848309052252413e'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:01:49.467352 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-7ac52bbd-6780-4167-8d76-325da9b4be3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fdd18b0eb954145848309052252413e'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:01:49.480009 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-7ac52bbd-6780-4167-8d76-325da9b4be3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fdd18b0eb954145848309052252413e'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:01:49.486031 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1247/2505] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:01:49 2022] DELETE /identity/v3/users/0fdd18b0eb954145848309052252413e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:01:49.490692 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4c1d2-a621-4910-aed4-af6c9589d106 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:49.491249 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4c1d2-a621-4910-aed4-af6c9589d106 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:49.491249 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4c1d2-a621-4910-aed4-af6c9589d106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:49.509184 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-aec4c1d2-a621-4910-aed4-af6c9589d106 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:01:49.510378 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-aec4c1d2-a621-4910-aed4-af6c9589d106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:01:49.574345 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1259/2506] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:01:49.586273 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac52bbd-6780-4167-8d76-325da9b4be3f admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:01:49.587850 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-7ac52bbd-6780-4167-8d76-325da9b4be3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:01:49.651512 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac52bbd-6780-4167-8d76-325da9b4be3f admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:01:49.656154 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df439271-4c1a-4ca6-a0ac-9031b1193633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:01:49.656827 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df439271-4c1a-4ca6-a0ac-9031b1193633 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:49.657108 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df439271-4c1a-4ca6-a0ac-9031b1193633 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:49.657365 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df439271-4c1a-4ca6-a0ac-9031b1193633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:49.668237 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df439271-4c1a-4ca6-a0ac-9031b1193633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:01:49.669702 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df439271-4c1a-4ca6-a0ac-9031b1193633 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:01:49.679957 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1248/2507] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:01:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:01:49.969288 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4c1d2-a621-4910-aed4-af6c9589d106 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:01:49.970981 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-aec4c1d2-a621-4910-aed4-af6c9589d106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:01:49.985587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4c1d2-a621-4910-aed4-af6c9589d106 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:01:49.990121 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f327b-83d4-4fa3-81d0-f8356a84dcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:01:49.991105 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f327b-83d4-4fa3-81d0-f8356a84dcba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:49.991417 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f327b-83d4-4fa3-81d0-f8356a84dcba admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:49.991714 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f327b-83d4-4fa3-81d0-f8356a84dcba admin admin] PATH_INFO: `/v3/projects/13772c55e89f4fac90ea7066d896d5e3` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:49.992861 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f327b-83d4-4fa3-81d0-f8356a84dcba admin admin] RBAC: Authorizing `identity:delete_project(project_id=13772c55e89f4fac90ea7066d896d5e3)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:01:49.995504 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f327b-83d4-4fa3-81d0-f8356a84dcba admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:01:50.044185 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7a5f327b-83d4-4fa3-81d0-f8356a84dcba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13772c55e89f4fac90ea7066d896d5e3', 'request_id': 'req-7a5f327b-83d4-4fa3-81d0-f8356a84dcba'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:01:50.051988 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7a5f327b-83d4-4fa3-81d0-f8356a84dcba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13772c55e89f4fac90ea7066d896d5e3', 'request_id': 'req-7a5f327b-83d4-4fa3-81d0-f8356a84dcba'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:01:50.059381 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7a5f327b-83d4-4fa3-81d0-f8356a84dcba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13772c55e89f4fac90ea7066d896d5e3', 'request_id': 'req-7a5f327b-83d4-4fa3-81d0-f8356a84dcba'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:01:50.077362 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7a5f327b-83d4-4fa3-81d0-f8356a84dcba admin admin] The token cache is being invalidate because project 13772c55e89f4fac90ea7066d896d5e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:01:50.077649 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7a5f327b-83d4-4fa3-81d0-f8356a84dcba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:01:50.078743 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7a5f327b-83d4-4fa3-81d0-f8356a84dcba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:01:50.081232 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1260/2508] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:01:49 2022] DELETE /identity/v3/projects/13772c55e89f4fac90ea7066d896d5e3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:01:50.088332 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d76a5-8a4b-489c-b1c4-a199f2a80443 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:50.088639 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d76a5-8a4b-489c-b1c4-a199f2a80443 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:50.088917 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d76a5-8a4b-489c-b1c4-a199f2a80443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:50.107339 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-2b2d76a5-8a4b-489c-b1c4-a199f2a80443 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:01:50.108530 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-2b2d76a5-8a4b-489c-b1c4-a199f2a80443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:01:50.125820 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:01:50.179514 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1249/2509] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:01:50.188060 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32754faf-1509-4c22-8af7-a8ade8672752 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:50.188346 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32754faf-1509-4c22-8af7-a8ade8672752 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:50.188626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32754faf-1509-4c22-8af7-a8ade8672752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:50.208314 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-32754faf-1509-4c22-8af7-a8ade8672752 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:01:50.209533 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-32754faf-1509-4c22-8af7-a8ade8672752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:01:50.219091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1261/2510] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:01:50.224261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d76a5-8a4b-489c-b1c4-a199f2a80443 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:01:50.240343 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d76a5-8a4b-489c-b1c4-a199f2a80443 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:01:50.247724 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6759a20-15b4-4ae2-be53-1082194dc152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:01:50.248395 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6759a20-15b4-4ae2-be53-1082194dc152 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:50.248685 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6759a20-15b4-4ae2-be53-1082194dc152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:50.248960 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6759a20-15b4-4ae2-be53-1082194dc152 admin admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:50.249697 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6759a20-15b4-4ae2-be53-1082194dc152 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 11:01:50.250005 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6759a20-15b4-4ae2-be53-1082194dc152 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:01:50.251644 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6759a20-15b4-4ae2-be53-1082194dc152 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:01:50.264398 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1250/2511] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 11:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 11:01:50.268763 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32754faf-1509-4c22-8af7-a8ade8672752 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:01:50.278505 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32754faf-1509-4c22-8af7-a8ade8672752 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:01:50.283428 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb278e6-1e90-4ea1-828a-74f225a557b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:01:50.284112 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb278e6-1e90-4ea1-828a-74f225a557b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:50.284399 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb278e6-1e90-4ea1-828a-74f225a557b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:50.284687 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb278e6-1e90-4ea1-828a-74f225a557b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:50.285399 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb278e6-1e90-4ea1-828a-74f225a557b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:01:50.287357 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb278e6-1e90-4ea1-828a-74f225a557b2 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:01:50.314310 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1262/2512] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:01:50 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:01:50.318458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6759a20-15b4-4ae2-be53-1082194dc152 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:01:50.329678 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6759a20-15b4-4ae2-be53-1082194dc152 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:01:50.389934 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524aff35-6c8a-4216-b38a-137c43974a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:01:50.390609 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524aff35-6c8a-4216-b38a-137c43974a0e admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:50.390926 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524aff35-6c8a-4216-b38a-137c43974a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:50.391197 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524aff35-6c8a-4216-b38a-137c43974a0e admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:50.391941 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524aff35-6c8a-4216-b38a-137c43974a0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:01:50.393870 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524aff35-6c8a-4216-b38a-137c43974a0e admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:01:50.415824 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1251/2513] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:01:50 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:01:50.420078 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb278e6-1e90-4ea1-828a-74f225a557b2 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:01:50.431103 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb278e6-1e90-4ea1-828a-74f225a557b2 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:01:50.437203 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3abed-1c4e-4576-8dad-bb56ed6d7dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:01:50.437864 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3abed-1c4e-4576-8dad-bb56ed6d7dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:50.438155 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3abed-1c4e-4576-8dad-bb56ed6d7dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:50.438413 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3abed-1c4e-4576-8dad-bb56ed6d7dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:50.439136 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3abed-1c4e-4576-8dad-bb56ed6d7dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:01:50.440834 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3abed-1c4e-4576-8dad-bb56ed6d7dc9 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:01:50.452812 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1263/2514] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:01:50.456947 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524aff35-6c8a-4216-b38a-137c43974a0e admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:01:50.468199 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524aff35-6c8a-4216-b38a-137c43974a0e admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:01:50.473465 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acaf857-3187-436d-aaf4-c5e85b6b24f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:01:50.474134 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acaf857-3187-436d-aaf4-c5e85b6b24f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:50.474432 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acaf857-3187-436d-aaf4-c5e85b6b24f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:50.474707 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acaf857-3187-436d-aaf4-c5e85b6b24f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:50.475450 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acaf857-3187-436d-aaf4-c5e85b6b24f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:01:50.477049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acaf857-3187-436d-aaf4-c5e85b6b24f6 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:01:50.487918 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1252/2515] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:01:50.492191 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3abed-1c4e-4576-8dad-bb56ed6d7dc9 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:01:50.502795 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3abed-1c4e-4576-8dad-bb56ed6d7dc9 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:01:50.507789 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cc8dc-13a8-4977-babf-acdd04acfe98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:01:50.508718 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cc8dc-13a8-4977-babf-acdd04acfe98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:50.509000 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cc8dc-13a8-4977-babf-acdd04acfe98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:50.509277 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cc8dc-13a8-4977-babf-acdd04acfe98 admin admin] PATH_INFO: `/v3/projects/fc6f775f98bb44fa984b09910cb16d85/users/028af403ea68430f8457a9f36f6dd4da/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:50.525171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5cc8dc-13a8-4977-babf-acdd04acfe98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc6f775f98bb44fa984b09910cb16d85, user_id=028af403ea68430f8457a9f36f6dd4da, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:01:50.528081 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5cc8dc-13a8-4977-babf-acdd04acfe98 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:01:50.543029 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1264/2516] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:01:50 2022] PUT /identity/v3/projects/fc6f775f98bb44fa984b09910cb16d85/users/028af403ea68430f8457a9f36f6dd4da/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:01:50.548205 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a678fde-7d9a-4d73-83ee-90621874964d None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:50.548863 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a678fde-7d9a-4d73-83ee-90621874964d None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:50.549160 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a678fde-7d9a-4d73-83ee-90621874964d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:50.568042 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-7a678fde-7d9a-4d73-83ee-90621874964d None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:01:50.569318 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-7a678fde-7d9a-4d73-83ee-90621874964d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:01:50.631631 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1253/2517] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:01:50.641440 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cc8dc-13a8-4977-babf-acdd04acfe98 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:01:50.643290 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-ba5cc8dc-13a8-4977-babf-acdd04acfe98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:01:50.666085 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:01:50.706125 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cc8dc-13a8-4977-babf-acdd04acfe98 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:01:50.710459 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60dab6d-fad0-4e9f-b591-a5440b51d1d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:01:50.711116 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dab6d-fad0-4e9f-b591-a5440b51d1d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:50.711427 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dab6d-fad0-4e9f-b591-a5440b51d1d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:50.711705 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dab6d-fad0-4e9f-b591-a5440b51d1d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:50.721439 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60dab6d-fad0-4e9f-b591-a5440b51d1d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:01:50.722851 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60dab6d-fad0-4e9f-b591-a5440b51d1d8 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:01:50.732796 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1265/2518] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:01:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:01:54.909137 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666cb16-ef1e-4aa9-8a82-70fb0fb7a987 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:54.909695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666cb16-ef1e-4aa9-8a82-70fb0fb7a987 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:54.909695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666cb16-ef1e-4aa9-8a82-70fb0fb7a987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:54.938033 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-3666cb16-ef1e-4aa9-8a82-70fb0fb7a987 None None] MFA Rules not processed for user `028af403ea68430f8457a9f36f6dd4da`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:01:54.939375 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-3666cb16-ef1e-4aa9-8a82-70fb0fb7a987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:01:54.960065 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:01:55.012019 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1254/2519] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:01:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:01:55.016518 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60dab6d-fad0-4e9f-b591-a5440b51d1d8 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:01:55.030140 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60dab6d-fad0-4e9f-b591-a5440b51d1d8 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:01:55.035039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd220d-e087-4e23-9339-3856148b5f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:01:55.035820 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd220d-e087-4e23-9339-3856148b5f78 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:55.036126 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd220d-e087-4e23-9339-3856148b5f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:55.036415 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd220d-e087-4e23-9339-3856148b5f78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:55.037123 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd220d-e087-4e23-9339-3856148b5f78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:01:55.039052 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd220d-e087-4e23-9339-3856148b5f78 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:01:55.071193 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1266/2520] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:01:55 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 11:01:55.073331 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666cb16-ef1e-4aa9-8a82-70fb0fb7a987 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:01:55.086073 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666cb16-ef1e-4aa9-8a82-70fb0fb7a987 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:01:55.159448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843bd94-32e5-440a-a99e-47da5765c2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:01:55.160469 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843bd94-32e5-440a-a99e-47da5765c2ac admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:55.160684 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843bd94-32e5-440a-a99e-47da5765c2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:55.160968 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843bd94-32e5-440a-a99e-47da5765c2ac admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:55.161673 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9843bd94-32e5-440a-a99e-47da5765c2ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:01:55.163807 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9843bd94-32e5-440a-a99e-47da5765c2ac admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:01:55.187595 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1255/2521] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:01:55 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:01:55.191731 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd220d-e087-4e23-9339-3856148b5f78 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:01:55.202653 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd220d-e087-4e23-9339-3856148b5f78 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:01:55.207167 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060e411-e217-449a-a28c-fbc09b04eb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:01:55.207839 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060e411-e217-449a-a28c-fbc09b04eb85 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:55.208156 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060e411-e217-449a-a28c-fbc09b04eb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:55.208429 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060e411-e217-449a-a28c-fbc09b04eb85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:55.209250 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060e411-e217-449a-a28c-fbc09b04eb85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:01:55.210735 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060e411-e217-449a-a28c-fbc09b04eb85 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:01:55.222116 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1267/2522] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:01:55.226641 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843bd94-32e5-440a-a99e-47da5765c2ac admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:01:55.238295 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843bd94-32e5-440a-a99e-47da5765c2ac admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:01:55.249998 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee2d56-b807-44a1-9042-6340df4bea78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:01:55.249998 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee2d56-b807-44a1-9042-6340df4bea78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:55.249998 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee2d56-b807-44a1-9042-6340df4bea78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:55.249998 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee2d56-b807-44a1-9042-6340df4bea78 admin admin] PATH_INFO: `/v3/projects/b00a3a8dfdaa4ff68a7a4ef68481d010/users/1f9477eeb4d1492192868792554a4260/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:55.273049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee2d56-b807-44a1-9042-6340df4bea78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b00a3a8dfdaa4ff68a7a4ef68481d010, user_id=1f9477eeb4d1492192868792554a4260, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:01:55.276196 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee2d56-b807-44a1-9042-6340df4bea78 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:01:55.305117 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1256/2523] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:01:55 2022] PUT /identity/v3/projects/b00a3a8dfdaa4ff68a7a4ef68481d010/users/1f9477eeb4d1492192868792554a4260/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:01:55.310827 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060e411-e217-449a-a28c-fbc09b04eb85 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:01:55.322413 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060e411-e217-449a-a28c-fbc09b04eb85 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:01:55.389651 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc8e65-c024-4130-972c-29a82abebca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:01:55.390337 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc8e65-c024-4130-972c-29a82abebca5 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:55.390618 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc8e65-c024-4130-972c-29a82abebca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:55.390892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc8e65-c024-4130-972c-29a82abebca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:55.391953 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc8e65-c024-4130-972c-29a82abebca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:01:55.393509 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc8e65-c024-4130-972c-29a82abebca5 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:01:55.408405 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1268/2524] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:01:55.409876 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee2d56-b807-44a1-9042-6340df4bea78 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:01:55.421586 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee2d56-b807-44a1-9042-6340df4bea78 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:01:55.426886 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd93403-aeb2-452e-86db-49f8662ab7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:01:55.427827 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd93403-aeb2-452e-86db-49f8662ab7ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:55.428115 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd93403-aeb2-452e-86db-49f8662ab7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:55.428391 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd93403-aeb2-452e-86db-49f8662ab7ee admin admin] PATH_INFO: `/v3/projects/b00a3a8dfdaa4ff68a7a4ef68481d010/users/1f9477eeb4d1492192868792554a4260/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:55.430405 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd93403-aeb2-452e-86db-49f8662ab7ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=b00a3a8dfdaa4ff68a7a4ef68481d010, user_id=1f9477eeb4d1492192868792554a4260, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:01:55.433251 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd93403-aeb2-452e-86db-49f8662ab7ee admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:01:55.444680 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1257/2525] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:01:55 2022] PUT /identity/v3/projects/b00a3a8dfdaa4ff68a7a4ef68481d010/users/1f9477eeb4d1492192868792554a4260/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:01:59.097147 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09418247-84ef-410a-813b-48117e715f96 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:59.098103 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09418247-84ef-410a-813b-48117e715f96 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:59.098390 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09418247-84ef-410a-813b-48117e715f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:59.127139 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-09418247-84ef-410a-813b-48117e715f96 None None] MFA Rules not processed for user `4dfddd72dfa84ce39fe62112224b425d`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:01:59.128450 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-09418247-84ef-410a-813b-48117e715f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:01:59.212532 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1269/2526] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jun 24 11:01:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:01:59.270225 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd93403-aeb2-452e-86db-49f8662ab7ee admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:01:59.272180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-5bd93403-aeb2-452e-86db-49f8662ab7ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:01:59.365244 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd93403-aeb2-452e-86db-49f8662ab7ee admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:01:59.371332 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578237c5-ccd3-4e40-bc90-6370390a0f73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff592d9ebd4241019625828ddd41aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:01:59.372286 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578237c5-ccd3-4e40-bc90-6370390a0f73 service swift] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:01:59.372738 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578237c5-ccd3-4e40-bc90-6370390a0f73 service swift] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:01:59.373276 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578237c5-ccd3-4e40-bc90-6370390a0f73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:01:59.384492 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578237c5-ccd3-4e40-bc90-6370390a0f73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:01:59.386649 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578237c5-ccd3-4e40-bc90-6370390a0f73 service swift] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:01:59.394409 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:01:59.411873 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1258/2527] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jun 24 11:01:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 11:02:00.304025 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00ccce-0950-44de-94ea-e0ce6bc5808c None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:02:00.304987 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00ccce-0950-44de-94ea-e0ce6bc5808c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:02:00.305428 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00ccce-0950-44de-94ea-e0ce6bc5808c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:02:00.344253 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-8a00ccce-0950-44de-94ea-e0ce6bc5808c None None] MFA Rules not processed for user `1f9477eeb4d1492192868792554a4260`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:02:00.345565 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-8a00ccce-0950-44de-94ea-e0ce6bc5808c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:02:00.369590 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:02:00.448531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1270/2528] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:02:00 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:02:00.461619 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578237c5-ccd3-4e40-bc90-6370390a0f73 service swift] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:02:00.463118 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-578237c5-ccd3-4e40-bc90-6370390a0f73 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:02:00.563119 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578237c5-ccd3-4e40-bc90-6370390a0f73 service swift] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:02:00.570364 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5ce87-e785-436a-9fc8-6566a0a54692 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:02:00.571487 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5ce87-e785-436a-9fc8-6566a0a54692 service nova] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:02:00.571923 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5ce87-e785-436a-9fc8-6566a0a54692 service nova] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:02:00.572422 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5ce87-e785-436a-9fc8-6566a0a54692 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:02:00.646994 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5ce87-e785-436a-9fc8-6566a0a54692 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:02:00.649042 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5ce87-e785-436a-9fc8-6566a0a54692 service nova] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:02:00.673329 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1259/2529] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:02:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:02:02.269690 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7860b8d-c492-49a4-8173-6aaa1bc1326c None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:02:02.270200 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7860b8d-c492-49a4-8173-6aaa1bc1326c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:02:02.270355 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7860b8d-c492-49a4-8173-6aaa1bc1326c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:02:02.290599 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-f7860b8d-c492-49a4-8173-6aaa1bc1326c None None] MFA Rules not processed for user `028af403ea68430f8457a9f36f6dd4da`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:02:02.293073 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-f7860b8d-c492-49a4-8173-6aaa1bc1326c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:02:02.303206 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1271/2530] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:02:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:02:10.665483 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=56 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:02:12.284892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=23 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:02:17.521504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f809c13-d4f5-4842-b75d-157329098d2d None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:02:17.521504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f809c13-d4f5-4842-b75d-157329098d2d None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:02:17.521504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f809c13-d4f5-4842-b75d-157329098d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:02:17.543178 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-4f809c13-d4f5-4842-b75d-157329098d2d None None] MFA Rules not processed for user `4dfddd72dfa84ce39fe62112224b425d`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:02:17.545216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-4f809c13-d4f5-4842-b75d-157329098d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:02:17.555180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1260/2531] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jun 24 11:02:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 11:02:17.570056 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7860b8d-c492-49a4-8173-6aaa1bc1326c None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:02:17.583988 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7860b8d-c492-49a4-8173-6aaa1bc1326c None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:02:17.589756 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18091a99-efa6-4e92-a3cc-bb114f7ca2ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff592d9ebd4241019625828ddd41aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:02:17.590753 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18091a99-efa6-4e92-a3cc-bb114f7ca2ce service swift] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:02:17.591251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18091a99-efa6-4e92-a3cc-bb114f7ca2ce service swift] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:02:17.591691 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18091a99-efa6-4e92-a3cc-bb114f7ca2ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:02:17.601695 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18091a99-efa6-4e92-a3cc-bb114f7ca2ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:02:17.603744 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18091a99-efa6-4e92-a3cc-bb114f7ca2ce service swift] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:02:17.615581 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1272/2532] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jun 24 11:02:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 11:02:27.536907 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:02:27.610152 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=6 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:02:30.547772 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f809c13-d4f5-4842-b75d-157329098d2d None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:02:30.550859 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-4f809c13-d4f5-4842-b75d-157329098d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:02:30.616307 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f809c13-d4f5-4842-b75d-157329098d2d None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:02:30.620930 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79109ef-cedd-4d90-b9f8-543b17b7f284 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:02:30.621593 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79109ef-cedd-4d90-b9f8-543b17b7f284 service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:02:30.621874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79109ef-cedd-4d90-b9f8-543b17b7f284 service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:02:30.622149 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79109ef-cedd-4d90-b9f8-543b17b7f284 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:02:30.624740 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-a79109ef-cedd-4d90-b9f8-543b17b7f284 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:02:30.687976 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79109ef-cedd-4d90-b9f8-543b17b7f284 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:02:30.689425 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79109ef-cedd-4d90-b9f8-543b17b7f284 service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:02:30.698719 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1261/2533] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:02:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:02:39.750630 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa4ccc-f6ba-4457-8688-52705c9f5f7b None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:02:39.751188 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa4ccc-f6ba-4457-8688-52705c9f5f7b None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:02:39.751188 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa4ccc-f6ba-4457-8688-52705c9f5f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:02:39.771365 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-b0aa4ccc-f6ba-4457-8688-52705c9f5f7b None None] MFA Rules not processed for user `4dfddd72dfa84ce39fe62112224b425d`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:02:39.772598 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b0aa4ccc-f6ba-4457-8688-52705c9f5f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:02:39.780153 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1273/2534] 10.222.0.16 () {58 vars in 967 bytes} [Fri Jun 24 11:02:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:02:39.792632 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79109ef-cedd-4d90-b9f8-543b17b7f284 service cinder] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:02:39.804610 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79109ef-cedd-4d90-b9f8-543b17b7f284 service cinder] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:02:39.809434 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0bf33-a4f2-48cf-b811-1513d3385355 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff592d9ebd4241019625828ddd41aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:02:39.810082 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0bf33-a4f2-48cf-b811-1513d3385355 service swift] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:02:39.810361 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0bf33-a4f2-48cf-b811-1513d3385355 service swift] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:02:39.810632 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0bf33-a4f2-48cf-b811-1513d3385355 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:02:39.818787 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0bf33-a4f2-48cf-b811-1513d3385355 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:02:39.820398 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0bf33-a4f2-48cf-b811-1513d3385355 service swift] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:02:39.829034 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1262/2535] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jun 24 11:02:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 11:02:41.790751 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b85ce-a6ef-4692-90cc-edb495ec6a0c None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:02:41.791353 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b85ce-a6ef-4692-90cc-edb495ec6a0c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:02:41.791353 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b85ce-a6ef-4692-90cc-edb495ec6a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:02:41.811452 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-0d2b85ce-a6ef-4692-90cc-edb495ec6a0c None None] MFA Rules not processed for user `0e97d164a02b49a79e4299be4debf774`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:02:41.812688 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-0d2b85ce-a6ef-4692-90cc-edb495ec6a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:02:41.823883 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1274/2536] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:02:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:02:49.825233 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=54 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:02:51.805483 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=6 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:02:57.789906 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0bf33-a4f2-48cf-b811-1513d3385355 service swift] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:02:57.791466 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-f1a0bf33-a4f2-48cf-b811-1513d3385355 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:02:57.853122 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0bf33-a4f2-48cf-b811-1513d3385355 service swift] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:02:57.857242 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a141f1e-96fb-4b62-959b-cd3da7ee0e17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:02:57.857916 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a141f1e-96fb-4b62-959b-cd3da7ee0e17 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:02:57.858198 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a141f1e-96fb-4b62-959b-cd3da7ee0e17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:02:57.858474 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a141f1e-96fb-4b62-959b-cd3da7ee0e17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:02:57.868013 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a141f1e-96fb-4b62-959b-cd3da7ee0e17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:02:57.869471 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a141f1e-96fb-4b62-959b-cd3da7ee0e17 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:02:57.878778 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1263/2537] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:02:57 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:03:01.346632 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b85ce-a6ef-4692-90cc-edb495ec6a0c None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:01.358915 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b85ce-a6ef-4692-90cc-edb495ec6a0c None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:01.362643 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52772a-8e59-4533-bf00-e3cbdd1c6cdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:01.363455 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52772a-8e59-4533-bf00-e3cbdd1c6cdf service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:01.363813 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52772a-8e59-4533-bf00-e3cbdd1c6cdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:01.364162 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52772a-8e59-4533-bf00-e3cbdd1c6cdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:01.366333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5c52772a-8e59-4533-bf00-e3cbdd1c6cdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:01.434819 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c52772a-8e59-4533-bf00-e3cbdd1c6cdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:01.437011 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c52772a-8e59-4533-bf00-e3cbdd1c6cdf service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:01.448604 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1275/2538] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:03:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:03:07.874584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=26 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:08.966394 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a141f1e-96fb-4b62-959b-cd3da7ee0e17 service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:08.975826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a141f1e-96fb-4b62-959b-cd3da7ee0e17 service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:08.980516 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8ea50-0dbc-475f-b9c4-21b4b740a734 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:08.981205 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8ea50-0dbc-475f-b9c4-21b4b740a734 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:08.981463 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8ea50-0dbc-475f-b9c4-21b4b740a734 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:08.981768 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8ea50-0dbc-475f-b9c4-21b4b740a734 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:08.983957 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-06c8ea50-0dbc-475f-b9c4-21b4b740a734 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:09.053036 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8ea50-0dbc-475f-b9c4-21b4b740a734 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:09.054476 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8ea50-0dbc-475f-b9c4-21b4b740a734 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:09.064543 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1264/2539] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:03:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:03:11.442916 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=30 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:12.318174 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52772a-8e59-4533-bf00-e3cbdd1c6cdf service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:12.319819 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5c52772a-8e59-4533-bf00-e3cbdd1c6cdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:12.334629 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52772a-8e59-4533-bf00-e3cbdd1c6cdf service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:12.339632 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe086d7-6603-49e3-9ddf-9c1b1aa0a2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:12.340537 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe086d7-6603-49e3-9ddf-9c1b1aa0a2ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:12.340822 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe086d7-6603-49e3-9ddf-9c1b1aa0a2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:12.341103 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe086d7-6603-49e3-9ddf-9c1b1aa0a2ae admin admin] PATH_INFO: `/v3/users/94d5d8610e67494dbebf53c4ed560504` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:12.356841 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe086d7-6603-49e3-9ddf-9c1b1aa0a2ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=94d5d8610e67494dbebf53c4ed560504)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:12.359010 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe086d7-6603-49e3-9ddf-9c1b1aa0a2ae admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:12.410388 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-ebe086d7-6603-49e3-9ddf-9c1b1aa0a2ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94d5d8610e67494dbebf53c4ed560504'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:12.417571 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-ebe086d7-6603-49e3-9ddf-9c1b1aa0a2ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94d5d8610e67494dbebf53c4ed560504'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:12.425104 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-ebe086d7-6603-49e3-9ddf-9c1b1aa0a2ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94d5d8610e67494dbebf53c4ed560504'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:12.425809 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-ebe086d7-6603-49e3-9ddf-9c1b1aa0a2ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94d5d8610e67494dbebf53c4ed560504'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:12.438895 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-ebe086d7-6603-49e3-9ddf-9c1b1aa0a2ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94d5d8610e67494dbebf53c4ed560504'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:12.445342 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1276/2540] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:03:12 2022] DELETE /identity/v3/users/94d5d8610e67494dbebf53c4ed560504 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:12.641054 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8ea50-0dbc-475f-b9c4-21b4b740a734 service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:12.652180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8ea50-0dbc-475f-b9c4-21b4b740a734 service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:12.711265 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734996a0-95c7-4103-84f9-0d495688d0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:12.712136 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734996a0-95c7-4103-84f9-0d495688d0ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:12.712609 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734996a0-95c7-4103-84f9-0d495688d0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:12.712892 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734996a0-95c7-4103-84f9-0d495688d0ee admin admin] PATH_INFO: `/v3/projects/add514f35d2c48a894cdf3a2b7401e82` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:12.724004 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734996a0-95c7-4103-84f9-0d495688d0ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=add514f35d2c48a894cdf3a2b7401e82)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:12.725931 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734996a0-95c7-4103-84f9-0d495688d0ee admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:12.773427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-734996a0-95c7-4103-84f9-0d495688d0ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'add514f35d2c48a894cdf3a2b7401e82', 'request_id': 'req-734996a0-95c7-4103-84f9-0d495688d0ee'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:12.781771 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-734996a0-95c7-4103-84f9-0d495688d0ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'add514f35d2c48a894cdf3a2b7401e82', 'request_id': 'req-734996a0-95c7-4103-84f9-0d495688d0ee'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:12.788157 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-734996a0-95c7-4103-84f9-0d495688d0ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'add514f35d2c48a894cdf3a2b7401e82', 'request_id': 'req-734996a0-95c7-4103-84f9-0d495688d0ee'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:12.800119 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-734996a0-95c7-4103-84f9-0d495688d0ee admin admin] The token cache is being invalidate because project add514f35d2c48a894cdf3a2b7401e82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:03:12.800404 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-734996a0-95c7-4103-84f9-0d495688d0ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:12.801086 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-734996a0-95c7-4103-84f9-0d495688d0ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:12.802672 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1265/2541] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:03:12 2022] DELETE /identity/v3/projects/add514f35d2c48a894cdf3a2b7401e82 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:12.808215 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb15a70-9ced-4fca-9b27-b3b646b1a312 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:12.808709 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb15a70-9ced-4fca-9b27-b3b646b1a312 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:12.809263 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb15a70-9ced-4fca-9b27-b3b646b1a312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:12.832985 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-3bb15a70-9ced-4fca-9b27-b3b646b1a312 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:12.834111 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-3bb15a70-9ced-4fca-9b27-b3b646b1a312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:12.907730 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1277/2542] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:12.916898 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e51d2-b2bd-4c09-a4bf-bfc84bff83e3 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:12.917547 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e51d2-b2bd-4c09-a4bf-bfc84bff83e3 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:12.918173 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e51d2-b2bd-4c09-a4bf-bfc84bff83e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:12.937524 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-019e51d2-b2bd-4c09-a4bf-bfc84bff83e3 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:12.938718 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-019e51d2-b2bd-4c09-a4bf-bfc84bff83e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:12.947483 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1266/2543] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:12.952521 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb15a70-9ced-4fca-9b27-b3b646b1a312 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:12.968099 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb15a70-9ced-4fca-9b27-b3b646b1a312 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:12.976483 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93594705-c76c-45db-8ab1-c7fc95c38185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:12.977515 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93594705-c76c-45db-8ab1-c7fc95c38185 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:12.977864 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93594705-c76c-45db-8ab1-c7fc95c38185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:12.978326 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93594705-c76c-45db-8ab1-c7fc95c38185 admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:12.979065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93594705-c76c-45db-8ab1-c7fc95c38185 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 11:03:12.979401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93594705-c76c-45db-8ab1-c7fc95c38185 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:12.981017 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93594705-c76c-45db-8ab1-c7fc95c38185 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:12.992890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1278/2544] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 11:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 11:03:12.997139 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e51d2-b2bd-4c09-a4bf-bfc84bff83e3 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:13.006966 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e51d2-b2bd-4c09-a4bf-bfc84bff83e3 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:13.012770 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f65707-87ea-4d4a-a7a6-8323e6b35565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:13.013445 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f65707-87ea-4d4a-a7a6-8323e6b35565 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:13.013711 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f65707-87ea-4d4a-a7a6-8323e6b35565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:13.013982 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f65707-87ea-4d4a-a7a6-8323e6b35565 admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:13.014666 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f65707-87ea-4d4a-a7a6-8323e6b35565 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:13.016612 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f65707-87ea-4d4a-a7a6-8323e6b35565 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:13.020984 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:13.051177 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1267/2545] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:03:12 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 11:03:13.055698 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93594705-c76c-45db-8ab1-c7fc95c38185 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:13.066638 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93594705-c76c-45db-8ab1-c7fc95c38185 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:13.113450 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:13.128243 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575d120-1a6e-4976-a19d-fd46237296fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:13.128911 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575d120-1a6e-4976-a19d-fd46237296fa admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:13.129192 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575d120-1a6e-4976-a19d-fd46237296fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:13.129493 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575d120-1a6e-4976-a19d-fd46237296fa admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:13.130183 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575d120-1a6e-4976-a19d-fd46237296fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:13.132143 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575d120-1a6e-4976-a19d-fd46237296fa admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:13.154931 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1279/2546] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:03:13 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:03:13.159340 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f65707-87ea-4d4a-a7a6-8323e6b35565 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:13.169972 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f65707-87ea-4d4a-a7a6-8323e6b35565 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:13.176374 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd3acd-52f1-4b27-9d73-2ffc0957aa0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:13.177004 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd3acd-52f1-4b27-9d73-2ffc0957aa0b admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:13.177303 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd3acd-52f1-4b27-9d73-2ffc0957aa0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:13.177571 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd3acd-52f1-4b27-9d73-2ffc0957aa0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:13.178301 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd3acd-52f1-4b27-9d73-2ffc0957aa0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:13.179947 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd3acd-52f1-4b27-9d73-2ffc0957aa0b admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:13.190947 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1268/2547] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:03:13.195100 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575d120-1a6e-4976-a19d-fd46237296fa admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:13.205965 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575d120-1a6e-4976-a19d-fd46237296fa admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:13.211010 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7f9df-b2c8-4da8-a216-2a99ef47c568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:13.211740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7f9df-b2c8-4da8-a216-2a99ef47c568 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:13.212023 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7f9df-b2c8-4da8-a216-2a99ef47c568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:13.212431 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7f9df-b2c8-4da8-a216-2a99ef47c568 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:13.213780 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7f9df-b2c8-4da8-a216-2a99ef47c568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:13.215618 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7f9df-b2c8-4da8-a216-2a99ef47c568 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:13.226790 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1280/2548] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:03:13.231638 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd3acd-52f1-4b27-9d73-2ffc0957aa0b admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:13.242257 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd3acd-52f1-4b27-9d73-2ffc0957aa0b admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:13.247694 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e174ec8-df21-4f2e-bde1-c8e0477846a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:13.248587 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e174ec8-df21-4f2e-bde1-c8e0477846a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:13.248867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e174ec8-df21-4f2e-bde1-c8e0477846a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:13.249141 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e174ec8-df21-4f2e-bde1-c8e0477846a1 admin admin] PATH_INFO: `/v3/projects/9de3ab9f7aae48ea86b3a5dd36d58618/users/a36e081d5de746a38f574820b0fc77db/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:13.264906 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e174ec8-df21-4f2e-bde1-c8e0477846a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9de3ab9f7aae48ea86b3a5dd36d58618, user_id=a36e081d5de746a38f574820b0fc77db, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:13.267602 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e174ec8-df21-4f2e-bde1-c8e0477846a1 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:13.282804 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1269/2549] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:03:13 2022] PUT /identity/v3/projects/9de3ab9f7aae48ea86b3a5dd36d58618/users/a36e081d5de746a38f574820b0fc77db/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:13.296036 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aea7e6-b797-4067-b51a-7546ae827f52 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:13.296405 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aea7e6-b797-4067-b51a-7546ae827f52 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:13.296875 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aea7e6-b797-4067-b51a-7546ae827f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:13.329152 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-46aea7e6-b797-4067-b51a-7546ae827f52 None None] MFA Rules not processed for user `a36e081d5de746a38f574820b0fc77db`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:13.330372 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-46aea7e6-b797-4067-b51a-7546ae827f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:13.398202 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1281/2550] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:13 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 11:03:13.409501 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e174ec8-df21-4f2e-bde1-c8e0477846a1 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:13.411399 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-9e174ec8-df21-4f2e-bde1-c8e0477846a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:13.470691 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e174ec8-df21-4f2e-bde1-c8e0477846a1 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:13.474568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb461e1b-b00d-4bd7-b1f8-4a72331c0f3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:13.475262 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb461e1b-b00d-4bd7-b1f8-4a72331c0f3f service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:13.475547 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb461e1b-b00d-4bd7-b1f8-4a72331c0f3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:13.475822 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb461e1b-b00d-4bd7-b1f8-4a72331c0f3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:13.484762 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb461e1b-b00d-4bd7-b1f8-4a72331c0f3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:13.486179 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb461e1b-b00d-4bd7-b1f8-4a72331c0f3f service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:13.495243 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1270/2551] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:03:13 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:03:14.891367 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aea7e6-b797-4067-b51a-7546ae827f52 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:14.893937 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-46aea7e6-b797-4067-b51a-7546ae827f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:14.909443 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aea7e6-b797-4067-b51a-7546ae827f52 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:14.913910 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929d44a-dac9-4f8f-b127-fbd52870e448 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:14.914562 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929d44a-dac9-4f8f-b127-fbd52870e448 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:14.914844 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929d44a-dac9-4f8f-b127-fbd52870e448 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:14.915117 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929d44a-dac9-4f8f-b127-fbd52870e448 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:14.917454 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e929d44a-dac9-4f8f-b127-fbd52870e448 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:15.005900 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929d44a-dac9-4f8f-b127-fbd52870e448 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:15.007954 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929d44a-dac9-4f8f-b127-fbd52870e448 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:15.020176 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1282/2552] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:03:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:03:16.435855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb461e1b-b00d-4bd7-b1f8-4a72331c0f3f service cinder] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:16.445306 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb461e1b-b00d-4bd7-b1f8-4a72331c0f3f service cinder] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:16.450134 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2682f-d86f-4753-90c9-ce86cbe15084 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:16.450935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2682f-d86f-4753-90c9-ce86cbe15084 service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:16.451355 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2682f-d86f-4753-90c9-ce86cbe15084 service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:16.451459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2682f-d86f-4753-90c9-ce86cbe15084 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:16.453783 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-bdc2682f-d86f-4753-90c9-ce86cbe15084 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:16.468025 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2682f-d86f-4753-90c9-ce86cbe15084 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:16.469478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2682f-d86f-4753-90c9-ce86cbe15084 service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:16.480592 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1271/2553] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:03:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:03:22.142888 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929d44a-dac9-4f8f-b127-fbd52870e448 service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:22.188950 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:22.214752 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929d44a-dac9-4f8f-b127-fbd52870e448 service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:22.222606 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a7f26-3dd4-4ddf-9576-3ae8b745d783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:22.223535 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a7f26-3dd4-4ddf-9576-3ae8b745d783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:22.223814 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a7f26-3dd4-4ddf-9576-3ae8b745d783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:22.224092 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a7f26-3dd4-4ddf-9576-3ae8b745d783 admin admin] PATH_INFO: `/v3/users/a36e081d5de746a38f574820b0fc77db` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:22.225440 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a7f26-3dd4-4ddf-9576-3ae8b745d783 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a36e081d5de746a38f574820b0fc77db)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:22.227418 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a7f26-3dd4-4ddf-9576-3ae8b745d783 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:22.279833 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d44a7f26-3dd4-4ddf-9576-3ae8b745d783 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a36e081d5de746a38f574820b0fc77db'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:22.286984 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d44a7f26-3dd4-4ddf-9576-3ae8b745d783 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a36e081d5de746a38f574820b0fc77db'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:22.298623 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d44a7f26-3dd4-4ddf-9576-3ae8b745d783 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a36e081d5de746a38f574820b0fc77db'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:22.299315 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d44a7f26-3dd4-4ddf-9576-3ae8b745d783 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a36e081d5de746a38f574820b0fc77db'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:22.312751 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d44a7f26-3dd4-4ddf-9576-3ae8b745d783 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a36e081d5de746a38f574820b0fc77db'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:22.319062 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1283/2554] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:03:22 2022] DELETE /identity/v3/users/a36e081d5de746a38f574820b0fc77db => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:22.324298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bb14e-971c-4c33-ae6a-6691d8b518cb None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:22.324822 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bb14e-971c-4c33-ae6a-6691d8b518cb None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:22.324919 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bb14e-971c-4c33-ae6a-6691d8b518cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:22.342922 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-2b4bb14e-971c-4c33-ae6a-6691d8b518cb None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:22.344429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-2b4bb14e-971c-4c33-ae6a-6691d8b518cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:22.407698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1272/2555] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:22.417572 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a7f26-3dd4-4ddf-9576-3ae8b745d783 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:22.419337 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-d44a7f26-3dd4-4ddf-9576-3ae8b745d783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:22.481693 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a7f26-3dd4-4ddf-9576-3ae8b745d783 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:22.486614 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc66dd0-0380-4b04-918f-00793c87c529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:22.487292 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc66dd0-0380-4b04-918f-00793c87c529 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:22.487576 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc66dd0-0380-4b04-918f-00793c87c529 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:22.487847 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc66dd0-0380-4b04-918f-00793c87c529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:22.497324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc66dd0-0380-4b04-918f-00793c87c529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:22.498747 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc66dd0-0380-4b04-918f-00793c87c529 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:22.508622 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1284/2556] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:03:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:03:22.797700 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bb14e-971c-4c33-ae6a-6691d8b518cb None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:22.799685 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-2b4bb14e-971c-4c33-ae6a-6691d8b518cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:22.814563 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bb14e-971c-4c33-ae6a-6691d8b518cb None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:22.820437 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd1a16-80b9-442a-8d6d-c6465d0ec664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:22.821432 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd1a16-80b9-442a-8d6d-c6465d0ec664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:22.821820 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd1a16-80b9-442a-8d6d-c6465d0ec664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:22.822156 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd1a16-80b9-442a-8d6d-c6465d0ec664 admin admin] PATH_INFO: `/v3/projects/9de3ab9f7aae48ea86b3a5dd36d58618` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:22.824039 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd1a16-80b9-442a-8d6d-c6465d0ec664 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9de3ab9f7aae48ea86b3a5dd36d58618)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:22.825989 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd1a16-80b9-442a-8d6d-c6465d0ec664 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:22.866737 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:22.877728 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-53cd1a16-80b9-442a-8d6d-c6465d0ec664 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9de3ab9f7aae48ea86b3a5dd36d58618', 'request_id': 'req-53cd1a16-80b9-442a-8d6d-c6465d0ec664'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:22.885390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-53cd1a16-80b9-442a-8d6d-c6465d0ec664 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9de3ab9f7aae48ea86b3a5dd36d58618', 'request_id': 'req-53cd1a16-80b9-442a-8d6d-c6465d0ec664'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:22.891088 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-53cd1a16-80b9-442a-8d6d-c6465d0ec664 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9de3ab9f7aae48ea86b3a5dd36d58618', 'request_id': 'req-53cd1a16-80b9-442a-8d6d-c6465d0ec664'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:22.902233 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-53cd1a16-80b9-442a-8d6d-c6465d0ec664 admin admin] The token cache is being invalidate because project 9de3ab9f7aae48ea86b3a5dd36d58618 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:03:22.902525 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-53cd1a16-80b9-442a-8d6d-c6465d0ec664 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:22.903278 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-53cd1a16-80b9-442a-8d6d-c6465d0ec664 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:22.904914 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1273/2557] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:03:22 2022] DELETE /identity/v3/projects/9de3ab9f7aae48ea86b3a5dd36d58618 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:22.910408 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d572037-404c-44d9-9cd3-73f2468cf3d0 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:22.910659 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d572037-404c-44d9-9cd3-73f2468cf3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:22.910926 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d572037-404c-44d9-9cd3-73f2468cf3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:22.929571 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-6d572037-404c-44d9-9cd3-73f2468cf3d0 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:22.931087 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6d572037-404c-44d9-9cd3-73f2468cf3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:23.003253 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1285/2558] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:23.011286 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddc487-43fd-43df-8295-3c9fa0c5d06a None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:23.011678 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddc487-43fd-43df-8295-3c9fa0c5d06a None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:23.011962 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddc487-43fd-43df-8295-3c9fa0c5d06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:23.033383 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-73ddc487-43fd-43df-8295-3c9fa0c5d06a None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:23.034633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-73ddc487-43fd-43df-8295-3c9fa0c5d06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:23.044353 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1274/2559] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:23.049333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d572037-404c-44d9-9cd3-73f2468cf3d0 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:23.055740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:23.059830 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d572037-404c-44d9-9cd3-73f2468cf3d0 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:23.067283 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c203d21-c9c1-45f2-a4d8-a25446e2a022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:23.067960 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c203d21-c9c1-45f2-a4d8-a25446e2a022 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:23.068248 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c203d21-c9c1-45f2-a4d8-a25446e2a022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:23.068538 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c203d21-c9c1-45f2-a4d8-a25446e2a022 admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:23.069534 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c203d21-c9c1-45f2-a4d8-a25446e2a022 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 11:03:23.069871 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c203d21-c9c1-45f2-a4d8-a25446e2a022 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:23.072036 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c203d21-c9c1-45f2-a4d8-a25446e2a022 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:23.084428 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1286/2560] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 11:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 11:03:23.089037 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ddc487-43fd-43df-8295-3c9fa0c5d06a None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:23.098857 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ddc487-43fd-43df-8295-3c9fa0c5d06a None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:23.105118 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17769c-37ae-4581-af00-beee50c30447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:23.105811 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17769c-37ae-4581-af00-beee50c30447 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:23.106094 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17769c-37ae-4581-af00-beee50c30447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:23.106365 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17769c-37ae-4581-af00-beee50c30447 admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:23.107054 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc17769c-37ae-4581-af00-beee50c30447 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:23.108972 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc17769c-37ae-4581-af00-beee50c30447 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:23.143421 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1275/2561] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:03:23 2022] POST /identity/v3/projects => generated 405 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:03:23.148449 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c203d21-c9c1-45f2-a4d8-a25446e2a022 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:23.158773 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c203d21-c9c1-45f2-a4d8-a25446e2a022 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:23.225644 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c8368-ed75-489e-b8de-20bd4c605010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:23.226256 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c8368-ed75-489e-b8de-20bd4c605010 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:23.226542 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c8368-ed75-489e-b8de-20bd4c605010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:23.226824 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c8368-ed75-489e-b8de-20bd4c605010 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:23.227535 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c8368-ed75-489e-b8de-20bd4c605010 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:23.229480 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c8368-ed75-489e-b8de-20bd4c605010 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:23.250593 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1287/2562] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:03:23 2022] POST /identity/v3/users => generated 303 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:03:23.255086 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17769c-37ae-4581-af00-beee50c30447 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:23.266106 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17769c-37ae-4581-af00-beee50c30447 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:23.271410 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4e789-43dd-4fa3-9a4a-a3a4d32a488e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:23.272093 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4e789-43dd-4fa3-9a4a-a3a4d32a488e admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:23.272381 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4e789-43dd-4fa3-9a4a-a3a4d32a488e admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:23.272657 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4e789-43dd-4fa3-9a4a-a3a4d32a488e admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:23.273399 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af4e789-43dd-4fa3-9a4a-a3a4d32a488e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:23.275019 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af4e789-43dd-4fa3-9a4a-a3a4d32a488e admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:23.286870 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1276/2563] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:03:23.290931 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c8368-ed75-489e-b8de-20bd4c605010 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:23.302186 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c8368-ed75-489e-b8de-20bd4c605010 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:23.307638 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c94b70-d087-4ec2-8525-07f648bfbcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:23.308315 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c94b70-d087-4ec2-8525-07f648bfbcb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:23.308603 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c94b70-d087-4ec2-8525-07f648bfbcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:23.308886 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c94b70-d087-4ec2-8525-07f648bfbcb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:23.309624 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c94b70-d087-4ec2-8525-07f648bfbcb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:23.311270 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c94b70-d087-4ec2-8525-07f648bfbcb4 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:23.322151 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1288/2564] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:03:23.326296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4e789-43dd-4fa3-9a4a-a3a4d32a488e admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:23.337598 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4e789-43dd-4fa3-9a4a-a3a4d32a488e admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:23.342558 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85804931-9baf-4ef9-9558-fe7690752a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:23.343505 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85804931-9baf-4ef9-9558-fe7690752a8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:23.343790 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85804931-9baf-4ef9-9558-fe7690752a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:23.344064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85804931-9baf-4ef9-9558-fe7690752a8f admin admin] PATH_INFO: `/v3/projects/726fc8c3a45f4644997ae7225551bee5/users/8e84b3a1043645a983136052a3cbf75f/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:23.359918 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85804931-9baf-4ef9-9558-fe7690752a8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=726fc8c3a45f4644997ae7225551bee5, user_id=8e84b3a1043645a983136052a3cbf75f, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:23.362875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85804931-9baf-4ef9-9558-fe7690752a8f admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:23.378150 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1277/2565] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:03:23 2022] PUT /identity/v3/projects/726fc8c3a45f4644997ae7225551bee5/users/8e84b3a1043645a983136052a3cbf75f/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:23.389926 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579b861-5595-4df8-a6aa-eef7a8be72b3 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:23.390214 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579b861-5595-4df8-a6aa-eef7a8be72b3 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:23.390501 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579b861-5595-4df8-a6aa-eef7a8be72b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:23.418820 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-3579b861-5595-4df8-a6aa-eef7a8be72b3 None None] MFA Rules not processed for user `8e84b3a1043645a983136052a3cbf75f`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:23.420089 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-3579b861-5595-4df8-a6aa-eef7a8be72b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:23.490650 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1289/2566] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:23 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:23.495235 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85804931-9baf-4ef9-9558-fe7690752a8f admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:23.561465 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85804931-9baf-4ef9-9558-fe7690752a8f admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:23.567116 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b11403-153d-4a08-93c3-601ac6a480b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:23.567811 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b11403-153d-4a08-93c3-601ac6a480b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:23.568091 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b11403-153d-4a08-93c3-601ac6a480b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:23.568366 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b11403-153d-4a08-93c3-601ac6a480b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:23.569036 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b11403-153d-4a08-93c3-601ac6a480b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:23.570941 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b11403-153d-4a08-93c3-601ac6a480b9 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:23.602109 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1278/2567] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:03:23 2022] POST /identity/v3/projects => generated 403 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:03:23.606300 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579b861-5595-4df8-a6aa-eef7a8be72b3 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:23.617881 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579b861-5595-4df8-a6aa-eef7a8be72b3 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:23.679760 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22cceff-edcc-44e5-a5f6-2c1997fa3328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:23.680446 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cceff-edcc-44e5-a5f6-2c1997fa3328 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:23.680734 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cceff-edcc-44e5-a5f6-2c1997fa3328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:23.681012 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cceff-edcc-44e5-a5f6-2c1997fa3328 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:23.681716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22cceff-edcc-44e5-a5f6-2c1997fa3328 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:23.683675 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22cceff-edcc-44e5-a5f6-2c1997fa3328 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:23.690366 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:23.706005 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1290/2568] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:03:23 2022] POST /identity/v3/users => generated 308 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:03:23.710469 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b11403-153d-4a08-93c3-601ac6a480b9 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:23.721255 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b11403-153d-4a08-93c3-601ac6a480b9 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:23.727050 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21445c10-65a7-4fe2-972b-154e302dc27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:23.727741 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21445c10-65a7-4fe2-972b-154e302dc27a admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:23.728026 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21445c10-65a7-4fe2-972b-154e302dc27a admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:23.728304 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21445c10-65a7-4fe2-972b-154e302dc27a admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:23.729035 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21445c10-65a7-4fe2-972b-154e302dc27a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:23.730668 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21445c10-65a7-4fe2-972b-154e302dc27a admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:23.742731 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1279/2569] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:03:23.748783 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22cceff-edcc-44e5-a5f6-2c1997fa3328 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:23.763642 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22cceff-edcc-44e5-a5f6-2c1997fa3328 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:23.770825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03696c51-70be-40c6-950d-26d06c9a1b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:23.771777 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03696c51-70be-40c6-950d-26d06c9a1b9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:23.772061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03696c51-70be-40c6-950d-26d06c9a1b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:23.772341 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03696c51-70be-40c6-950d-26d06c9a1b9f admin admin] PATH_INFO: `/v3/projects/bb452218ef0645f9ab51367617407b89/users/ec244bb7600048839ac008991c38f9a9/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:23.788530 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03696c51-70be-40c6-950d-26d06c9a1b9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb452218ef0645f9ab51367617407b89, user_id=ec244bb7600048839ac008991c38f9a9, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:23.791179 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03696c51-70be-40c6-950d-26d06c9a1b9f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:23.807743 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1291/2570] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:03:23 2022] PUT /identity/v3/projects/bb452218ef0645f9ab51367617407b89/users/ec244bb7600048839ac008991c38f9a9/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:23.811916 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21445c10-65a7-4fe2-972b-154e302dc27a admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:23.822544 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21445c10-65a7-4fe2-972b-154e302dc27a admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:23.856112 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:23.884215 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55020214-a134-4a65-9345-18689839888b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:23.884886 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55020214-a134-4a65-9345-18689839888b admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:23.885173 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55020214-a134-4a65-9345-18689839888b admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:23.885452 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55020214-a134-4a65-9345-18689839888b admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:23.886185 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55020214-a134-4a65-9345-18689839888b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:23.887846 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55020214-a134-4a65-9345-18689839888b admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:23.898785 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1280/2571] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:03:23.903373 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03696c51-70be-40c6-950d-26d06c9a1b9f admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:23.914396 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03696c51-70be-40c6-950d-26d06c9a1b9f admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:23.920260 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b3998-9d8c-4ff1-bb6e-8554115781f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:23.921163 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b3998-9d8c-4ff1-bb6e-8554115781f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:23.921449 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b3998-9d8c-4ff1-bb6e-8554115781f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:23.921729 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b3998-9d8c-4ff1-bb6e-8554115781f9 admin admin] PATH_INFO: `/v3/projects/bb452218ef0645f9ab51367617407b89/users/ec244bb7600048839ac008991c38f9a9/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:23.924448 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b3998-9d8c-4ff1-bb6e-8554115781f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb452218ef0645f9ab51367617407b89, user_id=ec244bb7600048839ac008991c38f9a9, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:23.927326 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b3998-9d8c-4ff1-bb6e-8554115781f9 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:23.939654 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1292/2572] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:03:23 2022] PUT /identity/v3/projects/bb452218ef0645f9ab51367617407b89/users/ec244bb7600048839ac008991c38f9a9/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:23.954867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6609eb4-5812-4035-8274-41b0405ab2d5 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:23.955178 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6609eb4-5812-4035-8274-41b0405ab2d5 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:23.955570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6609eb4-5812-4035-8274-41b0405ab2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:23.984156 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-d6609eb4-5812-4035-8274-41b0405ab2d5 None None] MFA Rules not processed for user `ec244bb7600048839ac008991c38f9a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:23.985357 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-d6609eb4-5812-4035-8274-41b0405ab2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:24.057939 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1281/2573] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:23 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:24.069249 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b3998-9d8c-4ff1-bb6e-8554115781f9 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:24.071454 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-187b3998-9d8c-4ff1-bb6e-8554115781f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:24.132123 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b3998-9d8c-4ff1-bb6e-8554115781f9 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:24.136205 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13025fd-6102-4ea8-a948-7477032ff426 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:24.136881 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13025fd-6102-4ea8-a948-7477032ff426 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:24.137175 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13025fd-6102-4ea8-a948-7477032ff426 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:24.137450 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13025fd-6102-4ea8-a948-7477032ff426 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:24.147000 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13025fd-6102-4ea8-a948-7477032ff426 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:24.148458 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13025fd-6102-4ea8-a948-7477032ff426 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:24.158100 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1293/2574] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:03:24 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:03:24.293979 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6609eb4-5812-4035-8274-41b0405ab2d5 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:24.359673 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6609eb4-5812-4035-8274-41b0405ab2d5 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:24.364975 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437a1a2-f0ad-4b14-8241-0603431edb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:24.365860 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437a1a2-f0ad-4b14-8241-0603431edb06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:24.366141 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437a1a2-f0ad-4b14-8241-0603431edb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:24.366441 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437a1a2-f0ad-4b14-8241-0603431edb06 admin admin] PATH_INFO: `/v3/users/8e84b3a1043645a983136052a3cbf75f` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:24.367670 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437a1a2-f0ad-4b14-8241-0603431edb06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e84b3a1043645a983136052a3cbf75f)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:24.370079 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437a1a2-f0ad-4b14-8241-0603431edb06 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:24.424974 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a437a1a2-f0ad-4b14-8241-0603431edb06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e84b3a1043645a983136052a3cbf75f'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:24.432429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a437a1a2-f0ad-4b14-8241-0603431edb06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e84b3a1043645a983136052a3cbf75f'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:24.435032 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:24.441407 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a437a1a2-f0ad-4b14-8241-0603431edb06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e84b3a1043645a983136052a3cbf75f'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:24.442664 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a437a1a2-f0ad-4b14-8241-0603431edb06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e84b3a1043645a983136052a3cbf75f'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:24.455381 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a437a1a2-f0ad-4b14-8241-0603431edb06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e84b3a1043645a983136052a3cbf75f'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:24.461743 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1282/2575] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:03:24 2022] DELETE /identity/v3/users/8e84b3a1043645a983136052a3cbf75f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:24.466392 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c692709-ca9d-4530-b41d-1cd67580d965 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:24.466703 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c692709-ca9d-4530-b41d-1cd67580d965 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:24.466980 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c692709-ca9d-4530-b41d-1cd67580d965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:24.485459 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-3c692709-ca9d-4530-b41d-1cd67580d965 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:24.486639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-3c692709-ca9d-4530-b41d-1cd67580d965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:24.551190 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1294/2576] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:24.561275 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437a1a2-f0ad-4b14-8241-0603431edb06 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:24.562806 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-a437a1a2-f0ad-4b14-8241-0603431edb06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:24.622278 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437a1a2-f0ad-4b14-8241-0603431edb06 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:24.626438 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9776eee-a56c-4875-a8c1-ca9a3d1f49b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:24.627104 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9776eee-a56c-4875-a8c1-ca9a3d1f49b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:24.627427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9776eee-a56c-4875-a8c1-ca9a3d1f49b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:24.627704 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9776eee-a56c-4875-a8c1-ca9a3d1f49b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:24.637836 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9776eee-a56c-4875-a8c1-ca9a3d1f49b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:24.639308 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9776eee-a56c-4875-a8c1-ca9a3d1f49b7 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:24.649765 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1283/2577] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:03:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:03:24.938793 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c692709-ca9d-4530-b41d-1cd67580d965 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:24.940352 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-3c692709-ca9d-4530-b41d-1cd67580d965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:24.953128 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c692709-ca9d-4530-b41d-1cd67580d965 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:24.958225 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281ed56-91c0-42ca-8c70-80eb5c86d02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:24.959295 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281ed56-91c0-42ca-8c70-80eb5c86d02f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:24.959583 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281ed56-91c0-42ca-8c70-80eb5c86d02f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:24.959863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281ed56-91c0-42ca-8c70-80eb5c86d02f admin admin] PATH_INFO: `/v3/projects/726fc8c3a45f4644997ae7225551bee5` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:24.961156 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281ed56-91c0-42ca-8c70-80eb5c86d02f admin admin] RBAC: Authorizing `identity:delete_project(project_id=726fc8c3a45f4644997ae7225551bee5)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:24.963089 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281ed56-91c0-42ca-8c70-80eb5c86d02f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:25.015937 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6281ed56-91c0-42ca-8c70-80eb5c86d02f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '726fc8c3a45f4644997ae7225551bee5', 'request_id': 'req-6281ed56-91c0-42ca-8c70-80eb5c86d02f'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:25.017621 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:25.025973 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6281ed56-91c0-42ca-8c70-80eb5c86d02f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '726fc8c3a45f4644997ae7225551bee5', 'request_id': 'req-6281ed56-91c0-42ca-8c70-80eb5c86d02f'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:25.032988 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6281ed56-91c0-42ca-8c70-80eb5c86d02f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '726fc8c3a45f4644997ae7225551bee5', 'request_id': 'req-6281ed56-91c0-42ca-8c70-80eb5c86d02f'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:25.044282 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6281ed56-91c0-42ca-8c70-80eb5c86d02f admin admin] The token cache is being invalidate because project 726fc8c3a45f4644997ae7225551bee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:03:25.044571 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6281ed56-91c0-42ca-8c70-80eb5c86d02f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:25.045219 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6281ed56-91c0-42ca-8c70-80eb5c86d02f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:25.047257 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1295/2578] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:03:24 2022] DELETE /identity/v3/projects/726fc8c3a45f4644997ae7225551bee5 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:25.051511 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9776eee-a56c-4875-a8c1-ca9a3d1f49b7 service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:25.061669 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9776eee-a56c-4875-a8c1-ca9a3d1f49b7 service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:25.123065 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0184cc-4ab2-441e-84fa-af47702ae8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:25.123986 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0184cc-4ab2-441e-84fa-af47702ae8c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:25.124267 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0184cc-4ab2-441e-84fa-af47702ae8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:25.124543 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0184cc-4ab2-441e-84fa-af47702ae8c7 admin admin] PATH_INFO: `/v3/users/ec244bb7600048839ac008991c38f9a9` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:25.125825 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0184cc-4ab2-441e-84fa-af47702ae8c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec244bb7600048839ac008991c38f9a9)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:25.127948 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0184cc-4ab2-441e-84fa-af47702ae8c7 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:25.179550 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-cd0184cc-4ab2-441e-84fa-af47702ae8c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec244bb7600048839ac008991c38f9a9'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:25.186633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-cd0184cc-4ab2-441e-84fa-af47702ae8c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec244bb7600048839ac008991c38f9a9'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:25.195478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-cd0184cc-4ab2-441e-84fa-af47702ae8c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec244bb7600048839ac008991c38f9a9'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:25.196196 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-cd0184cc-4ab2-441e-84fa-af47702ae8c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec244bb7600048839ac008991c38f9a9'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:25.208723 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-cd0184cc-4ab2-441e-84fa-af47702ae8c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec244bb7600048839ac008991c38f9a9'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:25.210203 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:25.215657 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1284/2579] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:03:25 2022] DELETE /identity/v3/users/ec244bb7600048839ac008991c38f9a9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:25.510966 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281ed56-91c0-42ca-8c70-80eb5c86d02f admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:25.512539 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6281ed56-91c0-42ca-8c70-80eb5c86d02f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:25.526947 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281ed56-91c0-42ca-8c70-80eb5c86d02f admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:25.586156 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd88ed-bf6c-453f-bc4c-8c49714fac82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:25.587063 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd88ed-bf6c-453f-bc4c-8c49714fac82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:25.587372 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd88ed-bf6c-453f-bc4c-8c49714fac82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:25.587649 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd88ed-bf6c-453f-bc4c-8c49714fac82 admin admin] PATH_INFO: `/v3/projects/bb452218ef0645f9ab51367617407b89` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:25.588870 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd88ed-bf6c-453f-bc4c-8c49714fac82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb452218ef0645f9ab51367617407b89)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:25.590778 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd88ed-bf6c-453f-bc4c-8c49714fac82 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:25.652059 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-4bfd88ed-bf6c-453f-bc4c-8c49714fac82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb452218ef0645f9ab51367617407b89', 'request_id': 'req-4bfd88ed-bf6c-453f-bc4c-8c49714fac82'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:25.661073 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-4bfd88ed-bf6c-453f-bc4c-8c49714fac82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb452218ef0645f9ab51367617407b89', 'request_id': 'req-4bfd88ed-bf6c-453f-bc4c-8c49714fac82'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:25.667551 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-4bfd88ed-bf6c-453f-bc4c-8c49714fac82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb452218ef0645f9ab51367617407b89', 'request_id': 'req-4bfd88ed-bf6c-453f-bc4c-8c49714fac82'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:25.680525 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-4bfd88ed-bf6c-453f-bc4c-8c49714fac82 admin admin] The token cache is being invalidate because project bb452218ef0645f9ab51367617407b89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:03:25.680813 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-4bfd88ed-bf6c-453f-bc4c-8c49714fac82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:25.681520 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-4bfd88ed-bf6c-453f-bc4c-8c49714fac82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:25.683185 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1296/2580] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:03:25 2022] DELETE /identity/v3/projects/bb452218ef0645f9ab51367617407b89 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 11:03:25.688388 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81af7ff-5c03-4bfe-8836-bde5d32ed4fc None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:25.688910 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81af7ff-5c03-4bfe-8836-bde5d32ed4fc None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:25.688910 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81af7ff-5c03-4bfe-8836-bde5d32ed4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:25.708626 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-b81af7ff-5c03-4bfe-8836-bde5d32ed4fc None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:25.709776 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-b81af7ff-5c03-4bfe-8836-bde5d32ed4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:25.777320 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1285/2581] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:25.785694 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94484732-92c3-4f0d-ade3-8626824e19d0 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:25.786141 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94484732-92c3-4f0d-ade3-8626824e19d0 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:25.787015 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94484732-92c3-4f0d-ade3-8626824e19d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:25.813967 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-94484732-92c3-4f0d-ade3-8626824e19d0 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:25.815531 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-94484732-92c3-4f0d-ade3-8626824e19d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:25.826794 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1297/2582] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:25.834677 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81af7ff-5c03-4bfe-8836-bde5d32ed4fc None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:25.850621 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81af7ff-5c03-4bfe-8836-bde5d32ed4fc None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:25.856208 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69e84b-ee23-42d9-a44d-8acfcb7e8740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:25.856886 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69e84b-ee23-42d9-a44d-8acfcb7e8740 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:25.857178 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69e84b-ee23-42d9-a44d-8acfcb7e8740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:25.857462 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69e84b-ee23-42d9-a44d-8acfcb7e8740 admin admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:25.858197 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69e84b-ee23-42d9-a44d-8acfcb7e8740 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 11:03:25.858511 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69e84b-ee23-42d9-a44d-8acfcb7e8740 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:25.860232 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69e84b-ee23-42d9-a44d-8acfcb7e8740 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:25.872938 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1286/2583] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 11:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 11:03:25.877446 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94484732-92c3-4f0d-ade3-8626824e19d0 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:25.887361 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94484732-92c3-4f0d-ade3-8626824e19d0 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:25.893310 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ae6cf-408e-4fb3-9cbf-3045e985a47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:25.893963 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ae6cf-408e-4fb3-9cbf-3045e985a47d admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:25.894243 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ae6cf-408e-4fb3-9cbf-3045e985a47d admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:25.894522 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ae6cf-408e-4fb3-9cbf-3045e985a47d admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:25.895276 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ae6cf-408e-4fb3-9cbf-3045e985a47d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:25.897346 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ae6cf-408e-4fb3-9cbf-3045e985a47d admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:25.925598 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1298/2584] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:03:25 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:03:25.930355 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69e84b-ee23-42d9-a44d-8acfcb7e8740 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:25.941614 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69e84b-ee23-42d9-a44d-8acfcb7e8740 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:26.003374 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314391cc-3046-40ff-bb7d-71eb02af7c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:26.004296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314391cc-3046-40ff-bb7d-71eb02af7c51 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:26.004718 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314391cc-3046-40ff-bb7d-71eb02af7c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:26.005245 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314391cc-3046-40ff-bb7d-71eb02af7c51 admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:26.006126 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314391cc-3046-40ff-bb7d-71eb02af7c51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:26.009191 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314391cc-3046-40ff-bb7d-71eb02af7c51 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:26.035861 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1287/2585] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:03:25 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:03:26.042010 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ae6cf-408e-4fb3-9cbf-3045e985a47d admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:26.052807 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ae6cf-408e-4fb3-9cbf-3045e985a47d admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:26.057526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75b9ce-3d9e-4424-90b0-61b9af585332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:26.058188 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75b9ce-3d9e-4424-90b0-61b9af585332 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:26.058472 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75b9ce-3d9e-4424-90b0-61b9af585332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:26.058748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75b9ce-3d9e-4424-90b0-61b9af585332 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:26.059822 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75b9ce-3d9e-4424-90b0-61b9af585332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:26.061200 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75b9ce-3d9e-4424-90b0-61b9af585332 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:26.074395 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1299/2586] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:03:26.078937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314391cc-3046-40ff-bb7d-71eb02af7c51 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:26.090654 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314391cc-3046-40ff-bb7d-71eb02af7c51 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:26.096575 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5021782-2424-481f-ac57-986b7cccaadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:26.097337 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5021782-2424-481f-ac57-986b7cccaadb admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:26.097622 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5021782-2424-481f-ac57-986b7cccaadb admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:26.097900 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5021782-2424-481f-ac57-986b7cccaadb admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:26.099049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5021782-2424-481f-ac57-986b7cccaadb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:26.100709 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5021782-2424-481f-ac57-986b7cccaadb admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:26.111617 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1288/2587] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:03:26.117243 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75b9ce-3d9e-4424-90b0-61b9af585332 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:26.130703 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75b9ce-3d9e-4424-90b0-61b9af585332 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:26.136639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6321dab-4a3e-4de9-82b0-574567434bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:26.137557 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6321dab-4a3e-4de9-82b0-574567434bbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:26.137845 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6321dab-4a3e-4de9-82b0-574567434bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:26.138110 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6321dab-4a3e-4de9-82b0-574567434bbc admin admin] PATH_INFO: `/v3/projects/78195ca696c445cf995213177fcacf9a/users/99db4bb6e53b4104a4cf4dcf17d357d2/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:26.153942 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6321dab-4a3e-4de9-82b0-574567434bbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=78195ca696c445cf995213177fcacf9a, user_id=99db4bb6e53b4104a4cf4dcf17d357d2, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:26.156618 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6321dab-4a3e-4de9-82b0-574567434bbc admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:26.172786 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1300/2588] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:03:26 2022] PUT /identity/v3/projects/78195ca696c445cf995213177fcacf9a/users/99db4bb6e53b4104a4cf4dcf17d357d2/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 11:03:26.184797 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1b506-a4a0-417c-b93e-487f9ad18df1 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:26.185097 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1b506-a4a0-417c-b93e-487f9ad18df1 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:26.185357 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1b506-a4a0-417c-b93e-487f9ad18df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:26.212899 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-6ce1b506-a4a0-417c-b93e-487f9ad18df1 None None] MFA Rules not processed for user `99db4bb6e53b4104a4cf4dcf17d357d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:26.214106 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-6ce1b506-a4a0-417c-b93e-487f9ad18df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:26.271131 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:26.283085 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1289/2589] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:26.288533 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6321dab-4a3e-4de9-82b0-574567434bbc admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:26.298473 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:26.360239 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6321dab-4a3e-4de9-82b0-574567434bbc admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:26.365414 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9205fc-2c72-4de5-aa53-37da8efe2085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:26.366089 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9205fc-2c72-4de5-aa53-37da8efe2085 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:26.366376 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9205fc-2c72-4de5-aa53-37da8efe2085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:26.366656 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9205fc-2c72-4de5-aa53-37da8efe2085 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:26.367387 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9205fc-2c72-4de5-aa53-37da8efe2085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:26.369308 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9205fc-2c72-4de5-aa53-37da8efe2085 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:26.403695 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1301/2590] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:03:26 2022] POST /identity/v3/projects => generated 365 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:03:26.407979 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1b506-a4a0-417c-b93e-487f9ad18df1 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:26.420487 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1b506-a4a0-417c-b93e-487f9ad18df1 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:26.490015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82d4e7-e0a4-4589-9482-dfd1b1e27e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:26.490701 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82d4e7-e0a4-4589-9482-dfd1b1e27e3d admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:26.490986 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82d4e7-e0a4-4589-9482-dfd1b1e27e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:26.491308 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82d4e7-e0a4-4589-9482-dfd1b1e27e3d admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:26.492057 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82d4e7-e0a4-4589-9482-dfd1b1e27e3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:26.493978 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82d4e7-e0a4-4589-9482-dfd1b1e27e3d admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:26.516354 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1290/2591] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:03:26 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:03:26.520475 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9205fc-2c72-4de5-aa53-37da8efe2085 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:26.531455 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9205fc-2c72-4de5-aa53-37da8efe2085 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:26.537028 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867468b4-c2af-40cb-8db6-1036d10c67c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:26.537720 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867468b4-c2af-40cb-8db6-1036d10c67c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:26.537988 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867468b4-c2af-40cb-8db6-1036d10c67c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:26.538263 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867468b4-c2af-40cb-8db6-1036d10c67c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:26.539012 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867468b4-c2af-40cb-8db6-1036d10c67c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:26.540654 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867468b4-c2af-40cb-8db6-1036d10c67c1 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:26.552225 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1302/2592] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:03:26.556586 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82d4e7-e0a4-4589-9482-dfd1b1e27e3d admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:26.567059 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82d4e7-e0a4-4589-9482-dfd1b1e27e3d admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:26.573132 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b574c8e-01f6-4330-9da8-03a1a7412eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:26.574056 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b574c8e-01f6-4330-9da8-03a1a7412eed admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:26.574337 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b574c8e-01f6-4330-9da8-03a1a7412eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:26.574609 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b574c8e-01f6-4330-9da8-03a1a7412eed admin admin] PATH_INFO: `/v3/projects/0df15cc63f174088a9ad40c9443e53d4/users/1723baf09d2f4996a271c1e08cfe94f6/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:26.592315 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b574c8e-01f6-4330-9da8-03a1a7412eed admin admin] RBAC: Authorizing `identity:create_grant(project_id=0df15cc63f174088a9ad40c9443e53d4, user_id=1723baf09d2f4996a271c1e08cfe94f6, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:26.596743 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b574c8e-01f6-4330-9da8-03a1a7412eed admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:26.613901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1291/2593] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:03:26 2022] PUT /identity/v3/projects/0df15cc63f174088a9ad40c9443e53d4/users/1723baf09d2f4996a271c1e08cfe94f6/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:26.618166 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867468b4-c2af-40cb-8db6-1036d10c67c1 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:26.629824 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867468b4-c2af-40cb-8db6-1036d10c67c1 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:26.689808 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8d9fc-99d8-4be6-baee-3d4ec9eb6dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:26.690511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8d9fc-99d8-4be6-baee-3d4ec9eb6dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:26.690799 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8d9fc-99d8-4be6-baee-3d4ec9eb6dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:26.691063 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8d9fc-99d8-4be6-baee-3d4ec9eb6dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:26.691835 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8d9fc-99d8-4be6-baee-3d4ec9eb6dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:26.693899 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8d9fc-99d8-4be6-baee-3d4ec9eb6dc0 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:26.707506 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1303/2594] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:03:26.712119 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b574c8e-01f6-4330-9da8-03a1a7412eed admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:26.723031 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b574c8e-01f6-4330-9da8-03a1a7412eed admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:26.728394 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39da184-e03a-4b87-934c-b4a28be2db9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:26.729285 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39da184-e03a-4b87-934c-b4a28be2db9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:26.729566 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39da184-e03a-4b87-934c-b4a28be2db9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:26.729839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39da184-e03a-4b87-934c-b4a28be2db9d admin admin] PATH_INFO: `/v3/projects/0df15cc63f174088a9ad40c9443e53d4/users/1723baf09d2f4996a271c1e08cfe94f6/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:26.731944 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39da184-e03a-4b87-934c-b4a28be2db9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0df15cc63f174088a9ad40c9443e53d4, user_id=1723baf09d2f4996a271c1e08cfe94f6, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:26.734574 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39da184-e03a-4b87-934c-b4a28be2db9d admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:26.746957 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1292/2595] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:03:26 2022] PUT /identity/v3/projects/0df15cc63f174088a9ad40c9443e53d4/users/1723baf09d2f4996a271c1e08cfe94f6/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:26.767727 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee70922-f127-4fe6-931e-c5464972ad71 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:26.768114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee70922-f127-4fe6-931e-c5464972ad71 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:26.768575 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee70922-f127-4fe6-931e-c5464972ad71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:26.800297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-cee70922-f127-4fe6-931e-c5464972ad71 None None] MFA Rules not processed for user `1723baf09d2f4996a271c1e08cfe94f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:26.801853 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-cee70922-f127-4fe6-931e-c5464972ad71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:26.870464 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:26.874885 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1304/2596] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:26 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:26.886440 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39da184-e03a-4b87-934c-b4a28be2db9d admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:26.888296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-c39da184-e03a-4b87-934c-b4a28be2db9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:26.950213 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39da184-e03a-4b87-934c-b4a28be2db9d admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:26.954652 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f047928-1e08-4c65-a5c9-8e312ac27600 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:26.955339 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f047928-1e08-4c65-a5c9-8e312ac27600 service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:26.955618 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f047928-1e08-4c65-a5c9-8e312ac27600 service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:26.955893 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f047928-1e08-4c65-a5c9-8e312ac27600 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:26.965558 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f047928-1e08-4c65-a5c9-8e312ac27600 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:26.966988 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f047928-1e08-4c65-a5c9-8e312ac27600 service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:26.976837 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1293/2597] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:03:26 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:03:27.053304 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee70922-f127-4fe6-931e-c5464972ad71 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:27.064065 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee70922-f127-4fe6-931e-c5464972ad71 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:27.068994 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f9c17-1ce0-4189-8336-26984007f1fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:27.080333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f9c17-1ce0-4189-8336-26984007f1fe service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:27.080670 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f9c17-1ce0-4189-8336-26984007f1fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:27.080954 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f9c17-1ce0-4189-8336-26984007f1fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:27.161540 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f9c17-1ce0-4189-8336-26984007f1fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:27.163179 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f9c17-1ce0-4189-8336-26984007f1fe service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:27.173005 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1305/2598] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:03:27 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:03:29.920490 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f047928-1e08-4c65-a5c9-8e312ac27600 service cinder] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:29.970676 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:29.986116 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f047928-1e08-4c65-a5c9-8e312ac27600 service cinder] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:29.991263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c39dde-3eb7-4857-a2d6-1f3b373ec9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:29.992147 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c39dde-3eb7-4857-a2d6-1f3b373ec9ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:29.992433 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c39dde-3eb7-4857-a2d6-1f3b373ec9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:29.992708 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c39dde-3eb7-4857-a2d6-1f3b373ec9ab admin admin] PATH_INFO: `/v3/users/99db4bb6e53b4104a4cf4dcf17d357d2` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:29.993965 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c39dde-3eb7-4857-a2d6-1f3b373ec9ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=99db4bb6e53b4104a4cf4dcf17d357d2)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:29.995932 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c39dde-3eb7-4857-a2d6-1f3b373ec9ab admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:30.047943 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-c0c39dde-3eb7-4857-a2d6-1f3b373ec9ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99db4bb6e53b4104a4cf4dcf17d357d2'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:30.055330 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-c0c39dde-3eb7-4857-a2d6-1f3b373ec9ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99db4bb6e53b4104a4cf4dcf17d357d2'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:30.066141 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-c0c39dde-3eb7-4857-a2d6-1f3b373ec9ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99db4bb6e53b4104a4cf4dcf17d357d2'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:30.066874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-c0c39dde-3eb7-4857-a2d6-1f3b373ec9ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99db4bb6e53b4104a4cf4dcf17d357d2'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:30.079318 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-c0c39dde-3eb7-4857-a2d6-1f3b373ec9ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99db4bb6e53b4104a4cf4dcf17d357d2'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:30.085420 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1294/2599] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:03:29 2022] DELETE /identity/v3/users/99db4bb6e53b4104a4cf4dcf17d357d2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:30.090189 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11629a-431b-47e5-9b19-7c3d9a51eef2 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:30.090667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11629a-431b-47e5-9b19-7c3d9a51eef2 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:30.090796 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11629a-431b-47e5-9b19-7c3d9a51eef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:30.108711 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-9c11629a-431b-47e5-9b19-7c3d9a51eef2 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:30.109854 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9c11629a-431b-47e5-9b19-7c3d9a51eef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:30.173969 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1306/2600] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:30.184520 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c39dde-3eb7-4857-a2d6-1f3b373ec9ab admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:30.186258 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-c0c39dde-3eb7-4857-a2d6-1f3b373ec9ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:30.250218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c39dde-3eb7-4857-a2d6-1f3b373ec9ab admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:30.254057 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9793ec-625a-4f83-aad6-538a0a35e391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:30.254724 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9793ec-625a-4f83-aad6-538a0a35e391 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:30.255036 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9793ec-625a-4f83-aad6-538a0a35e391 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:30.255353 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9793ec-625a-4f83-aad6-538a0a35e391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:30.265189 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9793ec-625a-4f83-aad6-538a0a35e391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:30.266621 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9793ec-625a-4f83-aad6-538a0a35e391 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:30.276268 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1295/2601] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:03:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 11:03:30.560971 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11629a-431b-47e5-9b19-7c3d9a51eef2 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:30.562427 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9c11629a-431b-47e5-9b19-7c3d9a51eef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:30.576402 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11629a-431b-47e5-9b19-7c3d9a51eef2 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:30.582061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f97bc-3b38-4ff5-81fc-4dc7f7e2a96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:30.583672 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f97bc-3b38-4ff5-81fc-4dc7f7e2a96d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:30.583959 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f97bc-3b38-4ff5-81fc-4dc7f7e2a96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:30.584232 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f97bc-3b38-4ff5-81fc-4dc7f7e2a96d admin admin] PATH_INFO: `/v3/projects/78195ca696c445cf995213177fcacf9a` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:30.586240 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f97bc-3b38-4ff5-81fc-4dc7f7e2a96d admin admin] RBAC: Authorizing `identity:delete_project(project_id=78195ca696c445cf995213177fcacf9a)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:30.588328 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f97bc-3b38-4ff5-81fc-4dc7f7e2a96d admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:30.639338 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-028f97bc-3b38-4ff5-81fc-4dc7f7e2a96d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78195ca696c445cf995213177fcacf9a', 'request_id': 'req-028f97bc-3b38-4ff5-81fc-4dc7f7e2a96d'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:30.648627 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-028f97bc-3b38-4ff5-81fc-4dc7f7e2a96d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78195ca696c445cf995213177fcacf9a', 'request_id': 'req-028f97bc-3b38-4ff5-81fc-4dc7f7e2a96d'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:30.654376 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-028f97bc-3b38-4ff5-81fc-4dc7f7e2a96d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78195ca696c445cf995213177fcacf9a', 'request_id': 'req-028f97bc-3b38-4ff5-81fc-4dc7f7e2a96d'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:30.671361 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-028f97bc-3b38-4ff5-81fc-4dc7f7e2a96d admin admin] The token cache is being invalidate because project 78195ca696c445cf995213177fcacf9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:03:30.671746 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-028f97bc-3b38-4ff5-81fc-4dc7f7e2a96d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:30.673288 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-028f97bc-3b38-4ff5-81fc-4dc7f7e2a96d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:30.675791 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1307/2602] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:03:30 2022] DELETE /identity/v3/projects/78195ca696c445cf995213177fcacf9a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:30.680088 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9793ec-625a-4f83-aad6-538a0a35e391 service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:30.690499 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9793ec-625a-4f83-aad6-538a0a35e391 service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:30.750981 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed6348-8a1c-43b7-93d5-657ace0bdaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:30.751901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed6348-8a1c-43b7-93d5-657ace0bdaba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:30.752186 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed6348-8a1c-43b7-93d5-657ace0bdaba admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:30.752465 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed6348-8a1c-43b7-93d5-657ace0bdaba admin admin] PATH_INFO: `/v3/users/1723baf09d2f4996a271c1e08cfe94f6` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:30.753812 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed6348-8a1c-43b7-93d5-657ace0bdaba admin admin] RBAC: Authorizing `identity:delete_user(user_id=1723baf09d2f4996a271c1e08cfe94f6)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:30.755813 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed6348-8a1c-43b7-93d5-657ace0bdaba admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:30.771002 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:30.806396 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-baed6348-8a1c-43b7-93d5-657ace0bdaba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1723baf09d2f4996a271c1e08cfe94f6'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:30.815178 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-baed6348-8a1c-43b7-93d5-657ace0bdaba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1723baf09d2f4996a271c1e08cfe94f6'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:30.827875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-baed6348-8a1c-43b7-93d5-657ace0bdaba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1723baf09d2f4996a271c1e08cfe94f6'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:30.828769 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-baed6348-8a1c-43b7-93d5-657ace0bdaba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1723baf09d2f4996a271c1e08cfe94f6'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:30.846395 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-baed6348-8a1c-43b7-93d5-657ace0bdaba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1723baf09d2f4996a271c1e08cfe94f6'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:30.852762 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1296/2603] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:03:30 2022] DELETE /identity/v3/users/1723baf09d2f4996a271c1e08cfe94f6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:31.130788 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f97bc-3b38-4ff5-81fc-4dc7f7e2a96d admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:31.133187 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-028f97bc-3b38-4ff5-81fc-4dc7f7e2a96d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:31.148880 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f97bc-3b38-4ff5-81fc-4dc7f7e2a96d admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:31.169535 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:31.210317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da247dc-9b32-4e41-b54f-cf8ac101427f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:31.211175 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da247dc-9b32-4e41-b54f-cf8ac101427f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:31.211464 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da247dc-9b32-4e41-b54f-cf8ac101427f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:31.211764 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da247dc-9b32-4e41-b54f-cf8ac101427f admin admin] PATH_INFO: `/v3/projects/0df15cc63f174088a9ad40c9443e53d4` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:31.213189 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da247dc-9b32-4e41-b54f-cf8ac101427f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0df15cc63f174088a9ad40c9443e53d4)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:31.215193 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da247dc-9b32-4e41-b54f-cf8ac101427f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:31.265001 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-2da247dc-9b32-4e41-b54f-cf8ac101427f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0df15cc63f174088a9ad40c9443e53d4', 'request_id': 'req-2da247dc-9b32-4e41-b54f-cf8ac101427f'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:31.273670 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-2da247dc-9b32-4e41-b54f-cf8ac101427f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0df15cc63f174088a9ad40c9443e53d4', 'request_id': 'req-2da247dc-9b32-4e41-b54f-cf8ac101427f'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:31.279306 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-2da247dc-9b32-4e41-b54f-cf8ac101427f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0df15cc63f174088a9ad40c9443e53d4', 'request_id': 'req-2da247dc-9b32-4e41-b54f-cf8ac101427f'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:31.290713 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-2da247dc-9b32-4e41-b54f-cf8ac101427f admin admin] The token cache is being invalidate because project 0df15cc63f174088a9ad40c9443e53d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:03:31.290994 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-2da247dc-9b32-4e41-b54f-cf8ac101427f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:31.291667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-2da247dc-9b32-4e41-b54f-cf8ac101427f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:31.293251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1308/2604] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:03:31 2022] DELETE /identity/v3/projects/0df15cc63f174088a9ad40c9443e53d4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:31.298646 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea1307-f3b1-44a4-b398-4ffc9b896b9d None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:31.299127 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea1307-f3b1-44a4-b398-4ffc9b896b9d None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:31.299263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea1307-f3b1-44a4-b398-4ffc9b896b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:31.320544 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-1cea1307-f3b1-44a4-b398-4ffc9b896b9d None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:31.321842 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-1cea1307-f3b1-44a4-b398-4ffc9b896b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:31.392223 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1297/2605] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:31.400652 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c4a7b-6b73-463d-b5cc-b1ffcc064ed1 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:31.400946 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c4a7b-6b73-463d-b5cc-b1ffcc064ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:31.401234 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c4a7b-6b73-463d-b5cc-b1ffcc064ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:31.419818 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-bb0c4a7b-6b73-463d-b5cc-b1ffcc064ed1 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:31.421032 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-bb0c4a7b-6b73-463d-b5cc-b1ffcc064ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:31.429926 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1309/2606] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:31.434144 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea1307-f3b1-44a4-b398-4ffc9b896b9d None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:31.446354 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea1307-f3b1-44a4-b398-4ffc9b896b9d None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:31.451793 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a5665-85d2-49b9-9e09-7878c4852c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:31.452553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a5665-85d2-49b9-9e09-7878c4852c02 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:31.452837 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a5665-85d2-49b9-9e09-7878c4852c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:31.453150 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a5665-85d2-49b9-9e09-7878c4852c02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:31.454158 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a5665-85d2-49b9-9e09-7878c4852c02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 11:03:31.454512 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a5665-85d2-49b9-9e09-7878c4852c02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:31.456173 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a5665-85d2-49b9-9e09-7878c4852c02 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:31.469097 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1298/2607] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 11:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 11:03:31.473768 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c4a7b-6b73-463d-b5cc-b1ffcc064ed1 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:31.483914 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c4a7b-6b73-463d-b5cc-b1ffcc064ed1 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:31.489822 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8882d-84b4-4f3e-80e9-d9064f378784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:31.490573 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8882d-84b4-4f3e-80e9-d9064f378784 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:31.490860 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8882d-84b4-4f3e-80e9-d9064f378784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:31.491122 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8882d-84b4-4f3e-80e9-d9064f378784 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:31.491877 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8882d-84b4-4f3e-80e9-d9064f378784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:31.493796 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8882d-84b4-4f3e-80e9-d9064f378784 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:31.521427 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1310/2608] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:03:31 2022] POST /identity/v3/projects => generated 393 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:03:31.525845 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a5665-85d2-49b9-9e09-7878c4852c02 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:31.536359 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a5665-85d2-49b9-9e09-7878c4852c02 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:31.604554 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a83b3-fff0-4e29-b97e-017f06eeca5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:31.605231 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a83b3-fff0-4e29-b97e-017f06eeca5b admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:31.605489 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a83b3-fff0-4e29-b97e-017f06eeca5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:31.605797 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a83b3-fff0-4e29-b97e-017f06eeca5b admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:31.606468 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a83b3-fff0-4e29-b97e-017f06eeca5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:31.608434 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a83b3-fff0-4e29-b97e-017f06eeca5b admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:31.630183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1299/2609] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:03:31 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 11:03:31.634573 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8882d-84b4-4f3e-80e9-d9064f378784 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:31.645299 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8882d-84b4-4f3e-80e9-d9064f378784 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:31.650386 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55697b7-229b-4945-a05e-b57630f7879f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:31.651048 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55697b7-229b-4945-a05e-b57630f7879f admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:31.651817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55697b7-229b-4945-a05e-b57630f7879f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:31.652095 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55697b7-229b-4945-a05e-b57630f7879f admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:31.652816 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55697b7-229b-4945-a05e-b57630f7879f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:31.654417 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55697b7-229b-4945-a05e-b57630f7879f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:31.665904 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1311/2610] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:03:31.670104 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a83b3-fff0-4e29-b97e-017f06eeca5b admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:31.681447 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a83b3-fff0-4e29-b97e-017f06eeca5b admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:31.687013 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79acae4-d593-40b7-8b6b-e887b313f6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:31.687719 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79acae4-d593-40b7-8b6b-e887b313f6dc admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:31.688003 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79acae4-d593-40b7-8b6b-e887b313f6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:31.688315 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79acae4-d593-40b7-8b6b-e887b313f6dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:31.689013 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79acae4-d593-40b7-8b6b-e887b313f6dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:31.690625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79acae4-d593-40b7-8b6b-e887b313f6dc admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:31.691886 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:31.703874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1300/2611] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:03:31.708222 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55697b7-229b-4945-a05e-b57630f7879f admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:31.718603 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55697b7-229b-4945-a05e-b57630f7879f admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:31.723639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50253b-1588-47bd-95e6-4413fe83ceba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:31.724462 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50253b-1588-47bd-95e6-4413fe83ceba admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:31.724883 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50253b-1588-47bd-95e6-4413fe83ceba admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:31.725611 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50253b-1588-47bd-95e6-4413fe83ceba admin admin] PATH_INFO: `/v3/projects/4d1798cd7944434099b42695855f6dd5/users/118809bc2e6746e387e32639b6d56308/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:31.741489 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb50253b-1588-47bd-95e6-4413fe83ceba admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d1798cd7944434099b42695855f6dd5, user_id=118809bc2e6746e387e32639b6d56308, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:31.744885 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb50253b-1588-47bd-95e6-4413fe83ceba admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:31.759042 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1312/2612] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:03:31 2022] PUT /identity/v3/projects/4d1798cd7944434099b42695855f6dd5/users/118809bc2e6746e387e32639b6d56308/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 11:03:31.770207 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f8950-b741-4afa-bc04-d722576c02e0 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:31.770501 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f8950-b741-4afa-bc04-d722576c02e0 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:31.770785 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f8950-b741-4afa-bc04-d722576c02e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:31.799175 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-e99f8950-b741-4afa-bc04-d722576c02e0 None None] MFA Rules not processed for user `118809bc2e6746e387e32639b6d56308`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:31.800452 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-e99f8950-b741-4afa-bc04-d722576c02e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:31.866415 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1301/2613] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:31.871109 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50253b-1588-47bd-95e6-4413fe83ceba admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:31.922124 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:31.938089 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50253b-1588-47bd-95e6-4413fe83ceba admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:31.943511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e24cce-4cf2-4113-96e5-7ec9c1c9e333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:31.944207 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e24cce-4cf2-4113-96e5-7ec9c1c9e333 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:31.944490 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e24cce-4cf2-4113-96e5-7ec9c1c9e333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:31.944753 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e24cce-4cf2-4113-96e5-7ec9c1c9e333 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:31.945453 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e24cce-4cf2-4113-96e5-7ec9c1c9e333 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:31.947416 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e24cce-4cf2-4113-96e5-7ec9c1c9e333 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:31.975850 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1313/2614] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:03:31 2022] POST /identity/v3/projects => generated 393 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:03:31.979973 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f8950-b741-4afa-bc04-d722576c02e0 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:31.991466 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f8950-b741-4afa-bc04-d722576c02e0 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:32.050093 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a4a1d-f07b-4d78-810f-af79c74e906f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:32.050789 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a4a1d-f07b-4d78-810f-af79c74e906f admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:32.051078 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a4a1d-f07b-4d78-810f-af79c74e906f admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:32.051377 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a4a1d-f07b-4d78-810f-af79c74e906f admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:32.052073 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a4a1d-f07b-4d78-810f-af79c74e906f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:32.054147 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a4a1d-f07b-4d78-810f-af79c74e906f admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:32.076835 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1302/2615] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:03:31 2022] POST /identity/v3/users => generated 303 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:03:32.082833 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e24cce-4cf2-4113-96e5-7ec9c1c9e333 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:32.094035 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e24cce-4cf2-4113-96e5-7ec9c1c9e333 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:32.099264 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69f308-e2ac-4547-81e9-24144cfd92de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:32.099981 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69f308-e2ac-4547-81e9-24144cfd92de admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:32.100402 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69f308-e2ac-4547-81e9-24144cfd92de admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:32.100681 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69f308-e2ac-4547-81e9-24144cfd92de admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:32.101413 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69f308-e2ac-4547-81e9-24144cfd92de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:32.103052 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69f308-e2ac-4547-81e9-24144cfd92de admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:32.115040 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1314/2616] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:03:32.119406 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a4a1d-f07b-4d78-810f-af79c74e906f admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:32.130050 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a4a1d-f07b-4d78-810f-af79c74e906f admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:32.135052 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d09348-256f-4ca7-830d-80dea62ee35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:32.136001 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d09348-256f-4ca7-830d-80dea62ee35b admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:32.136285 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d09348-256f-4ca7-830d-80dea62ee35b admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:32.136564 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d09348-256f-4ca7-830d-80dea62ee35b admin admin] PATH_INFO: `/v3/projects/ea684df4a6ab40ee9db901c8c35ba626/users/e5699a38ae1e4f8c9eadbe5f414d6fa8/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:32.152332 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d09348-256f-4ca7-830d-80dea62ee35b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea684df4a6ab40ee9db901c8c35ba626, user_id=e5699a38ae1e4f8c9eadbe5f414d6fa8, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:32.154990 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d09348-256f-4ca7-830d-80dea62ee35b admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:32.170121 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1303/2617] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:03:32 2022] PUT /identity/v3/projects/ea684df4a6ab40ee9db901c8c35ba626/users/e5699a38ae1e4f8c9eadbe5f414d6fa8/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:32.175115 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69f308-e2ac-4547-81e9-24144cfd92de admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:32.186453 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69f308-e2ac-4547-81e9-24144cfd92de admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:32.254569 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff9388-232f-497d-a772-2716ff0f93ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:32.255492 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff9388-232f-497d-a772-2716ff0f93ce admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:32.255903 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff9388-232f-497d-a772-2716ff0f93ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:32.256448 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff9388-232f-497d-a772-2716ff0f93ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:32.257184 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff9388-232f-497d-a772-2716ff0f93ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:32.259509 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff9388-232f-497d-a772-2716ff0f93ce admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:32.273970 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1315/2618] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:03:32.278365 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d09348-256f-4ca7-830d-80dea62ee35b admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:32.289569 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d09348-256f-4ca7-830d-80dea62ee35b admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:32.294969 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5a2bb-04f8-457a-9589-d271b4f0932e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:32.295925 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5a2bb-04f8-457a-9589-d271b4f0932e admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:32.296206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5a2bb-04f8-457a-9589-d271b4f0932e admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:32.296489 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5a2bb-04f8-457a-9589-d271b4f0932e admin admin] PATH_INFO: `/v3/projects/ea684df4a6ab40ee9db901c8c35ba626/users/e5699a38ae1e4f8c9eadbe5f414d6fa8/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:32.298885 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5a2bb-04f8-457a-9589-d271b4f0932e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea684df4a6ab40ee9db901c8c35ba626, user_id=e5699a38ae1e4f8c9eadbe5f414d6fa8, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:32.301582 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5a2bb-04f8-457a-9589-d271b4f0932e admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:32.312098 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1304/2619] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:03:32 2022] PUT /identity/v3/projects/ea684df4a6ab40ee9db901c8c35ba626/users/e5699a38ae1e4f8c9eadbe5f414d6fa8/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:32.322581 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c2c2d-363e-4226-81b1-7a706477ccc3 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:32.322878 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c2c2d-363e-4226-81b1-7a706477ccc3 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:32.323186 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c2c2d-363e-4226-81b1-7a706477ccc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:32.353399 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-532c2c2d-363e-4226-81b1-7a706477ccc3 None None] MFA Rules not processed for user `e5699a38ae1e4f8c9eadbe5f414d6fa8`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:32.354660 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-532c2c2d-363e-4226-81b1-7a706477ccc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:32.427994 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1316/2620] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:32.439260 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5a2bb-04f8-457a-9589-d271b4f0932e admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:32.440997 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-9cd5a2bb-04f8-457a-9589-d271b4f0932e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:32.489995 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:32.506150 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5a2bb-04f8-457a-9589-d271b4f0932e admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:32.509999 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26e197-19df-40a5-a4a8-bf1cdce423d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:32.510660 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26e197-19df-40a5-a4a8-bf1cdce423d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:32.510949 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26e197-19df-40a5-a4a8-bf1cdce423d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:32.511261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26e197-19df-40a5-a4a8-bf1cdce423d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:32.520338 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26e197-19df-40a5-a4a8-bf1cdce423d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:32.521762 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26e197-19df-40a5-a4a8-bf1cdce423d5 service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:32.531630 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1305/2621] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:03:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:03:32.580532 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c2c2d-363e-4226-81b1-7a706477ccc3 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:32.582055 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-532c2c2d-363e-4226-81b1-7a706477ccc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:32.594319 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c2c2d-363e-4226-81b1-7a706477ccc3 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:32.598056 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bb927-13ef-4d24-9470-9918313654d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:32.598748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bb927-13ef-4d24-9470-9918313654d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:32.598989 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bb927-13ef-4d24-9470-9918313654d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:32.599360 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bb927-13ef-4d24-9470-9918313654d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:32.643228 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:32.659666 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095bb927-13ef-4d24-9470-9918313654d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:32.661118 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095bb927-13ef-4d24-9470-9918313654d6 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:32.676131 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1317/2622] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:03:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:03:36.050412 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26e197-19df-40a5-a4a8-bf1cdce423d5 service cinder] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:36.125575 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26e197-19df-40a5-a4a8-bf1cdce423d5 service cinder] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:36.131183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51e0dc-a38f-407b-a46e-ac03c2c318e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:36.132073 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51e0dc-a38f-407b-a46e-ac03c2c318e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:36.132358 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51e0dc-a38f-407b-a46e-ac03c2c318e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:36.132637 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51e0dc-a38f-407b-a46e-ac03c2c318e8 admin admin] PATH_INFO: `/v3/users/118809bc2e6746e387e32639b6d56308` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:36.133941 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a51e0dc-a38f-407b-a46e-ac03c2c318e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=118809bc2e6746e387e32639b6d56308)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:36.135917 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a51e0dc-a38f-407b-a46e-ac03c2c318e8 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:36.190056 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-7a51e0dc-a38f-407b-a46e-ac03c2c318e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '118809bc2e6746e387e32639b6d56308'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:36.197353 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-7a51e0dc-a38f-407b-a46e-ac03c2c318e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '118809bc2e6746e387e32639b6d56308'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:36.207285 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-7a51e0dc-a38f-407b-a46e-ac03c2c318e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '118809bc2e6746e387e32639b6d56308'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:36.208124 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-7a51e0dc-a38f-407b-a46e-ac03c2c318e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '118809bc2e6746e387e32639b6d56308'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:36.221112 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-7a51e0dc-a38f-407b-a46e-ac03c2c318e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '118809bc2e6746e387e32639b6d56308'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:36.227397 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1306/2623] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:03:36 2022] DELETE /identity/v3/users/118809bc2e6746e387e32639b6d56308 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:36.232222 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d72fb-3a3f-4deb-9060-6ff448d7a51a None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:36.232704 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d72fb-3a3f-4deb-9060-6ff448d7a51a None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:36.232815 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d72fb-3a3f-4deb-9060-6ff448d7a51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:36.250525 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-560d72fb-3a3f-4deb-9060-6ff448d7a51a None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:36.251777 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-560d72fb-3a3f-4deb-9060-6ff448d7a51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:36.312974 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1318/2624] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:36.323007 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51e0dc-a38f-407b-a46e-ac03c2c318e8 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:36.324780 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-7a51e0dc-a38f-407b-a46e-ac03c2c318e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:36.386366 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51e0dc-a38f-407b-a46e-ac03c2c318e8 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:36.390533 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ada2c-4585-46c1-898f-73f1730affd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:36.391412 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ada2c-4585-46c1-898f-73f1730affd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:36.391696 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ada2c-4585-46c1-898f-73f1730affd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:36.391973 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ada2c-4585-46c1-898f-73f1730affd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:36.402573 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ada2c-4585-46c1-898f-73f1730affd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:36.404052 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ada2c-4585-46c1-898f-73f1730affd0 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:36.414422 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1307/2625] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:03:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:03:36.696170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d72fb-3a3f-4deb-9060-6ff448d7a51a None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:36.697657 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-560d72fb-3a3f-4deb-9060-6ff448d7a51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:36.710293 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d72fb-3a3f-4deb-9060-6ff448d7a51a None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:36.716290 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd8736-22a7-46f7-9f64-8570b527061e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:36.717254 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd8736-22a7-46f7-9f64-8570b527061e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:36.717610 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd8736-22a7-46f7-9f64-8570b527061e admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:36.717952 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd8736-22a7-46f7-9f64-8570b527061e admin admin] PATH_INFO: `/v3/projects/4d1798cd7944434099b42695855f6dd5` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:36.719430 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd8736-22a7-46f7-9f64-8570b527061e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d1798cd7944434099b42695855f6dd5)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:36.721630 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd8736-22a7-46f7-9f64-8570b527061e admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:36.769996 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-98fd8736-22a7-46f7-9f64-8570b527061e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d1798cd7944434099b42695855f6dd5', 'request_id': 'req-98fd8736-22a7-46f7-9f64-8570b527061e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:36.778000 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-98fd8736-22a7-46f7-9f64-8570b527061e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d1798cd7944434099b42695855f6dd5', 'request_id': 'req-98fd8736-22a7-46f7-9f64-8570b527061e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:36.783724 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-98fd8736-22a7-46f7-9f64-8570b527061e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d1798cd7944434099b42695855f6dd5', 'request_id': 'req-98fd8736-22a7-46f7-9f64-8570b527061e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:36.795101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-98fd8736-22a7-46f7-9f64-8570b527061e admin admin] The token cache is being invalidate because project 4d1798cd7944434099b42695855f6dd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:03:36.795543 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-98fd8736-22a7-46f7-9f64-8570b527061e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:36.796170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-98fd8736-22a7-46f7-9f64-8570b527061e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:36.798077 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1319/2626] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:03:36 2022] DELETE /identity/v3/projects/4d1798cd7944434099b42695855f6dd5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:36.802277 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ada2c-4585-46c1-898f-73f1730affd0 service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:36.808225 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:36.816056 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ada2c-4585-46c1-898f-73f1730affd0 service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:36.881984 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c596412-c657-429d-9f8b-22e63aea695d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:36.882893 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c596412-c657-429d-9f8b-22e63aea695d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:36.883192 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c596412-c657-429d-9f8b-22e63aea695d admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:36.883489 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c596412-c657-429d-9f8b-22e63aea695d admin admin] PATH_INFO: `/v3/users/e5699a38ae1e4f8c9eadbe5f414d6fa8` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:36.884706 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c596412-c657-429d-9f8b-22e63aea695d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5699a38ae1e4f8c9eadbe5f414d6fa8)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:36.886627 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c596412-c657-429d-9f8b-22e63aea695d admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:36.941695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-5c596412-c657-429d-9f8b-22e63aea695d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5699a38ae1e4f8c9eadbe5f414d6fa8'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:36.948684 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-5c596412-c657-429d-9f8b-22e63aea695d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5699a38ae1e4f8c9eadbe5f414d6fa8'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:36.957384 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-5c596412-c657-429d-9f8b-22e63aea695d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5699a38ae1e4f8c9eadbe5f414d6fa8'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:36.957993 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-5c596412-c657-429d-9f8b-22e63aea695d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5699a38ae1e4f8c9eadbe5f414d6fa8'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:36.970850 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-5c596412-c657-429d-9f8b-22e63aea695d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5699a38ae1e4f8c9eadbe5f414d6fa8'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:36.977016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1308/2627] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:03:36 2022] DELETE /identity/v3/users/e5699a38ae1e4f8c9eadbe5f414d6fa8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:37.277323 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd8736-22a7-46f7-9f64-8570b527061e admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:37.278895 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-98fd8736-22a7-46f7-9f64-8570b527061e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:37.292504 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd8736-22a7-46f7-9f64-8570b527061e admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:37.361981 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7bf40-87cd-4736-b8d9-f95a0a5df09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:37.362865 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7bf40-87cd-4736-b8d9-f95a0a5df09a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:37.363134 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7bf40-87cd-4736-b8d9-f95a0a5df09a admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:37.363451 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7bf40-87cd-4736-b8d9-f95a0a5df09a admin admin] PATH_INFO: `/v3/projects/ea684df4a6ab40ee9db901c8c35ba626` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:37.364722 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7bf40-87cd-4736-b8d9-f95a0a5df09a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea684df4a6ab40ee9db901c8c35ba626)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:37.366645 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7bf40-87cd-4736-b8d9-f95a0a5df09a admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:37.375370 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:37.416548 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-fcc7bf40-87cd-4736-b8d9-f95a0a5df09a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea684df4a6ab40ee9db901c8c35ba626', 'request_id': 'req-fcc7bf40-87cd-4736-b8d9-f95a0a5df09a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:37.425965 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-fcc7bf40-87cd-4736-b8d9-f95a0a5df09a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea684df4a6ab40ee9db901c8c35ba626', 'request_id': 'req-fcc7bf40-87cd-4736-b8d9-f95a0a5df09a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:37.433465 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-fcc7bf40-87cd-4736-b8d9-f95a0a5df09a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea684df4a6ab40ee9db901c8c35ba626', 'request_id': 'req-fcc7bf40-87cd-4736-b8d9-f95a0a5df09a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:37.448404 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-fcc7bf40-87cd-4736-b8d9-f95a0a5df09a admin admin] The token cache is being invalidate because project ea684df4a6ab40ee9db901c8c35ba626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:03:37.448688 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-fcc7bf40-87cd-4736-b8d9-f95a0a5df09a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:37.449347 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-fcc7bf40-87cd-4736-b8d9-f95a0a5df09a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:37.450905 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1320/2628] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:03:37 2022] DELETE /identity/v3/projects/ea684df4a6ab40ee9db901c8c35ba626 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:37.456068 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd47af4-6724-4dd5-b1a7-7103de79a733 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:37.456540 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd47af4-6724-4dd5-b1a7-7103de79a733 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:37.456647 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd47af4-6724-4dd5-b1a7-7103de79a733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:37.475180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-4fd47af4-6724-4dd5-b1a7-7103de79a733 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:37.476368 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-4fd47af4-6724-4dd5-b1a7-7103de79a733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:37.537105 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1309/2629] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:37.545403 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7a4cc-de1d-48c2-873a-b6e6d5d3f14a None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:37.545701 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7a4cc-de1d-48c2-873a-b6e6d5d3f14a None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:37.545979 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7a4cc-de1d-48c2-873a-b6e6d5d3f14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:37.566817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-ddf7a4cc-de1d-48c2-873a-b6e6d5d3f14a None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:37.568061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-ddf7a4cc-de1d-48c2-873a-b6e6d5d3f14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:37.577779 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1321/2630] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:37.582160 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd47af4-6724-4dd5-b1a7-7103de79a733 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:37.592756 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd47af4-6724-4dd5-b1a7-7103de79a733 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:37.598570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22010f3a-44b8-4a7e-a704-4892957714ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:37.599258 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22010f3a-44b8-4a7e-a704-4892957714ce admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:37.599560 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22010f3a-44b8-4a7e-a704-4892957714ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:37.599832 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22010f3a-44b8-4a7e-a704-4892957714ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:37.600575 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22010f3a-44b8-4a7e-a704-4892957714ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 11:03:37.600883 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22010f3a-44b8-4a7e-a704-4892957714ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:37.602680 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22010f3a-44b8-4a7e-a704-4892957714ce admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:37.614435 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1310/2631] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 11:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 11:03:37.619099 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7a4cc-de1d-48c2-873a-b6e6d5d3f14a None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:37.628667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7a4cc-de1d-48c2-873a-b6e6d5d3f14a None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:37.633746 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18f32d-67d5-45eb-a7d8-09a527f0c13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:37.634412 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18f32d-67d5-45eb-a7d8-09a527f0c13b admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:37.634694 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18f32d-67d5-45eb-a7d8-09a527f0c13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:37.634980 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18f32d-67d5-45eb-a7d8-09a527f0c13b admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:37.635709 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18f32d-67d5-45eb-a7d8-09a527f0c13b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:37.637614 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18f32d-67d5-45eb-a7d8-09a527f0c13b admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:37.664952 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1322/2632] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:03:37 2022] POST /identity/v3/projects => generated 389 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:03:37.669390 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22010f3a-44b8-4a7e-a704-4892957714ce admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:37.680058 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22010f3a-44b8-4a7e-a704-4892957714ce admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:37.684763 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:37.740446 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b969c3-7cfd-4b19-acb0-3245ec4fbe6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:37.741116 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b969c3-7cfd-4b19-acb0-3245ec4fbe6b admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:37.741394 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b969c3-7cfd-4b19-acb0-3245ec4fbe6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:37.741672 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b969c3-7cfd-4b19-acb0-3245ec4fbe6b admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:37.742466 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b969c3-7cfd-4b19-acb0-3245ec4fbe6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:37.744588 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b969c3-7cfd-4b19-acb0-3245ec4fbe6b admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:37.765203 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1311/2633] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:03:37 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:03:37.771584 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18f32d-67d5-45eb-a7d8-09a527f0c13b admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:37.783706 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18f32d-67d5-45eb-a7d8-09a527f0c13b admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:37.789610 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2128a-6f3b-44c4-bb2e-3f11d517af35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:37.790279 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2128a-6f3b-44c4-bb2e-3f11d517af35 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:37.790563 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2128a-6f3b-44c4-bb2e-3f11d517af35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:37.790839 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2128a-6f3b-44c4-bb2e-3f11d517af35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:37.791615 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2128a-6f3b-44c4-bb2e-3f11d517af35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:37.793220 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2128a-6f3b-44c4-bb2e-3f11d517af35 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:37.804777 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1323/2634] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:03:37.810611 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b969c3-7cfd-4b19-acb0-3245ec4fbe6b admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:37.826488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b969c3-7cfd-4b19-acb0-3245ec4fbe6b admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:37.834905 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7fd72-a8b0-4b70-a683-9d226d65972f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:37.836119 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7fd72-a8b0-4b70-a683-9d226d65972f admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:37.836424 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7fd72-a8b0-4b70-a683-9d226d65972f admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:37.836803 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7fd72-a8b0-4b70-a683-9d226d65972f admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:37.838020 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7fd72-a8b0-4b70-a683-9d226d65972f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:37.840310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7fd72-a8b0-4b70-a683-9d226d65972f admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:37.851297 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1312/2635] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:03:37.857932 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2128a-6f3b-44c4-bb2e-3f11d517af35 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:37.872092 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2128a-6f3b-44c4-bb2e-3f11d517af35 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:37.878384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa89805-a80f-4f6c-ad81-c48fb78625a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:37.879314 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa89805-a80f-4f6c-ad81-c48fb78625a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:37.879600 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa89805-a80f-4f6c-ad81-c48fb78625a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:37.879876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa89805-a80f-4f6c-ad81-c48fb78625a5 admin admin] PATH_INFO: `/v3/projects/e1726d55fd274f3ead4b8d7930438900/users/92f12740d3e04bd28330b8310f344c2d/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:37.895712 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa89805-a80f-4f6c-ad81-c48fb78625a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1726d55fd274f3ead4b8d7930438900, user_id=92f12740d3e04bd28330b8310f344c2d, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:37.898782 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa89805-a80f-4f6c-ad81-c48fb78625a5 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:37.918047 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1324/2636] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:03:37 2022] PUT /identity/v3/projects/e1726d55fd274f3ead4b8d7930438900/users/92f12740d3e04bd28330b8310f344c2d/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:37.933771 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63147c-fea6-4c41-944d-ec49f75505ed None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:37.934056 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63147c-fea6-4c41-944d-ec49f75505ed None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:37.934334 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63147c-fea6-4c41-944d-ec49f75505ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:37.963022 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-3f63147c-fea6-4c41-944d-ec49f75505ed None None] MFA Rules not processed for user `92f12740d3e04bd28330b8310f344c2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:37.964279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-3f63147c-fea6-4c41-944d-ec49f75505ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:38.029576 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1313/2637] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:38.034140 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa89805-a80f-4f6c-ad81-c48fb78625a5 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:38.100190 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa89805-a80f-4f6c-ad81-c48fb78625a5 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:38.105401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9bb882-6932-4656-b985-75b8d50178c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:38.106068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bb882-6932-4656-b985-75b8d50178c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:38.106351 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bb882-6932-4656-b985-75b8d50178c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:38.106632 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bb882-6932-4656-b985-75b8d50178c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:38.107344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9bb882-6932-4656-b985-75b8d50178c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:38.109246 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9bb882-6932-4656-b985-75b8d50178c3 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:38.138108 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1325/2638] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:03:38 2022] POST /identity/v3/projects => generated 389 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:03:38.142600 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63147c-fea6-4c41-944d-ec49f75505ed None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:38.157430 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63147c-fea6-4c41-944d-ec49f75505ed None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:38.219656 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5667d9-45ac-46e1-bf6d-9c4e12291e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:38.220324 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5667d9-45ac-46e1-bf6d-9c4e12291e66 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:38.220604 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5667d9-45ac-46e1-bf6d-9c4e12291e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:38.220877 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5667d9-45ac-46e1-bf6d-9c4e12291e66 admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:38.221561 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5667d9-45ac-46e1-bf6d-9c4e12291e66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:38.223495 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5667d9-45ac-46e1-bf6d-9c4e12291e66 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:38.245570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1314/2639] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:03:38 2022] POST /identity/v3/users => generated 301 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:03:38.249775 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9bb882-6932-4656-b985-75b8d50178c3 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:38.260922 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9bb882-6932-4656-b985-75b8d50178c3 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:38.265652 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f5f0b-b427-4d47-944a-c842ee8b9d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:38.266292 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f5f0b-b427-4d47-944a-c842ee8b9d7c admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:38.266574 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f5f0b-b427-4d47-944a-c842ee8b9d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:38.266847 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f5f0b-b427-4d47-944a-c842ee8b9d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:38.267616 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f5f0b-b427-4d47-944a-c842ee8b9d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:38.269230 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f5f0b-b427-4d47-944a-c842ee8b9d7c admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:38.280433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1326/2640] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:03:38.284442 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5667d9-45ac-46e1-bf6d-9c4e12291e66 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:38.294628 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5667d9-45ac-46e1-bf6d-9c4e12291e66 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:38.299925 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f203bd-da1a-4f1b-a995-7789568dd6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:38.300806 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f203bd-da1a-4f1b-a995-7789568dd6dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:38.302197 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f203bd-da1a-4f1b-a995-7789568dd6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:38.302507 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f203bd-da1a-4f1b-a995-7789568dd6dd admin admin] PATH_INFO: `/v3/projects/b9528fbc3188454498b66cdca7726e62/users/0c0af078dd894a8da245d584e87f7631/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:38.305240 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:38.327726 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f203bd-da1a-4f1b-a995-7789568dd6dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9528fbc3188454498b66cdca7726e62, user_id=0c0af078dd894a8da245d584e87f7631, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:38.330668 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f203bd-da1a-4f1b-a995-7789568dd6dd admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:38.345489 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1315/2641] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:03:38 2022] PUT /identity/v3/projects/b9528fbc3188454498b66cdca7726e62/users/0c0af078dd894a8da245d584e87f7631/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 11:03:38.350281 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f5f0b-b427-4d47-944a-c842ee8b9d7c admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:38.366158 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f5f0b-b427-4d47-944a-c842ee8b9d7c admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:38.370719 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:38.434143 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e758fe-84e0-4a0e-9bfc-9452015b0018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:38.434726 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e758fe-84e0-4a0e-9bfc-9452015b0018 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:38.435011 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e758fe-84e0-4a0e-9bfc-9452015b0018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:38.435325 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e758fe-84e0-4a0e-9bfc-9452015b0018 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:38.436095 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e758fe-84e0-4a0e-9bfc-9452015b0018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:38.437697 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e758fe-84e0-4a0e-9bfc-9452015b0018 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:38.448330 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1327/2642] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:03:38.452721 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f203bd-da1a-4f1b-a995-7789568dd6dd admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:38.463959 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f203bd-da1a-4f1b-a995-7789568dd6dd admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:38.469307 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38401620-32ca-4a20-95ad-a74e22d7d0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:38.470218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38401620-32ca-4a20-95ad-a74e22d7d0a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:38.470504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38401620-32ca-4a20-95ad-a74e22d7d0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:38.470785 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38401620-32ca-4a20-95ad-a74e22d7d0a0 admin admin] PATH_INFO: `/v3/projects/b9528fbc3188454498b66cdca7726e62/users/0c0af078dd894a8da245d584e87f7631/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:38.472915 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38401620-32ca-4a20-95ad-a74e22d7d0a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9528fbc3188454498b66cdca7726e62, user_id=0c0af078dd894a8da245d584e87f7631, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:38.475768 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38401620-32ca-4a20-95ad-a74e22d7d0a0 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:38.487432 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1316/2643] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:03:38 2022] PUT /identity/v3/projects/b9528fbc3188454498b66cdca7726e62/users/0c0af078dd894a8da245d584e87f7631/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:38.498016 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824193a-dd9c-41b1-b32d-ba3e2c461909 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:38.498312 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824193a-dd9c-41b1-b32d-ba3e2c461909 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:38.498604 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824193a-dd9c-41b1-b32d-ba3e2c461909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:38.527170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-e824193a-dd9c-41b1-b32d-ba3e2c461909 None None] MFA Rules not processed for user `0c0af078dd894a8da245d584e87f7631`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:38.528408 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e824193a-dd9c-41b1-b32d-ba3e2c461909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:38.600662 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1328/2644] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:38.611761 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38401620-32ca-4a20-95ad-a74e22d7d0a0 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:38.613748 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-38401620-32ca-4a20-95ad-a74e22d7d0a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:38.676180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38401620-32ca-4a20-95ad-a74e22d7d0a0 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:38.680355 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff00c88-e232-4bd8-bc0f-f44c7f34acbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:38.681129 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff00c88-e232-4bd8-bc0f-f44c7f34acbd service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:38.681408 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff00c88-e232-4bd8-bc0f-f44c7f34acbd service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:38.681682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff00c88-e232-4bd8-bc0f-f44c7f34acbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:38.691204 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff00c88-e232-4bd8-bc0f-f44c7f34acbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:38.692584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff00c88-e232-4bd8-bc0f-f44c7f34acbd service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:38.702398 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1317/2645] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:03:38 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:03:38.838138 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824193a-dd9c-41b1-b32d-ba3e2c461909 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:38.910941 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824193a-dd9c-41b1-b32d-ba3e2c461909 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:38.918763 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6c089-fc99-47af-bbc8-0f806efc2540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:38.919698 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6c089-fc99-47af-bbc8-0f806efc2540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:38.919984 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6c089-fc99-47af-bbc8-0f806efc2540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:38.920262 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6c089-fc99-47af-bbc8-0f806efc2540 admin admin] PATH_INFO: `/v3/users/92f12740d3e04bd28330b8310f344c2d` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:38.922043 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6c089-fc99-47af-bbc8-0f806efc2540 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92f12740d3e04bd28330b8310f344c2d)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:38.924024 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6c089-fc99-47af-bbc8-0f806efc2540 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:38.965059 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:38.978786 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-91b6c089-fc99-47af-bbc8-0f806efc2540 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92f12740d3e04bd28330b8310f344c2d'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:38.985919 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-91b6c089-fc99-47af-bbc8-0f806efc2540 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92f12740d3e04bd28330b8310f344c2d'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:38.993786 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-91b6c089-fc99-47af-bbc8-0f806efc2540 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92f12740d3e04bd28330b8310f344c2d'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:38.994396 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-91b6c089-fc99-47af-bbc8-0f806efc2540 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92f12740d3e04bd28330b8310f344c2d'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:39.006368 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-91b6c089-fc99-47af-bbc8-0f806efc2540 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92f12740d3e04bd28330b8310f344c2d'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:39.012461 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1329/2646] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:03:38 2022] DELETE /identity/v3/users/92f12740d3e04bd28330b8310f344c2d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:39.017113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33baded-0a72-49e8-9dc6-e903a357fe06 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:39.017404 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33baded-0a72-49e8-9dc6-e903a357fe06 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:39.017687 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33baded-0a72-49e8-9dc6-e903a357fe06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:39.041647 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-f33baded-0a72-49e8-9dc6-e903a357fe06 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:39.042869 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-f33baded-0a72-49e8-9dc6-e903a357fe06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:39.106053 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1318/2647] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:39.119067 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6c089-fc99-47af-bbc8-0f806efc2540 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:39.120627 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-91b6c089-fc99-47af-bbc8-0f806efc2540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:39.179535 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6c089-fc99-47af-bbc8-0f806efc2540 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:39.183374 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad5527-80ae-40c4-a2a1-2aebb2c94eea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:39.184033 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad5527-80ae-40c4-a2a1-2aebb2c94eea service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:39.184316 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad5527-80ae-40c4-a2a1-2aebb2c94eea service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:39.184602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad5527-80ae-40c4-a2a1-2aebb2c94eea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:39.193786 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad5527-80ae-40c4-a2a1-2aebb2c94eea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:39.195577 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad5527-80ae-40c4-a2a1-2aebb2c94eea service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:39.205781 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1330/2648] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:03:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:03:39.478657 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33baded-0a72-49e8-9dc6-e903a357fe06 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:39.480446 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-f33baded-0a72-49e8-9dc6-e903a357fe06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:39.493485 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33baded-0a72-49e8-9dc6-e903a357fe06 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:39.499185 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa2316-e2fc-48bf-a244-07e8b6a8ac26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:39.500197 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa2316-e2fc-48bf-a244-07e8b6a8ac26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:39.500486 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa2316-e2fc-48bf-a244-07e8b6a8ac26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:39.500760 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa2316-e2fc-48bf-a244-07e8b6a8ac26 admin admin] PATH_INFO: `/v3/projects/e1726d55fd274f3ead4b8d7930438900` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:39.502039 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa2316-e2fc-48bf-a244-07e8b6a8ac26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1726d55fd274f3ead4b8d7930438900)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:39.504036 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa2316-e2fc-48bf-a244-07e8b6a8ac26 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:39.557440 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-c3fa2316-e2fc-48bf-a244-07e8b6a8ac26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1726d55fd274f3ead4b8d7930438900', 'request_id': 'req-c3fa2316-e2fc-48bf-a244-07e8b6a8ac26'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:39.566880 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-c3fa2316-e2fc-48bf-a244-07e8b6a8ac26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1726d55fd274f3ead4b8d7930438900', 'request_id': 'req-c3fa2316-e2fc-48bf-a244-07e8b6a8ac26'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:39.573828 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-c3fa2316-e2fc-48bf-a244-07e8b6a8ac26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1726d55fd274f3ead4b8d7930438900', 'request_id': 'req-c3fa2316-e2fc-48bf-a244-07e8b6a8ac26'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:39.575765 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:39.587841 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-c3fa2316-e2fc-48bf-a244-07e8b6a8ac26 admin admin] The token cache is being invalidate because project e1726d55fd274f3ead4b8d7930438900 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:03:39.588127 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-c3fa2316-e2fc-48bf-a244-07e8b6a8ac26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:39.588785 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-c3fa2316-e2fc-48bf-a244-07e8b6a8ac26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:39.590368 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1319/2649] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:03:39 2022] DELETE /identity/v3/projects/e1726d55fd274f3ead4b8d7930438900 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:39.594413 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad5527-80ae-40c4-a2a1-2aebb2c94eea service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:39.604759 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad5527-80ae-40c4-a2a1-2aebb2c94eea service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:39.664733 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f363f-1eda-493e-afff-1e3bd83a302b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:39.665678 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f363f-1eda-493e-afff-1e3bd83a302b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:39.665944 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f363f-1eda-493e-afff-1e3bd83a302b admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:39.666213 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f363f-1eda-493e-afff-1e3bd83a302b admin admin] PATH_INFO: `/v3/users/0c0af078dd894a8da245d584e87f7631` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:39.667849 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f363f-1eda-493e-afff-1e3bd83a302b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c0af078dd894a8da245d584e87f7631)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:39.669773 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f363f-1eda-493e-afff-1e3bd83a302b admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:39.719106 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f40f363f-1eda-493e-afff-1e3bd83a302b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c0af078dd894a8da245d584e87f7631'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:39.723926 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:39.727457 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f40f363f-1eda-493e-afff-1e3bd83a302b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c0af078dd894a8da245d584e87f7631'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:39.736593 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f40f363f-1eda-493e-afff-1e3bd83a302b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c0af078dd894a8da245d584e87f7631'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:39.737323 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f40f363f-1eda-493e-afff-1e3bd83a302b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c0af078dd894a8da245d584e87f7631'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:39.749961 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f40f363f-1eda-493e-afff-1e3bd83a302b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c0af078dd894a8da245d584e87f7631'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:39.757756 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1331/2650] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:03:39 2022] DELETE /identity/v3/users/0c0af078dd894a8da245d584e87f7631 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:40.048626 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa2316-e2fc-48bf-a244-07e8b6a8ac26 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:40.050326 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-c3fa2316-e2fc-48bf-a244-07e8b6a8ac26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:40.066975 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa2316-e2fc-48bf-a244-07e8b6a8ac26 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:40.127544 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba95ce-7b8d-4e96-af8d-ca95c8a70396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:40.128486 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba95ce-7b8d-4e96-af8d-ca95c8a70396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:40.128771 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba95ce-7b8d-4e96-af8d-ca95c8a70396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:40.129048 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba95ce-7b8d-4e96-af8d-ca95c8a70396 admin admin] PATH_INFO: `/v3/projects/b9528fbc3188454498b66cdca7726e62` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:40.130458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba95ce-7b8d-4e96-af8d-ca95c8a70396 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9528fbc3188454498b66cdca7726e62)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:40.132472 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba95ce-7b8d-4e96-af8d-ca95c8a70396 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:40.182633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-f1ba95ce-7b8d-4e96-af8d-ca95c8a70396 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9528fbc3188454498b66cdca7726e62', 'request_id': 'req-f1ba95ce-7b8d-4e96-af8d-ca95c8a70396'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:40.192729 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-f1ba95ce-7b8d-4e96-af8d-ca95c8a70396 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9528fbc3188454498b66cdca7726e62', 'request_id': 'req-f1ba95ce-7b8d-4e96-af8d-ca95c8a70396'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:40.199202 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-f1ba95ce-7b8d-4e96-af8d-ca95c8a70396 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9528fbc3188454498b66cdca7726e62', 'request_id': 'req-f1ba95ce-7b8d-4e96-af8d-ca95c8a70396'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:40.210431 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-f1ba95ce-7b8d-4e96-af8d-ca95c8a70396 admin admin] The token cache is being invalidate because project b9528fbc3188454498b66cdca7726e62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:03:40.210727 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-f1ba95ce-7b8d-4e96-af8d-ca95c8a70396 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:40.211503 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-f1ba95ce-7b8d-4e96-af8d-ca95c8a70396 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:40.213187 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1320/2651] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:03:40 2022] DELETE /identity/v3/projects/b9528fbc3188454498b66cdca7726e62 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:40.218330 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de427a-5196-4aa3-80a0-f3615b26f983 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:40.218624 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de427a-5196-4aa3-80a0-f3615b26f983 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:40.218906 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de427a-5196-4aa3-80a0-f3615b26f983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:40.239458 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-59de427a-5196-4aa3-80a0-f3615b26f983 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:40.240566 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-59de427a-5196-4aa3-80a0-f3615b26f983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:40.303402 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1332/2652] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 11:03:40.313255 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b06da2-5531-45b8-9007-8dccc27c555e None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:40.313654 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b06da2-5531-45b8-9007-8dccc27c555e None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:40.313942 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b06da2-5531-45b8-9007-8dccc27c555e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:40.333901 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-42b06da2-5531-45b8-9007-8dccc27c555e None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:40.335120 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-42b06da2-5531-45b8-9007-8dccc27c555e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:40.344118 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1321/2653] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:40.348693 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de427a-5196-4aa3-80a0-f3615b26f983 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:40.359569 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de427a-5196-4aa3-80a0-f3615b26f983 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:40.364550 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfa143-c268-4d23-95a9-0a53e3dc0394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:40.365220 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfa143-c268-4d23-95a9-0a53e3dc0394 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:40.365500 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfa143-c268-4d23-95a9-0a53e3dc0394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:40.365784 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfa143-c268-4d23-95a9-0a53e3dc0394 admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:40.366527 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcfa143-c268-4d23-95a9-0a53e3dc0394 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 11:03:40.366836 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcfa143-c268-4d23-95a9-0a53e3dc0394 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:40.368580 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcfa143-c268-4d23-95a9-0a53e3dc0394 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:40.380199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1333/2654] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 11:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 11:03:40.384926 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b06da2-5531-45b8-9007-8dccc27c555e None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:40.394339 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b06da2-5531-45b8-9007-8dccc27c555e None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:40.399377 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15716849-ef91-4bde-80e5-2f334dc62842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:40.400040 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15716849-ef91-4bde-80e5-2f334dc62842 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:40.400325 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15716849-ef91-4bde-80e5-2f334dc62842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:40.400586 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15716849-ef91-4bde-80e5-2f334dc62842 admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:40.401433 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15716849-ef91-4bde-80e5-2f334dc62842 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:40.403394 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15716849-ef91-4bde-80e5-2f334dc62842 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:40.430918 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1322/2655] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:03:40 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:03:40.435178 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfa143-c268-4d23-95a9-0a53e3dc0394 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:40.445427 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfa143-c268-4d23-95a9-0a53e3dc0394 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:40.507200 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b6ebb-cbd3-4134-8659-aac47a5924a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:40.507864 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b6ebb-cbd3-4134-8659-aac47a5924a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:40.508164 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b6ebb-cbd3-4134-8659-aac47a5924a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:40.508459 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b6ebb-cbd3-4134-8659-aac47a5924a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:40.509161 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b6ebb-cbd3-4134-8659-aac47a5924a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:40.511069 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b6ebb-cbd3-4134-8659-aac47a5924a5 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:40.534629 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1334/2656] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:03:40 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:03:40.540505 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15716849-ef91-4bde-80e5-2f334dc62842 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:40.551853 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15716849-ef91-4bde-80e5-2f334dc62842 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:40.557080 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc50f9e-b712-49d8-9a17-fb707bd965c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:40.557761 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc50f9e-b712-49d8-9a17-fb707bd965c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:40.558077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc50f9e-b712-49d8-9a17-fb707bd965c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:40.558401 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc50f9e-b712-49d8-9a17-fb707bd965c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:40.559174 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc50f9e-b712-49d8-9a17-fb707bd965c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:40.560842 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc50f9e-b712-49d8-9a17-fb707bd965c2 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:40.572411 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1323/2657] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:03:40.576476 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b6ebb-cbd3-4134-8659-aac47a5924a5 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:40.590195 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b6ebb-cbd3-4134-8659-aac47a5924a5 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:40.596001 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd817c-92f7-4832-9c22-b21df5601bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:40.596665 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd817c-92f7-4832-9c22-b21df5601bce admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:40.596955 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd817c-92f7-4832-9c22-b21df5601bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:40.597235 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd817c-92f7-4832-9c22-b21df5601bce admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:40.597962 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd817c-92f7-4832-9c22-b21df5601bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:40.599596 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd817c-92f7-4832-9c22-b21df5601bce admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:40.610405 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1335/2658] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:03:40.614656 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc50f9e-b712-49d8-9a17-fb707bd965c2 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:40.625787 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc50f9e-b712-49d8-9a17-fb707bd965c2 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:40.631739 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80915f1d-61d3-4d06-98c4-0202c3c2bacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:40.632674 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80915f1d-61d3-4d06-98c4-0202c3c2bacb admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:40.632962 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80915f1d-61d3-4d06-98c4-0202c3c2bacb admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:40.633413 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80915f1d-61d3-4d06-98c4-0202c3c2bacb admin admin] PATH_INFO: `/v3/projects/1c756a9e4b514efea26ae2b216c76285/users/4df2489d0ca5475e86eb9cc7b0c91eeb/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:40.649149 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80915f1d-61d3-4d06-98c4-0202c3c2bacb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c756a9e4b514efea26ae2b216c76285, user_id=4df2489d0ca5475e86eb9cc7b0c91eeb, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:40.651926 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80915f1d-61d3-4d06-98c4-0202c3c2bacb admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:40.667960 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1324/2659] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:03:40 2022] PUT /identity/v3/projects/1c756a9e4b514efea26ae2b216c76285/users/4df2489d0ca5475e86eb9cc7b0c91eeb/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:40.679091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608a3a5-a1a5-4e68-96f9-ca22fb5cb4cf None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:40.679416 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608a3a5-a1a5-4e68-96f9-ca22fb5cb4cf None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:40.679913 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608a3a5-a1a5-4e68-96f9-ca22fb5cb4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:40.708573 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-e608a3a5-a1a5-4e68-96f9-ca22fb5cb4cf None None] MFA Rules not processed for user `4df2489d0ca5475e86eb9cc7b0c91eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:40.709781 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e608a3a5-a1a5-4e68-96f9-ca22fb5cb4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:40.735073 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:40.778265 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1336/2660] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:40.782925 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80915f1d-61d3-4d06-98c4-0202c3c2bacb admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:40.809219 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:40.849229 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80915f1d-61d3-4d06-98c4-0202c3c2bacb admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:40.854534 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b334e-3660-4836-a656-e1f5081a54ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:40.855207 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b334e-3660-4836-a656-e1f5081a54ff admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:40.855499 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b334e-3660-4836-a656-e1f5081a54ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:40.855777 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b334e-3660-4836-a656-e1f5081a54ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:40.856481 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b334e-3660-4836-a656-e1f5081a54ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:40.858386 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b334e-3660-4836-a656-e1f5081a54ff admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:40.887268 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1325/2661] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:03:40 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:03:40.891572 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608a3a5-a1a5-4e68-96f9-ca22fb5cb4cf None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:40.903461 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608a3a5-a1a5-4e68-96f9-ca22fb5cb4cf None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:40.965163 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25db6a-6050-45ad-a952-2277db5c82a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:40.965840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25db6a-6050-45ad-a952-2277db5c82a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:40.966124 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25db6a-6050-45ad-a952-2277db5c82a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:40.966401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25db6a-6050-45ad-a952-2277db5c82a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:40.967098 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25db6a-6050-45ad-a952-2277db5c82a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:40.969044 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25db6a-6050-45ad-a952-2277db5c82a1 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:40.990395 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1337/2662] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:03:40 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:03:40.995391 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b334e-3660-4836-a656-e1f5081a54ff admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:41.008091 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b334e-3660-4836-a656-e1f5081a54ff admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:41.016287 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776d611-ab6b-47be-8739-d76f006e39f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:41.016959 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776d611-ab6b-47be-8739-d76f006e39f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:41.017242 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776d611-ab6b-47be-8739-d76f006e39f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:41.017512 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776d611-ab6b-47be-8739-d76f006e39f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:41.018239 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776d611-ab6b-47be-8739-d76f006e39f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:41.019871 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776d611-ab6b-47be-8739-d76f006e39f1 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:41.031518 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1326/2663] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:03:41.035708 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25db6a-6050-45ad-a952-2277db5c82a1 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:41.046937 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25db6a-6050-45ad-a952-2277db5c82a1 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:41.052260 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3136b-edfb-46f8-a3b5-ab1735d3699d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:41.053149 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3136b-edfb-46f8-a3b5-ab1735d3699d admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:41.053427 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3136b-edfb-46f8-a3b5-ab1735d3699d admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:41.053699 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3136b-edfb-46f8-a3b5-ab1735d3699d admin admin] PATH_INFO: `/v3/projects/b12c143da2fe4d06bf2ac47b9e908882/users/d912c754052e4c4e9c0e42b078c48457/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:41.070591 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d3136b-edfb-46f8-a3b5-ab1735d3699d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b12c143da2fe4d06bf2ac47b9e908882, user_id=d912c754052e4c4e9c0e42b078c48457, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:41.073359 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d3136b-edfb-46f8-a3b5-ab1735d3699d admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:41.087988 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1338/2664] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:03:41 2022] PUT /identity/v3/projects/b12c143da2fe4d06bf2ac47b9e908882/users/d912c754052e4c4e9c0e42b078c48457/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:41.092009 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776d611-ab6b-47be-8739-d76f006e39f1 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:41.102085 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776d611-ab6b-47be-8739-d76f006e39f1 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:41.159679 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab4510-f691-4097-a997-f5479c36e7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:41.160379 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab4510-f691-4097-a997-f5479c36e7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:41.160662 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab4510-f691-4097-a997-f5479c36e7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:41.160935 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab4510-f691-4097-a997-f5479c36e7f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:41.161642 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab4510-f691-4097-a997-f5479c36e7f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:41.163277 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab4510-f691-4097-a997-f5479c36e7f5 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:41.173835 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1327/2665] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:03:41.178081 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3136b-edfb-46f8-a3b5-ab1735d3699d admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:41.188779 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3136b-edfb-46f8-a3b5-ab1735d3699d admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:41.193989 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6cc59-572b-49a2-9c9d-db3341d77907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:41.194878 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6cc59-572b-49a2-9c9d-db3341d77907 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:41.195272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6cc59-572b-49a2-9c9d-db3341d77907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:41.195549 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6cc59-572b-49a2-9c9d-db3341d77907 admin admin] PATH_INFO: `/v3/projects/b12c143da2fe4d06bf2ac47b9e908882/users/d912c754052e4c4e9c0e42b078c48457/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:41.197657 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6cc59-572b-49a2-9c9d-db3341d77907 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b12c143da2fe4d06bf2ac47b9e908882, user_id=d912c754052e4c4e9c0e42b078c48457, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:41.200335 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6cc59-572b-49a2-9c9d-db3341d77907 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:41.211448 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1339/2666] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:03:41 2022] PUT /identity/v3/projects/b12c143da2fe4d06bf2ac47b9e908882/users/d912c754052e4c4e9c0e42b078c48457/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:41.221544 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd1850-e14f-441b-9218-25a29f79a572 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:41.221835 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd1850-e14f-441b-9218-25a29f79a572 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:41.222114 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd1850-e14f-441b-9218-25a29f79a572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:41.250389 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-63dd1850-e14f-441b-9218-25a29f79a572 None None] MFA Rules not processed for user `d912c754052e4c4e9c0e42b078c48457`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:41.251748 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-63dd1850-e14f-441b-9218-25a29f79a572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:41.332778 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1328/2667] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:41 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:41.346415 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6cc59-572b-49a2-9c9d-db3341d77907 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:41.351369 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-07c6cc59-572b-49a2-9c9d-db3341d77907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:41.422612 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6cc59-572b-49a2-9c9d-db3341d77907 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:41.428763 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c647438-db37-443e-9078-966353cb3008 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:41.430016 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c647438-db37-443e-9078-966353cb3008 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:41.430175 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c647438-db37-443e-9078-966353cb3008 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:41.430422 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c647438-db37-443e-9078-966353cb3008 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:41.439931 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c647438-db37-443e-9078-966353cb3008 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:41.441352 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c647438-db37-443e-9078-966353cb3008 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:41.450950 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1340/2668] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:03:41 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:03:41.846886 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd1850-e14f-441b-9218-25a29f79a572 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:41.866716 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:41.918003 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd1850-e14f-441b-9218-25a29f79a572 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:41.923905 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90518974-bc23-43e3-adc3-d4dfa8105c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:41.924804 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90518974-bc23-43e3-adc3-d4dfa8105c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:41.925208 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90518974-bc23-43e3-adc3-d4dfa8105c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:41.925497 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90518974-bc23-43e3-adc3-d4dfa8105c40 admin admin] PATH_INFO: `/v3/users/4df2489d0ca5475e86eb9cc7b0c91eeb` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:41.926720 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90518974-bc23-43e3-adc3-d4dfa8105c40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4df2489d0ca5475e86eb9cc7b0c91eeb)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:41.928769 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90518974-bc23-43e3-adc3-d4dfa8105c40 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:41.981262 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-90518974-bc23-43e3-adc3-d4dfa8105c40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4df2489d0ca5475e86eb9cc7b0c91eeb'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:41.988329 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-90518974-bc23-43e3-adc3-d4dfa8105c40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4df2489d0ca5475e86eb9cc7b0c91eeb'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:41.997192 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-90518974-bc23-43e3-adc3-d4dfa8105c40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4df2489d0ca5475e86eb9cc7b0c91eeb'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:41.997847 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-90518974-bc23-43e3-adc3-d4dfa8105c40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4df2489d0ca5475e86eb9cc7b0c91eeb'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:42.010148 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-90518974-bc23-43e3-adc3-d4dfa8105c40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4df2489d0ca5475e86eb9cc7b0c91eeb'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:42.016204 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1329/2669] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:03:41 2022] DELETE /identity/v3/users/4df2489d0ca5475e86eb9cc7b0c91eeb => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:42.022341 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4547dd5-0d4e-4ad1-be9f-ff486c1fbc1b None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:42.022831 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4547dd5-0d4e-4ad1-be9f-ff486c1fbc1b None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:42.022932 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4547dd5-0d4e-4ad1-be9f-ff486c1fbc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:42.044737 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-a4547dd5-0d4e-4ad1-be9f-ff486c1fbc1b None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:42.045986 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a4547dd5-0d4e-4ad1-be9f-ff486c1fbc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:42.060508 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:42.110935 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1341/2670] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:42.121009 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90518974-bc23-43e3-adc3-d4dfa8105c40 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:42.122730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-90518974-bc23-43e3-adc3-d4dfa8105c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:42.184523 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90518974-bc23-43e3-adc3-d4dfa8105c40 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:42.188860 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413ca10-9e65-45ec-b54e-da953f8e5a6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:42.189540 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413ca10-9e65-45ec-b54e-da953f8e5a6a service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:42.189826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413ca10-9e65-45ec-b54e-da953f8e5a6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:42.190097 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413ca10-9e65-45ec-b54e-da953f8e5a6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:42.199834 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c413ca10-9e65-45ec-b54e-da953f8e5a6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:42.201266 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c413ca10-9e65-45ec-b54e-da953f8e5a6a service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:42.211736 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1330/2671] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:03:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:03:42.509703 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4547dd5-0d4e-4ad1-be9f-ff486c1fbc1b None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:42.511208 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a4547dd5-0d4e-4ad1-be9f-ff486c1fbc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:42.523610 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4547dd5-0d4e-4ad1-be9f-ff486c1fbc1b None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:42.528424 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afa724-7db0-4ca8-ba3c-03b5ae112c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:42.529303 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afa724-7db0-4ca8-ba3c-03b5ae112c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:42.529579 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afa724-7db0-4ca8-ba3c-03b5ae112c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:42.529850 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afa724-7db0-4ca8-ba3c-03b5ae112c21 admin admin] PATH_INFO: `/v3/projects/1c756a9e4b514efea26ae2b216c76285` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:42.531043 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0afa724-7db0-4ca8-ba3c-03b5ae112c21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c756a9e4b514efea26ae2b216c76285)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:42.532966 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0afa724-7db0-4ca8-ba3c-03b5ae112c21 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:42.585753 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e0afa724-7db0-4ca8-ba3c-03b5ae112c21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c756a9e4b514efea26ae2b216c76285', 'request_id': 'req-e0afa724-7db0-4ca8-ba3c-03b5ae112c21'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:42.600751 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e0afa724-7db0-4ca8-ba3c-03b5ae112c21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c756a9e4b514efea26ae2b216c76285', 'request_id': 'req-e0afa724-7db0-4ca8-ba3c-03b5ae112c21'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:42.606943 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e0afa724-7db0-4ca8-ba3c-03b5ae112c21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c756a9e4b514efea26ae2b216c76285', 'request_id': 'req-e0afa724-7db0-4ca8-ba3c-03b5ae112c21'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:42.618568 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e0afa724-7db0-4ca8-ba3c-03b5ae112c21 admin admin] The token cache is being invalidate because project 1c756a9e4b514efea26ae2b216c76285 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:03:42.618863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e0afa724-7db0-4ca8-ba3c-03b5ae112c21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:42.619615 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e0afa724-7db0-4ca8-ba3c-03b5ae112c21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:42.621382 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1342/2672] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:03:42 2022] DELETE /identity/v3/projects/1c756a9e4b514efea26ae2b216c76285 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:42.625589 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413ca10-9e65-45ec-b54e-da953f8e5a6a service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:42.636264 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413ca10-9e65-45ec-b54e-da953f8e5a6a service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:42.678107 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:42.701864 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d8aa4-c373-4f0c-bcf1-5d27c1100c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:42.703200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d8aa4-c373-4f0c-bcf1-5d27c1100c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:42.703594 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d8aa4-c373-4f0c-bcf1-5d27c1100c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:42.703996 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d8aa4-c373-4f0c-bcf1-5d27c1100c21 admin admin] PATH_INFO: `/v3/users/d912c754052e4c4e9c0e42b078c48457` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:42.705997 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d8aa4-c373-4f0c-bcf1-5d27c1100c21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d912c754052e4c4e9c0e42b078c48457)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:42.708981 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d8aa4-c373-4f0c-bcf1-5d27c1100c21 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:42.768443 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-079d8aa4-c373-4f0c-bcf1-5d27c1100c21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd912c754052e4c4e9c0e42b078c48457'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:42.775769 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-079d8aa4-c373-4f0c-bcf1-5d27c1100c21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd912c754052e4c4e9c0e42b078c48457'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:42.784637 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-079d8aa4-c373-4f0c-bcf1-5d27c1100c21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd912c754052e4c4e9c0e42b078c48457'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:42.785297 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-079d8aa4-c373-4f0c-bcf1-5d27c1100c21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd912c754052e4c4e9c0e42b078c48457'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:42.797896 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-079d8aa4-c373-4f0c-bcf1-5d27c1100c21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd912c754052e4c4e9c0e42b078c48457'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:42.803827 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1331/2673] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:03:42 2022] DELETE /identity/v3/users/d912c754052e4c4e9c0e42b078c48457 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:43.093810 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afa724-7db0-4ca8-ba3c-03b5ae112c21 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:43.095289 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e0afa724-7db0-4ca8-ba3c-03b5ae112c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:43.109452 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afa724-7db0-4ca8-ba3c-03b5ae112c21 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:43.166097 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a1588-80e5-4813-8c0c-37db870c81ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:43.166902 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a1588-80e5-4813-8c0c-37db870c81ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:43.167187 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a1588-80e5-4813-8c0c-37db870c81ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:43.167489 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a1588-80e5-4813-8c0c-37db870c81ee admin admin] PATH_INFO: `/v3/projects/b12c143da2fe4d06bf2ac47b9e908882` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:43.168677 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a1588-80e5-4813-8c0c-37db870c81ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=b12c143da2fe4d06bf2ac47b9e908882)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:43.170575 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a1588-80e5-4813-8c0c-37db870c81ee admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:43.216667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:43.219996 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d43a1588-80e5-4813-8c0c-37db870c81ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b12c143da2fe4d06bf2ac47b9e908882', 'request_id': 'req-d43a1588-80e5-4813-8c0c-37db870c81ee'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:43.229619 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d43a1588-80e5-4813-8c0c-37db870c81ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b12c143da2fe4d06bf2ac47b9e908882', 'request_id': 'req-d43a1588-80e5-4813-8c0c-37db870c81ee'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:43.235404 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d43a1588-80e5-4813-8c0c-37db870c81ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b12c143da2fe4d06bf2ac47b9e908882', 'request_id': 'req-d43a1588-80e5-4813-8c0c-37db870c81ee'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:43.247439 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d43a1588-80e5-4813-8c0c-37db870c81ee admin admin] The token cache is being invalidate because project b12c143da2fe4d06bf2ac47b9e908882 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:03:43.247846 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d43a1588-80e5-4813-8c0c-37db870c81ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:43.248551 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d43a1588-80e5-4813-8c0c-37db870c81ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:43.250244 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1343/2674] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:03:43 2022] DELETE /identity/v3/projects/b12c143da2fe4d06bf2ac47b9e908882 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:43.255519 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a308fa-2952-4c7c-943c-63da8a68e825 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:43.256053 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a308fa-2952-4c7c-943c-63da8a68e825 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:43.256053 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a308fa-2952-4c7c-943c-63da8a68e825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:43.274945 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-30a308fa-2952-4c7c-943c-63da8a68e825 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:43.276216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-30a308fa-2952-4c7c-943c-63da8a68e825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:43.338952 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1332/2675] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:43.347185 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12f579-30ac-4afe-8eaf-1d50abb880c2 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:43.347506 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12f579-30ac-4afe-8eaf-1d50abb880c2 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:43.347788 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12f579-30ac-4afe-8eaf-1d50abb880c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:43.368006 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-7c12f579-30ac-4afe-8eaf-1d50abb880c2 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:43.369194 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-7c12f579-30ac-4afe-8eaf-1d50abb880c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:43.377526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1344/2676] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:43.381907 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a308fa-2952-4c7c-943c-63da8a68e825 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:43.395123 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a308fa-2952-4c7c-943c-63da8a68e825 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:43.401268 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9a8fd-71e8-4a0b-974f-858415b2abc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:43.401933 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9a8fd-71e8-4a0b-974f-858415b2abc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:43.402217 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9a8fd-71e8-4a0b-974f-858415b2abc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:43.402494 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9a8fd-71e8-4a0b-974f-858415b2abc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:43.403259 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9a8fd-71e8-4a0b-974f-858415b2abc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 11:03:43.403565 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9a8fd-71e8-4a0b-974f-858415b2abc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:43.405159 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9a8fd-71e8-4a0b-974f-858415b2abc4 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:43.420334 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1333/2677] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 11:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 11:03:43.425250 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12f579-30ac-4afe-8eaf-1d50abb880c2 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:43.435028 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12f579-30ac-4afe-8eaf-1d50abb880c2 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:43.440010 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf424a6-3af7-48de-9658-3497e4db3d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:43.440655 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf424a6-3af7-48de-9658-3497e4db3d08 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:43.440935 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf424a6-3af7-48de-9658-3497e4db3d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:43.441206 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf424a6-3af7-48de-9658-3497e4db3d08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:43.441907 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf424a6-3af7-48de-9658-3497e4db3d08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:43.443843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf424a6-3af7-48de-9658-3497e4db3d08 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:43.470280 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1345/2678] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:03:43 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 11:03:43.474475 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9a8fd-71e8-4a0b-974f-858415b2abc4 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:43.484601 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9a8fd-71e8-4a0b-974f-858415b2abc4 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:43.529954 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:43.545547 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21219e49-2228-45c5-9065-c3a93d7bbfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:43.546230 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21219e49-2228-45c5-9065-c3a93d7bbfe2 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:43.546895 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21219e49-2228-45c5-9065-c3a93d7bbfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:43.547204 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21219e49-2228-45c5-9065-c3a93d7bbfe2 admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:43.547902 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21219e49-2228-45c5-9065-c3a93d7bbfe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:43.549881 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21219e49-2228-45c5-9065-c3a93d7bbfe2 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:43.571530 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1334/2679] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:03:43 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:03:43.579259 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf424a6-3af7-48de-9658-3497e4db3d08 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:43.590817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf424a6-3af7-48de-9658-3497e4db3d08 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:43.596789 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19255e-173c-4bd0-b0c0-7a3ea081d215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:43.597472 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19255e-173c-4bd0-b0c0-7a3ea081d215 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:43.597794 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19255e-173c-4bd0-b0c0-7a3ea081d215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:43.598070 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19255e-173c-4bd0-b0c0-7a3ea081d215 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:43.598802 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19255e-173c-4bd0-b0c0-7a3ea081d215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:43.600470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19255e-173c-4bd0-b0c0-7a3ea081d215 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:43.614747 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1346/2680] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:03:43.619039 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21219e49-2228-45c5-9065-c3a93d7bbfe2 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:43.632047 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21219e49-2228-45c5-9065-c3a93d7bbfe2 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:43.638119 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35839466-2b60-4144-a4ac-cb6fe325a4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:43.638813 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35839466-2b60-4144-a4ac-cb6fe325a4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:43.639102 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35839466-2b60-4144-a4ac-cb6fe325a4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:43.639424 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35839466-2b60-4144-a4ac-cb6fe325a4d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:43.640171 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35839466-2b60-4144-a4ac-cb6fe325a4d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:43.641928 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35839466-2b60-4144-a4ac-cb6fe325a4d3 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:43.658171 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1335/2681] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:03:43.660283 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19255e-173c-4bd0-b0c0-7a3ea081d215 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:43.673247 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19255e-173c-4bd0-b0c0-7a3ea081d215 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:43.678627 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b682dc3-b95c-424e-9946-c9d1942b072e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:43.679544 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b682dc3-b95c-424e-9946-c9d1942b072e admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:43.679825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b682dc3-b95c-424e-9946-c9d1942b072e admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:43.680231 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b682dc3-b95c-424e-9946-c9d1942b072e admin admin] PATH_INFO: `/v3/projects/a346aca969fd4ff6ab57217725e70e9a/users/5d8ad299cc25461f9bf8d5470e000272/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:43.695435 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b682dc3-b95c-424e-9946-c9d1942b072e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a346aca969fd4ff6ab57217725e70e9a, user_id=5d8ad299cc25461f9bf8d5470e000272, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:43.698243 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b682dc3-b95c-424e-9946-c9d1942b072e admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:43.713482 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1347/2682] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:03:43 2022] PUT /identity/v3/projects/a346aca969fd4ff6ab57217725e70e9a/users/5d8ad299cc25461f9bf8d5470e000272/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:43.723933 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdc5e3-d32c-48b6-8d85-6d1d40e9a32d None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:43.724228 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdc5e3-d32c-48b6-8d85-6d1d40e9a32d None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:43.724512 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdc5e3-d32c-48b6-8d85-6d1d40e9a32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:43.755111 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-93fdc5e3-d32c-48b6-8d85-6d1d40e9a32d None None] MFA Rules not processed for user `5d8ad299cc25461f9bf8d5470e000272`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:43.756360 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-93fdc5e3-d32c-48b6-8d85-6d1d40e9a32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:43.833376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1336/2683] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:43.839473 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b682dc3-b95c-424e-9946-c9d1942b072e admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:43.920188 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b682dc3-b95c-424e-9946-c9d1942b072e admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:43.926381 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c546feb-504b-4fe3-9574-51ad83753bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:43.927012 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c546feb-504b-4fe3-9574-51ad83753bfb admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:43.927322 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c546feb-504b-4fe3-9574-51ad83753bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:43.927589 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c546feb-504b-4fe3-9574-51ad83753bfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:43.928390 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c546feb-504b-4fe3-9574-51ad83753bfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:43.930323 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c546feb-504b-4fe3-9574-51ad83753bfb admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:43.961253 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1348/2684] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:03:43 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:03:43.966518 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fdc5e3-d32c-48b6-8d85-6d1d40e9a32d None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:43.980267 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fdc5e3-d32c-48b6-8d85-6d1d40e9a32d None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:44.050056 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07caaaf-69af-460f-8788-b64e546fe191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:44.051109 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07caaaf-69af-460f-8788-b64e546fe191 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:44.051415 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07caaaf-69af-460f-8788-b64e546fe191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:44.051687 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07caaaf-69af-460f-8788-b64e546fe191 admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:44.052385 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07caaaf-69af-460f-8788-b64e546fe191 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:44.054398 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07caaaf-69af-460f-8788-b64e546fe191 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:44.088778 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1337/2685] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:03:43 2022] POST /identity/v3/users => generated 298 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:03:44.092843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c546feb-504b-4fe3-9574-51ad83753bfb admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:44.106527 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c546feb-504b-4fe3-9574-51ad83753bfb admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:44.112062 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c1877-8903-4e1b-8260-42a3c2357cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:44.112753 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c1877-8903-4e1b-8260-42a3c2357cae admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:44.113051 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c1877-8903-4e1b-8260-42a3c2357cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:44.113320 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c1877-8903-4e1b-8260-42a3c2357cae admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:44.114059 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c1877-8903-4e1b-8260-42a3c2357cae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:44.115737 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c1877-8903-4e1b-8260-42a3c2357cae admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:44.127903 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1349/2686] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:03:44.132477 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07caaaf-69af-460f-8788-b64e546fe191 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:44.144279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07caaaf-69af-460f-8788-b64e546fe191 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:44.150151 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42b248-ab0f-4f5c-bd52-004bcd6c2856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:44.151976 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42b248-ab0f-4f5c-bd52-004bcd6c2856 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:44.152274 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42b248-ab0f-4f5c-bd52-004bcd6c2856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:44.152561 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42b248-ab0f-4f5c-bd52-004bcd6c2856 admin admin] PATH_INFO: `/v3/projects/f40cb6349d78466b8e579c676556a5c2/users/1ad79ae1b8cc452d9397b2c466861ef4/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:44.171180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc42b248-ab0f-4f5c-bd52-004bcd6c2856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f40cb6349d78466b8e579c676556a5c2, user_id=1ad79ae1b8cc452d9397b2c466861ef4, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:44.174217 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc42b248-ab0f-4f5c-bd52-004bcd6c2856 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:44.193603 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1338/2687] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:03:44 2022] PUT /identity/v3/projects/f40cb6349d78466b8e579c676556a5c2/users/1ad79ae1b8cc452d9397b2c466861ef4/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:44.199324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c1877-8903-4e1b-8260-42a3c2357cae admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:44.213439 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c1877-8903-4e1b-8260-42a3c2357cae admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:44.267527 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:44.289058 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f86b9f-d68b-4b8c-b40f-8c34482f4e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:44.290293 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f86b9f-d68b-4b8c-b40f-8c34482f4e78 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:44.290580 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f86b9f-d68b-4b8c-b40f-8c34482f4e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:44.290859 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f86b9f-d68b-4b8c-b40f-8c34482f4e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:44.291660 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f86b9f-d68b-4b8c-b40f-8c34482f4e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:44.293408 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f86b9f-d68b-4b8c-b40f-8c34482f4e78 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:44.305382 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1350/2688] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:03:44.311319 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42b248-ab0f-4f5c-bd52-004bcd6c2856 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:44.323474 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42b248-ab0f-4f5c-bd52-004bcd6c2856 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:44.328765 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295fee7-3f99-4a44-bfd3-22d7fa864b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:44.329778 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295fee7-3f99-4a44-bfd3-22d7fa864b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:44.330128 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295fee7-3f99-4a44-bfd3-22d7fa864b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:44.330408 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295fee7-3f99-4a44-bfd3-22d7fa864b57 admin admin] PATH_INFO: `/v3/projects/f40cb6349d78466b8e579c676556a5c2/users/1ad79ae1b8cc452d9397b2c466861ef4/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:44.332526 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b295fee7-3f99-4a44-bfd3-22d7fa864b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f40cb6349d78466b8e579c676556a5c2, user_id=1ad79ae1b8cc452d9397b2c466861ef4, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:44.335218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b295fee7-3f99-4a44-bfd3-22d7fa864b57 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:44.347535 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1339/2689] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:03:44 2022] PUT /identity/v3/projects/f40cb6349d78466b8e579c676556a5c2/users/1ad79ae1b8cc452d9397b2c466861ef4/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:44.416103 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3db519-49bf-4b2e-ad81-29cc0207b7f4 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:44.416377 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3db519-49bf-4b2e-ad81-29cc0207b7f4 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:44.416663 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3db519-49bf-4b2e-ad81-29cc0207b7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:44.446154 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-6b3db519-49bf-4b2e-ad81-29cc0207b7f4 None None] MFA Rules not processed for user `1ad79ae1b8cc452d9397b2c466861ef4`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:44.447329 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6b3db519-49bf-4b2e-ad81-29cc0207b7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:44.526154 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1351/2690] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:44.539367 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295fee7-3f99-4a44-bfd3-22d7fa864b57 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:44.541346 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-b295fee7-3f99-4a44-bfd3-22d7fa864b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:44.553116 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:44.619197 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295fee7-3f99-4a44-bfd3-22d7fa864b57 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:44.623340 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160c9b2-f0d5-4cee-9818-a4a6ebefa35d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:44.623999 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160c9b2-f0d5-4cee-9818-a4a6ebefa35d service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:44.624280 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160c9b2-f0d5-4cee-9818-a4a6ebefa35d service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:44.624553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160c9b2-f0d5-4cee-9818-a4a6ebefa35d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:44.636062 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160c9b2-f0d5-4cee-9818-a4a6ebefa35d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:44.637543 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160c9b2-f0d5-4cee-9818-a4a6ebefa35d service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:44.649845 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1340/2691] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:03:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:03:44.749333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3db519-49bf-4b2e-ad81-29cc0207b7f4 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:44.761893 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3db519-49bf-4b2e-ad81-29cc0207b7f4 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:44.766084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82494f7-be83-44d2-acdd-a8a501d25a67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:44.766738 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82494f7-be83-44d2-acdd-a8a501d25a67 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:44.767023 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82494f7-be83-44d2-acdd-a8a501d25a67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:44.767335 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82494f7-be83-44d2-acdd-a8a501d25a67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:44.839433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82494f7-be83-44d2-acdd-a8a501d25a67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:44.841007 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82494f7-be83-44d2-acdd-a8a501d25a67 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:44.850558 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1352/2692] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:03:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:03:45.165160 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160c9b2-f0d5-4cee-9818-a4a6ebefa35d service cinder] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:45.238745 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160c9b2-f0d5-4cee-9818-a4a6ebefa35d service cinder] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:45.244862 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30287e-c064-4891-937b-7e148b2687fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:45.245756 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30287e-c064-4891-937b-7e148b2687fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:45.246040 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30287e-c064-4891-937b-7e148b2687fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:45.246316 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30287e-c064-4891-937b-7e148b2687fe admin admin] PATH_INFO: `/v3/users/5d8ad299cc25461f9bf8d5470e000272` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:45.247656 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30287e-c064-4891-937b-7e148b2687fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d8ad299cc25461f9bf8d5470e000272)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:45.249602 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30287e-c064-4891-937b-7e148b2687fe admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:45.308042 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-5e30287e-c064-4891-937b-7e148b2687fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d8ad299cc25461f9bf8d5470e000272'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:45.315985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-5e30287e-c064-4891-937b-7e148b2687fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d8ad299cc25461f9bf8d5470e000272'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:45.328740 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-5e30287e-c064-4891-937b-7e148b2687fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d8ad299cc25461f9bf8d5470e000272'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:45.329436 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-5e30287e-c064-4891-937b-7e148b2687fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d8ad299cc25461f9bf8d5470e000272'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:45.343848 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-5e30287e-c064-4891-937b-7e148b2687fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d8ad299cc25461f9bf8d5470e000272'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:45.351742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1341/2693] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:03:45 2022] DELETE /identity/v3/users/5d8ad299cc25461f9bf8d5470e000272 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:45.357129 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a054f57-b604-4041-89c8-54e14d9a26c3 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:45.357725 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a054f57-b604-4041-89c8-54e14d9a26c3 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:45.357725 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a054f57-b604-4041-89c8-54e14d9a26c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:45.375728 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-9a054f57-b604-4041-89c8-54e14d9a26c3 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:45.377044 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9a054f57-b604-4041-89c8-54e14d9a26c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:45.438204 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1353/2694] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:45.449672 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30287e-c064-4891-937b-7e148b2687fe admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:45.451341 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-5e30287e-c064-4891-937b-7e148b2687fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:45.485180 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:45.517496 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30287e-c064-4891-937b-7e148b2687fe admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:45.521466 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da65bf4-8d5f-4356-9a3f-a3ac00ba4ef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:45.522234 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da65bf4-8d5f-4356-9a3f-a3ac00ba4ef7 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:45.522527 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da65bf4-8d5f-4356-9a3f-a3ac00ba4ef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:45.522799 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da65bf4-8d5f-4356-9a3f-a3ac00ba4ef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:45.532395 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da65bf4-8d5f-4356-9a3f-a3ac00ba4ef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:45.533825 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da65bf4-8d5f-4356-9a3f-a3ac00ba4ef7 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:45.543479 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1342/2695] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:03:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:03:45.823862 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a054f57-b604-4041-89c8-54e14d9a26c3 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:45.825446 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9a054f57-b604-4041-89c8-54e14d9a26c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:45.833722 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:45.838702 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a054f57-b604-4041-89c8-54e14d9a26c3 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:45.844238 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be78e85-2e99-4278-a2d2-592b664cd040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:45.845121 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be78e85-2e99-4278-a2d2-592b664cd040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:45.845410 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be78e85-2e99-4278-a2d2-592b664cd040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:45.845673 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be78e85-2e99-4278-a2d2-592b664cd040 admin admin] PATH_INFO: `/v3/projects/a346aca969fd4ff6ab57217725e70e9a` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:45.846934 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be78e85-2e99-4278-a2d2-592b664cd040 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a346aca969fd4ff6ab57217725e70e9a)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:45.848888 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be78e85-2e99-4278-a2d2-592b664cd040 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:45.898247 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-5be78e85-2e99-4278-a2d2-592b664cd040 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a346aca969fd4ff6ab57217725e70e9a', 'request_id': 'req-5be78e85-2e99-4278-a2d2-592b664cd040'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:45.907387 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-5be78e85-2e99-4278-a2d2-592b664cd040 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a346aca969fd4ff6ab57217725e70e9a', 'request_id': 'req-5be78e85-2e99-4278-a2d2-592b664cd040'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:45.913885 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-5be78e85-2e99-4278-a2d2-592b664cd040 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a346aca969fd4ff6ab57217725e70e9a', 'request_id': 'req-5be78e85-2e99-4278-a2d2-592b664cd040'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:45.926283 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-5be78e85-2e99-4278-a2d2-592b664cd040 admin admin] The token cache is being invalidate because project a346aca969fd4ff6ab57217725e70e9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:03:45.926570 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-5be78e85-2e99-4278-a2d2-592b664cd040 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:45.927291 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-5be78e85-2e99-4278-a2d2-592b664cd040 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:45.928897 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1354/2696] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:03:45 2022] DELETE /identity/v3/projects/a346aca969fd4ff6ab57217725e70e9a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:45.933294 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da65bf4-8d5f-4356-9a3f-a3ac00ba4ef7 service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:45.944228 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da65bf4-8d5f-4356-9a3f-a3ac00ba4ef7 service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:46.005632 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76f6fb-3aa8-48fa-9241-a9112de766df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:46.006525 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76f6fb-3aa8-48fa-9241-a9112de766df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:46.006827 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76f6fb-3aa8-48fa-9241-a9112de766df admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:46.007121 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76f6fb-3aa8-48fa-9241-a9112de766df admin admin] PATH_INFO: `/v3/users/1ad79ae1b8cc452d9397b2c466861ef4` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:46.008354 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76f6fb-3aa8-48fa-9241-a9112de766df admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ad79ae1b8cc452d9397b2c466861ef4)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:46.010353 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76f6fb-3aa8-48fa-9241-a9112de766df admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:46.059155 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-cd76f6fb-3aa8-48fa-9241-a9112de766df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ad79ae1b8cc452d9397b2c466861ef4'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:46.066020 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-cd76f6fb-3aa8-48fa-9241-a9112de766df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ad79ae1b8cc452d9397b2c466861ef4'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:46.076281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-cd76f6fb-3aa8-48fa-9241-a9112de766df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ad79ae1b8cc452d9397b2c466861ef4'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:46.076913 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-cd76f6fb-3aa8-48fa-9241-a9112de766df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ad79ae1b8cc452d9397b2c466861ef4'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:46.089665 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-cd76f6fb-3aa8-48fa-9241-a9112de766df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ad79ae1b8cc452d9397b2c466861ef4'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:46.095813 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1343/2697] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:03:45 2022] DELETE /identity/v3/users/1ad79ae1b8cc452d9397b2c466861ef4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:46.374078 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be78e85-2e99-4278-a2d2-592b664cd040 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:46.375676 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5be78e85-2e99-4278-a2d2-592b664cd040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:46.397118 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be78e85-2e99-4278-a2d2-592b664cd040 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:46.471479 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe344532-4c11-47b0-a7ba-2081bcc9c4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:46.472808 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe344532-4c11-47b0-a7ba-2081bcc9c4ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:46.473245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe344532-4c11-47b0-a7ba-2081bcc9c4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:46.473645 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe344532-4c11-47b0-a7ba-2081bcc9c4ec admin admin] PATH_INFO: `/v3/projects/f40cb6349d78466b8e579c676556a5c2` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:46.475522 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe344532-4c11-47b0-a7ba-2081bcc9c4ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=f40cb6349d78466b8e579c676556a5c2)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:46.478631 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe344532-4c11-47b0-a7ba-2081bcc9c4ec admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:46.525904 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-fe344532-4c11-47b0-a7ba-2081bcc9c4ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f40cb6349d78466b8e579c676556a5c2', 'request_id': 'req-fe344532-4c11-47b0-a7ba-2081bcc9c4ec'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:46.534885 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-fe344532-4c11-47b0-a7ba-2081bcc9c4ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f40cb6349d78466b8e579c676556a5c2', 'request_id': 'req-fe344532-4c11-47b0-a7ba-2081bcc9c4ec'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:46.541443 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-fe344532-4c11-47b0-a7ba-2081bcc9c4ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f40cb6349d78466b8e579c676556a5c2', 'request_id': 'req-fe344532-4c11-47b0-a7ba-2081bcc9c4ec'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:46.553985 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-fe344532-4c11-47b0-a7ba-2081bcc9c4ec admin admin] The token cache is being invalidate because project f40cb6349d78466b8e579c676556a5c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:03:46.554272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-fe344532-4c11-47b0-a7ba-2081bcc9c4ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:46.554966 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-fe344532-4c11-47b0-a7ba-2081bcc9c4ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:03:46.557151 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1355/2698] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:03:46 2022] DELETE /identity/v3/projects/f40cb6349d78466b8e579c676556a5c2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:46.562124 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436aaf3a-dac3-43f5-aa7f-e65ca18d24de None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:46.562595 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436aaf3a-dac3-43f5-aa7f-e65ca18d24de None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:46.562719 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436aaf3a-dac3-43f5-aa7f-e65ca18d24de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:46.581770 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-436aaf3a-dac3-43f5-aa7f-e65ca18d24de None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:46.582967 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-436aaf3a-dac3-43f5-aa7f-e65ca18d24de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:46.631082 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:46.653571 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1344/2699] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:46.661827 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e7260-1d86-47ad-a909-02edceeb360e None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:46.662527 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e7260-1d86-47ad-a909-02edceeb360e None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:46.662527 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e7260-1d86-47ad-a909-02edceeb360e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:46.705780 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-0e6e7260-1d86-47ad-a909-02edceeb360e None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:46.707674 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-0e6e7260-1d86-47ad-a909-02edceeb360e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:46.719119 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1356/2700] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:46.725153 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436aaf3a-dac3-43f5-aa7f-e65ca18d24de None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:46.736326 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436aaf3a-dac3-43f5-aa7f-e65ca18d24de None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:46.742620 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fc61b-370a-436f-8572-2a7ec461d046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:46.743952 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fc61b-370a-436f-8572-2a7ec461d046 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:46.744233 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fc61b-370a-436f-8572-2a7ec461d046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:46.744506 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fc61b-370a-436f-8572-2a7ec461d046 admin admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:46.745243 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124fc61b-370a-436f-8572-2a7ec461d046 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 11:03:46.745547 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124fc61b-370a-436f-8572-2a7ec461d046 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:46.747173 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124fc61b-370a-436f-8572-2a7ec461d046 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:46.760176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1345/2701] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 11:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 11:03:46.764669 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e7260-1d86-47ad-a909-02edceeb360e None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:46.774408 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e7260-1d86-47ad-a909-02edceeb360e None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:46.783304 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6f285-aadf-47eb-97df-20c23338204f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:46.784378 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6f285-aadf-47eb-97df-20c23338204f admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:46.784824 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6f285-aadf-47eb-97df-20c23338204f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:46.785272 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6f285-aadf-47eb-97df-20c23338204f admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:46.786282 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6f285-aadf-47eb-97df-20c23338204f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:46.789376 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6f285-aadf-47eb-97df-20c23338204f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:46.803848 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:46.825268 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1357/2702] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:03:46 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:03:46.829522 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fc61b-370a-436f-8572-2a7ec461d046 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:46.840331 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fc61b-370a-436f-8572-2a7ec461d046 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:46.903454 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204994d-efe5-4fbb-946e-b009927db294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:46.904054 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204994d-efe5-4fbb-946e-b009927db294 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:46.904334 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204994d-efe5-4fbb-946e-b009927db294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:46.904604 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204994d-efe5-4fbb-946e-b009927db294 admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:46.905310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204994d-efe5-4fbb-946e-b009927db294 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:46.907314 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204994d-efe5-4fbb-946e-b009927db294 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:46.930851 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1346/2703] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:03:46 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 11:03:46.935897 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6f285-aadf-47eb-97df-20c23338204f admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:46.950583 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6f285-aadf-47eb-97df-20c23338204f admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:46.956146 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d024ab9-0b6f-4069-818d-a13225481352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:46.956830 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d024ab9-0b6f-4069-818d-a13225481352 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:46.957115 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d024ab9-0b6f-4069-818d-a13225481352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:46.957386 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d024ab9-0b6f-4069-818d-a13225481352 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:46.958127 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d024ab9-0b6f-4069-818d-a13225481352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:46.959788 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d024ab9-0b6f-4069-818d-a13225481352 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:46.970777 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1358/2704] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:03:46.974777 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204994d-efe5-4fbb-946e-b009927db294 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:46.985283 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204994d-efe5-4fbb-946e-b009927db294 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:46.990363 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49603b-9495-43ae-bbbd-7a91282428aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:46.991048 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49603b-9495-43ae-bbbd-7a91282428aa admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:46.991343 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49603b-9495-43ae-bbbd-7a91282428aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:46.991623 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49603b-9495-43ae-bbbd-7a91282428aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:46.992336 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49603b-9495-43ae-bbbd-7a91282428aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:46.994024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49603b-9495-43ae-bbbd-7a91282428aa admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:47.004172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1347/2705] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:03:47.008228 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d024ab9-0b6f-4069-818d-a13225481352 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:47.018485 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d024ab9-0b6f-4069-818d-a13225481352 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:47.024331 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107416f-21d8-46ca-b935-4ea8eb3d0dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:47.025220 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107416f-21d8-46ca-b935-4ea8eb3d0dba admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:47.025501 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107416f-21d8-46ca-b935-4ea8eb3d0dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:47.025780 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107416f-21d8-46ca-b935-4ea8eb3d0dba admin admin] PATH_INFO: `/v3/projects/8110aca033444d74b0d49095fda4ad17/users/ae5df30bf1424bfdaced8e4711829ad6/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:47.042642 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107416f-21d8-46ca-b935-4ea8eb3d0dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=8110aca033444d74b0d49095fda4ad17, user_id=ae5df30bf1424bfdaced8e4711829ad6, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:47.047344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107416f-21d8-46ca-b935-4ea8eb3d0dba admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:47.066387 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1359/2706] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:03:47 2022] PUT /identity/v3/projects/8110aca033444d74b0d49095fda4ad17/users/ae5df30bf1424bfdaced8e4711829ad6/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:03:47.072077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ac119-52ca-4805-bb8d-fd951c96061f None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:47.072370 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ac119-52ca-4805-bb8d-fd951c96061f None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:47.072653 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ac119-52ca-4805-bb8d-fd951c96061f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:47.090846 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-be2ac119-52ca-4805-bb8d-fd951c96061f None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:47.092086 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-be2ac119-52ca-4805-bb8d-fd951c96061f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:47.157532 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1348/2707] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 11:03:47.170564 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107416f-21d8-46ca-b935-4ea8eb3d0dba admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:47.172894 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-4107416f-21d8-46ca-b935-4ea8eb3d0dba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:47.231699 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107416f-21d8-46ca-b935-4ea8eb3d0dba admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:47.235897 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb24062-60aa-469b-b0d0-5d432d986291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:47.236546 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb24062-60aa-469b-b0d0-5d432d986291 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:47.236832 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb24062-60aa-469b-b0d0-5d432d986291 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:47.237106 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb24062-60aa-469b-b0d0-5d432d986291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:47.247388 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb24062-60aa-469b-b0d0-5d432d986291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:47.248899 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb24062-60aa-469b-b0d0-5d432d986291 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:47.259062 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1360/2708] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:03:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:03:47.891281 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b24854-1e24-4d10-93a8-4427688dd384 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:47.891794 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b24854-1e24-4d10-93a8-4427688dd384 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:47.891890 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b24854-1e24-4d10-93a8-4427688dd384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:47.919487 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-b8b24854-1e24-4d10-93a8-4427688dd384 None None] MFA Rules not processed for user `ae5df30bf1424bfdaced8e4711829ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:47.920742 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-b8b24854-1e24-4d10-93a8-4427688dd384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:47.969257 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:03:47.993594 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1349/2709] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:48.005064 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb24062-60aa-469b-b0d0-5d432d986291 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:48.006741 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5fb24062-60aa-469b-b0d0-5d432d986291 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:48.070117 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb24062-60aa-469b-b0d0-5d432d986291 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:48.074188 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25690a5-d4a3-43df-9591-1cb15c1ccb9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:48.074852 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25690a5-d4a3-43df-9591-1cb15c1ccb9a service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:48.075140 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25690a5-d4a3-43df-9591-1cb15c1ccb9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:48.075452 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25690a5-d4a3-43df-9591-1cb15c1ccb9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:48.084197 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25690a5-d4a3-43df-9591-1cb15c1ccb9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:48.085637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25690a5-d4a3-43df-9591-1cb15c1ccb9a service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:48.094727 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1361/2710] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:03:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:03:49.473530 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df5f4f-6f61-4dee-a2bd-58e082bf5d24 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:49.474058 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df5f4f-6f61-4dee-a2bd-58e082bf5d24 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:49.474058 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df5f4f-6f61-4dee-a2bd-58e082bf5d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:49.491756 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-e1df5f4f-6f61-4dee-a2bd-58e082bf5d24 None None] MFA Rules not processed for user `ae5df30bf1424bfdaced8e4711829ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:03:49.492981 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-e1df5f4f-6f61-4dee-a2bd-58e082bf5d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:49.500678 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1350/2711] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:03:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:03:51.778346 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25690a5-d4a3-43df-9591-1cb15c1ccb9a service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:51.788535 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25690a5-d4a3-43df-9591-1cb15c1ccb9a service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:51.792843 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e35452-b8c5-4a91-9d89-64ea269a9a55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:51.793491 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e35452-b8c5-4a91-9d89-64ea269a9a55 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:51.793780 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e35452-b8c5-4a91-9d89-64ea269a9a55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:51.794064 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e35452-b8c5-4a91-9d89-64ea269a9a55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:51.795994 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-f1e35452-b8c5-4a91-9d89-64ea269a9a55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:51.806230 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e35452-b8c5-4a91-9d89-64ea269a9a55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:51.807789 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e35452-b8c5-4a91-9d89-64ea269a9a55 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:51.816078 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1362/2712] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:03:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:03:57.651865 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df5f4f-6f61-4dee-a2bd-58e082bf5d24 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:03:57.654036 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-e1df5f4f-6f61-4dee-a2bd-58e082bf5d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:57.668551 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df5f4f-6f61-4dee-a2bd-58e082bf5d24 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:03:57.672897 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2bfc2-88ec-4ccb-8713-e2dfcd189ebc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:03:57.673588 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2bfc2-88ec-4ccb-8713-e2dfcd189ebc service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:03:57.673876 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2bfc2-88ec-4ccb-8713-e2dfcd189ebc service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:03:57.674155 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2bfc2-88ec-4ccb-8713-e2dfcd189ebc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:03:57.676101 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-6be2bfc2-88ec-4ccb-8713-e2dfcd189ebc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:03:57.768668 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be2bfc2-88ec-4ccb-8713-e2dfcd189ebc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:03:57.770105 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be2bfc2-88ec-4ccb-8713-e2dfcd189ebc service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:03:57.789983 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1351/2713] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:03:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:04:01.324986 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e35452-b8c5-4a91-9d89-64ea269a9a55 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:04:01.326438 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-f1e35452-b8c5-4a91-9d89-64ea269a9a55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:04:01.387774 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:04:01.423643 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e35452-b8c5-4a91-9d89-64ea269a9a55 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:04:01.429970 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a9103-6467-4184-9e42-15fc6848cbf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:04:01.430865 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a9103-6467-4184-9e42-15fc6848cbf9 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:04:01.431061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a9103-6467-4184-9e42-15fc6848cbf9 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:04:01.431359 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a9103-6467-4184-9e42-15fc6848cbf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:04:01.433538 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-538a9103-6467-4184-9e42-15fc6848cbf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:04:01.448269 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a9103-6467-4184-9e42-15fc6848cbf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:04:01.450667 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a9103-6467-4184-9e42-15fc6848cbf9 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:04:01.462748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1363/2714] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:04:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:04:05.982092 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2bfc2-88ec-4ccb-8713-e2dfcd189ebc service cinder] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:04:05.992599 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2bfc2-88ec-4ccb-8713-e2dfcd189ebc service cinder] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:04:05.997376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58e4de-58d0-4d86-a070-9c8d4d9abf09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:04:05.998083 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58e4de-58d0-4d86-a070-9c8d4d9abf09 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:04:05.998368 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58e4de-58d0-4d86-a070-9c8d4d9abf09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:04:05.998637 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58e4de-58d0-4d86-a070-9c8d4d9abf09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:04:06.005701 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-8e58e4de-58d0-4d86-a070-9c8d4d9abf09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:04:06.019569 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58e4de-58d0-4d86-a070-9c8d4d9abf09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:04:06.020998 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58e4de-58d0-4d86-a070-9c8d4d9abf09 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:04:06.031185 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1352/2715] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:04:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:04:09.252315 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a9103-6467-4184-9e42-15fc6848cbf9 service nova] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:04:09.253905 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-538a9103-6467-4184-9e42-15fc6848cbf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:04:09.326900 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58e4de-58d0-4d86-a070-9c8d4d9abf09 service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:04:09.328527 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-8e58e4de-58d0-4d86-a070-9c8d4d9abf09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:04:09.337295 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a9103-6467-4184-9e42-15fc6848cbf9 service nova] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:04:09.342402 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58e4de-58d0-4d86-a070-9c8d4d9abf09 service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:04:09.343617 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a523cc-90d9-42a5-83d2-1b5b39f9fa16 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b365d9dd635e4518a41181649c323062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:04:09.349012 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a523cc-90d9-42a5-83d2-1b5b39f9fa16 service placement] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:04:09.349012 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a523cc-90d9-42a5-83d2-1b5b39f9fa16 service placement] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:04:09.349012 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a523cc-90d9-42a5-83d2-1b5b39f9fa16 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:04:09.350453 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-27a523cc-90d9-42a5-83d2-1b5b39f9fa16 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:04:09.351770 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5838b5-ac5f-4cec-a656-194150734689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:04:09.352681 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5838b5-ac5f-4cec-a656-194150734689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:04:09.352969 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5838b5-ac5f-4cec-a656-194150734689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:04:09.353252 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5838b5-ac5f-4cec-a656-194150734689 admin admin] PATH_INFO: `/v3/users/25281e85b31b47d9889838ba5a65c328` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:04:09.354459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5838b5-ac5f-4cec-a656-194150734689 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25281e85b31b47d9889838ba5a65c328)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:04:09.356470 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5838b5-ac5f-4cec-a656-194150734689 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:04:09.368621 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a523cc-90d9-42a5-83d2-1b5b39f9fa16 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:04:09.370480 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a523cc-90d9-42a5-83d2-1b5b39f9fa16 service placement] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:04:09.381204 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1364/2716] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:04:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:04:09.413344 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-3b5838b5-ac5f-4cec-a656-194150734689 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25281e85b31b47d9889838ba5a65c328'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:04:09.420466 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-3b5838b5-ac5f-4cec-a656-194150734689 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25281e85b31b47d9889838ba5a65c328'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:04:09.429740 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-3b5838b5-ac5f-4cec-a656-194150734689 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25281e85b31b47d9889838ba5a65c328'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:04:09.430376 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-3b5838b5-ac5f-4cec-a656-194150734689 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25281e85b31b47d9889838ba5a65c328'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:04:09.442275 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-3b5838b5-ac5f-4cec-a656-194150734689 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25281e85b31b47d9889838ba5a65c328'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:04:09.448109 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1353/2717] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:04:09 2022] DELETE /identity/v3/users/25281e85b31b47d9889838ba5a65c328 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:04:09.633140 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a523cc-90d9-42a5-83d2-1b5b39f9fa16 service placement] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:04:09.644933 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a523cc-90d9-42a5-83d2-1b5b39f9fa16 service placement] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:04:09.719294 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc1d1e-0e7e-4a3c-9988-f9cf84b6b4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:04:09.720203 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc1d1e-0e7e-4a3c-9988-f9cf84b6b4a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:04:09.720484 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc1d1e-0e7e-4a3c-9988-f9cf84b6b4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:04:09.720772 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc1d1e-0e7e-4a3c-9988-f9cf84b6b4a2 admin admin] PATH_INFO: `/v3/projects/74e4808575f64e5b9c5d8e68784dc504` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:04:09.722064 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc1d1e-0e7e-4a3c-9988-f9cf84b6b4a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74e4808575f64e5b9c5d8e68784dc504)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:04:09.724116 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc1d1e-0e7e-4a3c-9988-f9cf84b6b4a2 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:04:09.780056 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-29cc1d1e-0e7e-4a3c-9988-f9cf84b6b4a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74e4808575f64e5b9c5d8e68784dc504', 'request_id': 'req-29cc1d1e-0e7e-4a3c-9988-f9cf84b6b4a2'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:04:09.789737 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-29cc1d1e-0e7e-4a3c-9988-f9cf84b6b4a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74e4808575f64e5b9c5d8e68784dc504', 'request_id': 'req-29cc1d1e-0e7e-4a3c-9988-f9cf84b6b4a2'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:04:09.794873 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:04:09.796975 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-29cc1d1e-0e7e-4a3c-9988-f9cf84b6b4a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74e4808575f64e5b9c5d8e68784dc504', 'request_id': 'req-29cc1d1e-0e7e-4a3c-9988-f9cf84b6b4a2'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:04:09.811595 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-29cc1d1e-0e7e-4a3c-9988-f9cf84b6b4a2 admin admin] The token cache is being invalidate because project 74e4808575f64e5b9c5d8e68784dc504 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:04:09.811966 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-29cc1d1e-0e7e-4a3c-9988-f9cf84b6b4a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:04:09.812697 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-29cc1d1e-0e7e-4a3c-9988-f9cf84b6b4a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:04:09.814326 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1365/2718] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:04:09 2022] DELETE /identity/v3/projects/74e4808575f64e5b9c5d8e68784dc504 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:04:09.819382 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fd3e6-0d6c-4738-940b-7f715e74c2ae None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:04:09.819681 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fd3e6-0d6c-4738-940b-7f715e74c2ae None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:04:09.819964 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fd3e6-0d6c-4738-940b-7f715e74c2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:04:09.838795 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-520fd3e6-0d6c-4738-940b-7f715e74c2ae None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:04:09.839998 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-520fd3e6-0d6c-4738-940b-7f715e74c2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:04:09.846362 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:04:09.909091 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1354/2719] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:04:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:04:09.917510 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe0c05-f0da-450d-ad64-57e5e31e559e None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:04:09.917806 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe0c05-f0da-450d-ad64-57e5e31e559e None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:04:09.918091 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe0c05-f0da-450d-ad64-57e5e31e559e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:04:09.938316 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-66fe0c05-f0da-450d-ad64-57e5e31e559e None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:04:09.939787 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-66fe0c05-f0da-450d-ad64-57e5e31e559e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:04:09.948411 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1366/2720] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:04:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:04:09.952961 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fd3e6-0d6c-4738-940b-7f715e74c2ae None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:04:09.963167 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fd3e6-0d6c-4738-940b-7f715e74c2ae None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:04:09.968358 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b0893-4b97-46ed-8dc2-950b4a084b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:04:09.968972 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b0893-4b97-46ed-8dc2-950b4a084b8e admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:04:09.969263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b0893-4b97-46ed-8dc2-950b4a084b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:04:09.969541 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b0893-4b97-46ed-8dc2-950b4a084b8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:04:09.970279 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b0893-4b97-46ed-8dc2-950b4a084b8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 11:04:09.970624 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b0893-4b97-46ed-8dc2-950b4a084b8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:04:09.972278 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b0893-4b97-46ed-8dc2-950b4a084b8e admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:04:09.984388 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1355/2721] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 11:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 11:04:09.989371 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe0c05-f0da-450d-ad64-57e5e31e559e None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:04:09.999333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe0c05-f0da-450d-ad64-57e5e31e559e None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:04:10.004307 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fbfea-b576-453c-8797-ebbce95c1b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:04:10.004969 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fbfea-b576-453c-8797-ebbce95c1b5e admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:04:10.005254 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fbfea-b576-453c-8797-ebbce95c1b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:04:10.005522 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fbfea-b576-453c-8797-ebbce95c1b5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:04:10.006237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506fbfea-b576-453c-8797-ebbce95c1b5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:04:10.008196 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506fbfea-b576-453c-8797-ebbce95c1b5e admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:04:10.036690 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1367/2722] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:04:09 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:04:10.041094 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b0893-4b97-46ed-8dc2-950b4a084b8e admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:04:10.052190 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b0893-4b97-46ed-8dc2-950b4a084b8e admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:04:10.116824 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137c0dd-0d92-4d61-9650-8d841f7bc96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:04:10.117514 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137c0dd-0d92-4d61-9650-8d841f7bc96c admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:04:10.117801 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137c0dd-0d92-4d61-9650-8d841f7bc96c admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:04:10.118079 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137c0dd-0d92-4d61-9650-8d841f7bc96c admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:04:10.118775 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137c0dd-0d92-4d61-9650-8d841f7bc96c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:04:10.120734 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137c0dd-0d92-4d61-9650-8d841f7bc96c admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:04:10.146393 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1356/2723] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:04:10 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:04:10.151181 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fbfea-b576-453c-8797-ebbce95c1b5e admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:04:10.163313 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fbfea-b576-453c-8797-ebbce95c1b5e admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:04:10.168373 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78005acc-26b0-42b5-9e06-eece1eb702c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:04:10.169031 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78005acc-26b0-42b5-9e06-eece1eb702c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:04:10.169315 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78005acc-26b0-42b5-9e06-eece1eb702c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:04:10.169588 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78005acc-26b0-42b5-9e06-eece1eb702c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:04:10.170309 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78005acc-26b0-42b5-9e06-eece1eb702c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:04:10.172440 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78005acc-26b0-42b5-9e06-eece1eb702c5 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:04:10.183101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1368/2724] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:04:10.187088 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137c0dd-0d92-4d61-9650-8d841f7bc96c admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:04:10.197866 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137c0dd-0d92-4d61-9650-8d841f7bc96c admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:04:10.203916 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20db6da-9b18-4114-9f1c-3edc670e8f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:04:10.204708 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20db6da-9b18-4114-9f1c-3edc670e8f46 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:04:10.205170 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20db6da-9b18-4114-9f1c-3edc670e8f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:04:10.205511 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20db6da-9b18-4114-9f1c-3edc670e8f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:04:10.206269 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20db6da-9b18-4114-9f1c-3edc670e8f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:04:10.207949 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20db6da-9b18-4114-9f1c-3edc670e8f46 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:04:10.219301 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1357/2725] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:04:10.223317 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78005acc-26b0-42b5-9e06-eece1eb702c5 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:04:10.233748 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78005acc-26b0-42b5-9e06-eece1eb702c5 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:04:10.239058 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ef931-27d0-4018-a976-e624e921171d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:04:10.240019 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ef931-27d0-4018-a976-e624e921171d admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:04:10.240300 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ef931-27d0-4018-a976-e624e921171d admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:04:10.240571 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ef931-27d0-4018-a976-e624e921171d admin admin] PATH_INFO: `/v3/projects/fa621614a8cf401593c3b10dd5738127/users/0c6d8051a64a4633bb86c54d9030c8ac/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:04:10.256570 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ef931-27d0-4018-a976-e624e921171d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa621614a8cf401593c3b10dd5738127, user_id=0c6d8051a64a4633bb86c54d9030c8ac, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:04:10.259771 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ef931-27d0-4018-a976-e624e921171d admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:04:10.279253 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1369/2726] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:04:10 2022] PUT /identity/v3/projects/fa621614a8cf401593c3b10dd5738127/users/0c6d8051a64a4633bb86c54d9030c8ac/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:04:10.282002 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743c361-bd51-4a73-9de4-1489871a6976 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:04:10.282296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743c361-bd51-4a73-9de4-1489871a6976 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:04:10.282701 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743c361-bd51-4a73-9de4-1489871a6976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:04:10.302887 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-d743c361-bd51-4a73-9de4-1489871a6976 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:04:10.304369 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-d743c361-bd51-4a73-9de4-1489871a6976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:04:10.373200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1358/2727] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:04:10.383588 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ef931-27d0-4018-a976-e624e921171d admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:04:10.385601 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-655ef931-27d0-4018-a976-e624e921171d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:04:10.456108 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ef931-27d0-4018-a976-e624e921171d admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:04:10.460588 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878a5ae-b9e8-4d51-b617-c6ae87effa78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:04:10.461256 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878a5ae-b9e8-4d51-b617-c6ae87effa78 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:04:10.461536 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878a5ae-b9e8-4d51-b617-c6ae87effa78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:04:10.461818 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878a5ae-b9e8-4d51-b617-c6ae87effa78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:04:10.471821 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7878a5ae-b9e8-4d51-b617-c6ae87effa78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:04:10.473201 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7878a5ae-b9e8-4d51-b617-c6ae87effa78 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:04:10.483455 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1370/2728] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:04:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 11:04:14.638874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b66e3b-eb38-4d96-938e-01cb95e3bbf6 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:04:14.638874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b66e3b-eb38-4d96-938e-01cb95e3bbf6 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:04:14.639469 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b66e3b-eb38-4d96-938e-01cb95e3bbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:04:14.689975 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-18b66e3b-eb38-4d96-938e-01cb95e3bbf6 None None] MFA Rules not processed for user `0c6d8051a64a4633bb86c54d9030c8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:04:14.691273 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-18b66e3b-eb38-4d96-938e-01cb95e3bbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:04:14.695360 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:04:14.763535 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1359/2729] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:04:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:04:14.779392 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878a5ae-b9e8-4d51-b617-c6ae87effa78 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:04:14.782171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-7878a5ae-b9e8-4d51-b617-c6ae87effa78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:04:14.860359 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878a5ae-b9e8-4d51-b617-c6ae87effa78 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:04:14.865895 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ce6e3-bb55-4881-aba3-89a8302ecbe1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:04:14.866574 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ce6e3-bb55-4881-aba3-89a8302ecbe1 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:04:14.866850 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ce6e3-bb55-4881-aba3-89a8302ecbe1 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:04:14.867114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ce6e3-bb55-4881-aba3-89a8302ecbe1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:04:14.876481 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ce6e3-bb55-4881-aba3-89a8302ecbe1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:04:14.878124 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ce6e3-bb55-4881-aba3-89a8302ecbe1 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:04:14.888266 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1371/2730] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:04:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:04:16.243923 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4621509-5354-473b-96ba-fce180c45d6d None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:04:16.244432 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4621509-5354-473b-96ba-fce180c45d6d None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:04:16.244528 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4621509-5354-473b-96ba-fce180c45d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:04:16.263135 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-a4621509-5354-473b-96ba-fce180c45d6d None None] MFA Rules not processed for user `0c6d8051a64a4633bb86c54d9030c8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:04:16.264316 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-a4621509-5354-473b-96ba-fce180c45d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:04:16.274536 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1360/2731] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:04:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:04:24.884592 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=91,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:04:26.258603 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=28 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:05:11.349786 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91b1da-576c-4926-b7d6-ea0071f2ea6a None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:05:11.350400 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91b1da-576c-4926-b7d6-ea0071f2ea6a None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:05:11.350400 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91b1da-576c-4926-b7d6-ea0071f2ea6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:05:11.370056 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-ad91b1da-576c-4926-b7d6-ea0071f2ea6a None None] MFA Rules not processed for user `ae5df30bf1424bfdaced8e4711829ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:05:11.371362 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-ad91b1da-576c-4926-b7d6-ea0071f2ea6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:05:11.428409 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1372/2732] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:05:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:05:11.677170 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4621509-5354-473b-96ba-fce180c45d6d None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:05:11.679411 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-a4621509-5354-473b-96ba-fce180c45d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:05:11.691766 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4621509-5354-473b-96ba-fce180c45d6d None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:05:11.695971 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7765ac-9d78-470f-90b0-fc0210fb65e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:05:11.696629 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7765ac-9d78-470f-90b0-fc0210fb65e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:05:11.697988 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7765ac-9d78-470f-90b0-fc0210fb65e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:05:11.698449 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7765ac-9d78-470f-90b0-fc0210fb65e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:05:11.702183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-ba7765ac-9d78-470f-90b0-fc0210fb65e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:05:11.716599 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7765ac-9d78-470f-90b0-fc0210fb65e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:05:11.718028 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7765ac-9d78-470f-90b0-fc0210fb65e8 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:05:11.726072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1361/2733] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:05:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:05:12.328391 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91b1da-576c-4926-b7d6-ea0071f2ea6a None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:05:12.329941 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-ad91b1da-576c-4926-b7d6-ea0071f2ea6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:05:12.408318 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91b1da-576c-4926-b7d6-ea0071f2ea6a None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:05:12.413690 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89605d19-cff8-4777-b164-7505177625e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b365d9dd635e4518a41181649c323062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:05:12.414354 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89605d19-cff8-4777-b164-7505177625e1 service placement] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:05:12.414640 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89605d19-cff8-4777-b164-7505177625e1 service placement] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:05:12.414920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89605d19-cff8-4777-b164-7505177625e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:05:12.416759 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-89605d19-cff8-4777-b164-7505177625e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:05:12.428791 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89605d19-cff8-4777-b164-7505177625e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:05:12.430369 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89605d19-cff8-4777-b164-7505177625e1 service placement] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:05:12.440535 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1373/2734] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:05:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:05:15.437900 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7765ac-9d78-470f-90b0-fc0210fb65e8 service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:05:15.454072 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7765ac-9d78-470f-90b0-fc0210fb65e8 service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:05:15.460026 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111e6a8-d65d-4376-a85b-fde618a70d5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:05:15.461384 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111e6a8-d65d-4376-a85b-fde618a70d5d service nova] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:05:15.461684 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111e6a8-d65d-4376-a85b-fde618a70d5d service nova] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:05:15.461986 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111e6a8-d65d-4376-a85b-fde618a70d5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:05:15.464085 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-6111e6a8-d65d-4376-a85b-fde618a70d5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:05:15.479252 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6111e6a8-d65d-4376-a85b-fde618a70d5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:05:15.480874 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6111e6a8-d65d-4376-a85b-fde618a70d5d service nova] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:05:15.493221 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1362/2735] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:05:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:05:22.151890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89605d19-cff8-4777-b164-7505177625e1 service placement] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:05:22.164649 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89605d19-cff8-4777-b164-7505177625e1 service placement] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:05:22.171042 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3147473-8027-4b8f-be11-988bbb2cece6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:05:22.171785 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3147473-8027-4b8f-be11-988bbb2cece6 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:05:22.172067 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3147473-8027-4b8f-be11-988bbb2cece6 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:05:22.172344 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3147473-8027-4b8f-be11-988bbb2cece6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:05:22.174160 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c3147473-8027-4b8f-be11-988bbb2cece6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:05:22.190525 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3147473-8027-4b8f-be11-988bbb2cece6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:05:22.192252 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3147473-8027-4b8f-be11-988bbb2cece6 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:05:22.205278 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1374/2736] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:05:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:05:22.450188 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111e6a8-d65d-4376-a85b-fde618a70d5d service nova] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:05:22.460176 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111e6a8-d65d-4376-a85b-fde618a70d5d service nova] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:05:22.465350 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02f4f1-0516-43d9-b15e-2037f7a851b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:05:22.466077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02f4f1-0516-43d9-b15e-2037f7a851b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:05:22.466452 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02f4f1-0516-43d9-b15e-2037f7a851b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:05:22.466710 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02f4f1-0516-43d9-b15e-2037f7a851b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:05:22.469062 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-fb02f4f1-0516-43d9-b15e-2037f7a851b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:05:22.482355 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02f4f1-0516-43d9-b15e-2037f7a851b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:05:22.484353 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02f4f1-0516-43d9-b15e-2037f7a851b1 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:05:22.499788 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1363/2737] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:05:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:05:28.886310 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3147473-8027-4b8f-be11-988bbb2cece6 service nova] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:05:28.889362 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c3147473-8027-4b8f-be11-988bbb2cece6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:05:28.906366 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3147473-8027-4b8f-be11-988bbb2cece6 service nova] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:05:28.911632 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25762f4f-ca01-4a1e-bb41-16bda97179d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b365d9dd635e4518a41181649c323062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:05:28.912307 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25762f4f-ca01-4a1e-bb41-16bda97179d4 service placement] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:05:28.912623 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25762f4f-ca01-4a1e-bb41-16bda97179d4 service placement] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:05:28.912972 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25762f4f-ca01-4a1e-bb41-16bda97179d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:05:28.915132 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-25762f4f-ca01-4a1e-bb41-16bda97179d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:05:28.928602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25762f4f-ca01-4a1e-bb41-16bda97179d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:05:28.930111 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25762f4f-ca01-4a1e-bb41-16bda97179d4 service placement] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:05:28.943678 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1375/2738] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:05:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:05:28.959113 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02f4f1-0516-43d9-b15e-2037f7a851b1 service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:05:28.960587 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-fb02f4f1-0516-43d9-b15e-2037f7a851b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:05:28.986383 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02f4f1-0516-43d9-b15e-2037f7a851b1 service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:05:28.991174 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46720bd9-ef97-4cd4-8a84-6e29a9405b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:05:28.992118 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46720bd9-ef97-4cd4-8a84-6e29a9405b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:05:28.992401 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46720bd9-ef97-4cd4-8a84-6e29a9405b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:05:28.992679 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46720bd9-ef97-4cd4-8a84-6e29a9405b6e admin admin] PATH_INFO: `/v3/users/0e97d164a02b49a79e4299be4debf774` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:05:28.993865 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46720bd9-ef97-4cd4-8a84-6e29a9405b6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e97d164a02b49a79e4299be4debf774)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:05:28.995851 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46720bd9-ef97-4cd4-8a84-6e29a9405b6e admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:05:29.045105 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-46720bd9-ef97-4cd4-8a84-6e29a9405b6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e97d164a02b49a79e4299be4debf774'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:05:29.052705 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-46720bd9-ef97-4cd4-8a84-6e29a9405b6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e97d164a02b49a79e4299be4debf774'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:05:29.062868 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-46720bd9-ef97-4cd4-8a84-6e29a9405b6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e97d164a02b49a79e4299be4debf774'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:05:29.063587 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-46720bd9-ef97-4cd4-8a84-6e29a9405b6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e97d164a02b49a79e4299be4debf774'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:05:29.075515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-46720bd9-ef97-4cd4-8a84-6e29a9405b6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e97d164a02b49a79e4299be4debf774'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:05:29.081503 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1364/2739] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:05:28 2022] DELETE /identity/v3/users/0e97d164a02b49a79e4299be4debf774 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:05:29.267405 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25762f4f-ca01-4a1e-bb41-16bda97179d4 service placement] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:05:29.278553 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25762f4f-ca01-4a1e-bb41-16bda97179d4 service placement] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:05:29.337610 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e067f7b-382f-4b27-adad-2ff51f6f3132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:05:29.338492 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e067f7b-382f-4b27-adad-2ff51f6f3132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:05:29.338767 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e067f7b-382f-4b27-adad-2ff51f6f3132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:05:29.339038 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e067f7b-382f-4b27-adad-2ff51f6f3132 admin admin] PATH_INFO: `/v3/projects/8ac83d6edd244e269722822e0e339f15` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:05:29.340362 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e067f7b-382f-4b27-adad-2ff51f6f3132 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ac83d6edd244e269722822e0e339f15)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:05:29.342254 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e067f7b-382f-4b27-adad-2ff51f6f3132 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:05:29.353740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:05:29.393362 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-2e067f7b-382f-4b27-adad-2ff51f6f3132 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ac83d6edd244e269722822e0e339f15', 'request_id': 'req-2e067f7b-382f-4b27-adad-2ff51f6f3132'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:05:29.401899 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-2e067f7b-382f-4b27-adad-2ff51f6f3132 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ac83d6edd244e269722822e0e339f15', 'request_id': 'req-2e067f7b-382f-4b27-adad-2ff51f6f3132'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:05:29.407693 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-2e067f7b-382f-4b27-adad-2ff51f6f3132 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ac83d6edd244e269722822e0e339f15', 'request_id': 'req-2e067f7b-382f-4b27-adad-2ff51f6f3132'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:05:29.419123 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-2e067f7b-382f-4b27-adad-2ff51f6f3132 admin admin] The token cache is being invalidate because project 8ac83d6edd244e269722822e0e339f15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:05:29.419523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-2e067f7b-382f-4b27-adad-2ff51f6f3132 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:05:29.420212 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-2e067f7b-382f-4b27-adad-2ff51f6f3132 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:05:29.421825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1376/2740] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:05:29 2022] DELETE /identity/v3/projects/8ac83d6edd244e269722822e0e339f15 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:05:29.426009 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46720bd9-ef97-4cd4-8a84-6e29a9405b6e admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:05:29.427539 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-46720bd9-ef97-4cd4-8a84-6e29a9405b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:05:29.441972 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46720bd9-ef97-4cd4-8a84-6e29a9405b6e admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:05:29.505048 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00e0da-5e1a-4aeb-975a-af67153fad0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:05:29.506171 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00e0da-5e1a-4aeb-975a-af67153fad0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:05:29.506467 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00e0da-5e1a-4aeb-975a-af67153fad0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:05:29.506748 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00e0da-5e1a-4aeb-975a-af67153fad0e admin admin] PATH_INFO: `/v3/users/753d97a529664fe39f73e2c66aaacc68` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:05:29.508003 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00e0da-5e1a-4aeb-975a-af67153fad0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=753d97a529664fe39f73e2c66aaacc68)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:05:29.509937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00e0da-5e1a-4aeb-975a-af67153fad0e admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:05:29.554631 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:05:29.566635 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-4c00e0da-5e1a-4aeb-975a-af67153fad0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '753d97a529664fe39f73e2c66aaacc68'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:05:29.573820 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-4c00e0da-5e1a-4aeb-975a-af67153fad0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '753d97a529664fe39f73e2c66aaacc68'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:05:29.582208 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-4c00e0da-5e1a-4aeb-975a-af67153fad0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '753d97a529664fe39f73e2c66aaacc68'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:05:29.587596 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-4c00e0da-5e1a-4aeb-975a-af67153fad0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '753d97a529664fe39f73e2c66aaacc68'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:05:29.604680 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-4c00e0da-5e1a-4aeb-975a-af67153fad0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '753d97a529664fe39f73e2c66aaacc68'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:05:29.611645 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1365/2741] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:05:29 2022] DELETE /identity/v3/users/753d97a529664fe39f73e2c66aaacc68 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 11:05:29.803274 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e067f7b-382f-4b27-adad-2ff51f6f3132 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:05:29.804817 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-2e067f7b-382f-4b27-adad-2ff51f6f3132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:05:29.818299 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e067f7b-382f-4b27-adad-2ff51f6f3132 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:05:29.882895 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8938a-ebd5-410a-be12-c81abfa2a4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:05:29.883841 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8938a-ebd5-410a-be12-c81abfa2a4b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:05:29.884126 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8938a-ebd5-410a-be12-c81abfa2a4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:05:29.884406 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8938a-ebd5-410a-be12-c81abfa2a4b8 admin admin] PATH_INFO: `/v3/projects/0e5e67dae3264723a9d5fffbc85b909b` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:05:29.885591 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8938a-ebd5-410a-be12-c81abfa2a4b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e5e67dae3264723a9d5fffbc85b909b)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:05:29.887670 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8938a-ebd5-410a-be12-c81abfa2a4b8 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:05:29.938424 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-85a8938a-ebd5-410a-be12-c81abfa2a4b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e5e67dae3264723a9d5fffbc85b909b', 'request_id': 'req-85a8938a-ebd5-410a-be12-c81abfa2a4b8'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:05:29.954010 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-85a8938a-ebd5-410a-be12-c81abfa2a4b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e5e67dae3264723a9d5fffbc85b909b', 'request_id': 'req-85a8938a-ebd5-410a-be12-c81abfa2a4b8'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:05:29.962644 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-85a8938a-ebd5-410a-be12-c81abfa2a4b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e5e67dae3264723a9d5fffbc85b909b', 'request_id': 'req-85a8938a-ebd5-410a-be12-c81abfa2a4b8'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:05:29.979251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-85a8938a-ebd5-410a-be12-c81abfa2a4b8 admin admin] The token cache is being invalidate because project 0e5e67dae3264723a9d5fffbc85b909b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:05:29.979441 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-85a8938a-ebd5-410a-be12-c81abfa2a4b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:05:29.980180 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-85a8938a-ebd5-410a-be12-c81abfa2a4b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:05:29.982120 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1377/2742] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:05:29 2022] DELETE /identity/v3/projects/0e5e67dae3264723a9d5fffbc85b909b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:05:39.607811 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=16,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:05:39.975195 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=71,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:05:58.156375 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00e0da-5e1a-4aeb-975a-af67153fad0e admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:05:58.157854 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-4c00e0da-5e1a-4aeb-975a-af67153fad0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:05:58.270976 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00e0da-5e1a-4aeb-975a-af67153fad0e admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:05:58.322345 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276f274-af88-4cd2-a824-a0cd8227d687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:05:58.323003 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276f274-af88-4cd2-a824-a0cd8227d687 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:05:58.323314 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276f274-af88-4cd2-a824-a0cd8227d687 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:05:58.323664 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276f274-af88-4cd2-a824-a0cd8227d687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:05:58.325743 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-9276f274-af88-4cd2-a824-a0cd8227d687 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:05:58.335427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276f274-af88-4cd2-a824-a0cd8227d687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:05:58.336854 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276f274-af88-4cd2-a824-a0cd8227d687 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:05:58.345629 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1366/2743] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:05:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:05:58.453266 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8938a-ebd5-410a-be12-c81abfa2a4b8 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:05:58.454868 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-85a8938a-ebd5-410a-be12-c81abfa2a4b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:05:58.472306 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8938a-ebd5-410a-be12-c81abfa2a4b8 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:05:58.476077 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355fce2-2a81-4dd9-861d-c5abb70c29b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:05:58.476736 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355fce2-2a81-4dd9-861d-c5abb70c29b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:05:58.477021 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355fce2-2a81-4dd9-861d-c5abb70c29b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:05:58.477296 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355fce2-2a81-4dd9-861d-c5abb70c29b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:05:58.479135 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-f355fce2-2a81-4dd9-861d-c5abb70c29b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:05:58.489243 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355fce2-2a81-4dd9-861d-c5abb70c29b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:05:58.490678 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355fce2-2a81-4dd9-861d-c5abb70c29b3 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:05:58.500969 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1378/2744] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:05:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:05:58.595932 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276f274-af88-4cd2-a824-a0cd8227d687 service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:05:58.605522 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276f274-af88-4cd2-a824-a0cd8227d687 service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:05:58.610735 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531c269-a8bc-40d9-b938-bba7456cb102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:05:58.612149 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531c269-a8bc-40d9-b938-bba7456cb102 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:05:58.612428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531c269-a8bc-40d9-b938-bba7456cb102 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:05:58.612735 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531c269-a8bc-40d9-b938-bba7456cb102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:05:58.614661 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-6531c269-a8bc-40d9-b938-bba7456cb102 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:05:58.678811 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:05:58.708729 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531c269-a8bc-40d9-b938-bba7456cb102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:05:58.710207 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531c269-a8bc-40d9-b938-bba7456cb102 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:05:58.721670 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1367/2745] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:05:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:06:08.495562 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=8 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:06:08.716486 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=11 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:06:17.021323 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355fce2-2a81-4dd9-861d-c5abb70c29b3 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:06:17.022839 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-f355fce2-2a81-4dd9-861d-c5abb70c29b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:06:17.125211 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355fce2-2a81-4dd9-861d-c5abb70c29b3 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:06:17.130831 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde8b2c-dd37-4157-96cf-2b0fdeac0e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:06:17.131746 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde8b2c-dd37-4157-96cf-2b0fdeac0e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:06:17.132024 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde8b2c-dd37-4157-96cf-2b0fdeac0e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:06:17.132297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde8b2c-dd37-4157-96cf-2b0fdeac0e6c admin admin] PATH_INFO: `/v3/users/ae5df30bf1424bfdaced8e4711829ad6` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:06:17.133533 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde8b2c-dd37-4157-96cf-2b0fdeac0e6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae5df30bf1424bfdaced8e4711829ad6)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:06:17.135475 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde8b2c-dd37-4157-96cf-2b0fdeac0e6c admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:06:17.186829 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6fde8b2c-dd37-4157-96cf-2b0fdeac0e6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae5df30bf1424bfdaced8e4711829ad6'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:06:17.194574 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6fde8b2c-dd37-4157-96cf-2b0fdeac0e6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae5df30bf1424bfdaced8e4711829ad6'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:06:17.204254 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6fde8b2c-dd37-4157-96cf-2b0fdeac0e6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae5df30bf1424bfdaced8e4711829ad6'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:06:17.204985 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6fde8b2c-dd37-4157-96cf-2b0fdeac0e6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae5df30bf1424bfdaced8e4711829ad6'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:06:17.217539 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6fde8b2c-dd37-4157-96cf-2b0fdeac0e6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae5df30bf1424bfdaced8e4711829ad6'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:06:17.223901 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1379/2746] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:06:17 2022] DELETE /identity/v3/users/ae5df30bf1424bfdaced8e4711829ad6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:06:17.423278 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531c269-a8bc-40d9-b938-bba7456cb102 service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:06:17.434509 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531c269-a8bc-40d9-b938-bba7456cb102 service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:06:17.494519 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385ddf8-a310-4bf1-9113-fbc1e15fc13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:06:17.495430 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385ddf8-a310-4bf1-9113-fbc1e15fc13b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:06:17.495713 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385ddf8-a310-4bf1-9113-fbc1e15fc13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:06:17.495989 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385ddf8-a310-4bf1-9113-fbc1e15fc13b admin admin] PATH_INFO: `/v3/projects/8110aca033444d74b0d49095fda4ad17` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:06:17.497153 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385ddf8-a310-4bf1-9113-fbc1e15fc13b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8110aca033444d74b0d49095fda4ad17)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:06:17.499062 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385ddf8-a310-4bf1-9113-fbc1e15fc13b admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:06:17.547454 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-e385ddf8-a310-4bf1-9113-fbc1e15fc13b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8110aca033444d74b0d49095fda4ad17', 'request_id': 'req-e385ddf8-a310-4bf1-9113-fbc1e15fc13b'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:06:17.557432 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-e385ddf8-a310-4bf1-9113-fbc1e15fc13b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8110aca033444d74b0d49095fda4ad17', 'request_id': 'req-e385ddf8-a310-4bf1-9113-fbc1e15fc13b'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:06:17.563675 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-e385ddf8-a310-4bf1-9113-fbc1e15fc13b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8110aca033444d74b0d49095fda4ad17', 'request_id': 'req-e385ddf8-a310-4bf1-9113-fbc1e15fc13b'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:06:17.574803 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-e385ddf8-a310-4bf1-9113-fbc1e15fc13b admin admin] The token cache is being invalidate because project 8110aca033444d74b0d49095fda4ad17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:06:17.575091 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-e385ddf8-a310-4bf1-9113-fbc1e15fc13b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:06:17.575766 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-e385ddf8-a310-4bf1-9113-fbc1e15fc13b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:06:17.577338 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1368/2747] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:06:17 2022] DELETE /identity/v3/projects/8110aca033444d74b0d49095fda4ad17 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:06:27.220617 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=66,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:06:27.571849 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:06:32.271024 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde8b2c-dd37-4157-96cf-2b0fdeac0e6c admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:06:32.272876 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6fde8b2c-dd37-4157-96cf-2b0fdeac0e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:06:32.373203 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde8b2c-dd37-4157-96cf-2b0fdeac0e6c admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:06:32.438974 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9897481-8b13-488b-b6f3-0a1fe922e23e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b365d9dd635e4518a41181649c323062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:06:32.439706 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9897481-8b13-488b-b6f3-0a1fe922e23e service placement] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:06:32.439996 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9897481-8b13-488b-b6f3-0a1fe922e23e service placement] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:06:32.440259 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9897481-8b13-488b-b6f3-0a1fe922e23e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:06:32.442375 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-d9897481-8b13-488b-b6f3-0a1fe922e23e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:06:32.454776 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9897481-8b13-488b-b6f3-0a1fe922e23e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:06:32.456370 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9897481-8b13-488b-b6f3-0a1fe922e23e service placement] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:06:32.467009 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1380/2748] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:06:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:06:39.807713 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ede575-b5c9-41c3-bca1-611be1b09d6d None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:06:39.808269 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ede575-b5c9-41c3-bca1-611be1b09d6d None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:06:39.808269 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ede575-b5c9-41c3-bca1-611be1b09d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:06:39.826709 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-c1ede575-b5c9-41c3-bca1-611be1b09d6d None None] MFA Rules not processed for user `0c6d8051a64a4633bb86c54d9030c8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:06:39.827954 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-c1ede575-b5c9-41c3-bca1-611be1b09d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:06:39.891960 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1369/2749] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:06:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:06:42.462776 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=67 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:06:49.879521 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=25 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:07:57.522018 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9897481-8b13-488b-b6f3-0a1fe922e23e service placement] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:07:57.523639 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-d9897481-8b13-488b-b6f3-0a1fe922e23e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:07:57.583472 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9897481-8b13-488b-b6f3-0a1fe922e23e service placement] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:07:57.588032 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475c154-3e90-4df1-9d1b-3b9901a7d179 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:07:57.588683 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475c154-3e90-4df1-9d1b-3b9901a7d179 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:07:57.588971 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475c154-3e90-4df1-9d1b-3b9901a7d179 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:07:57.589254 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475c154-3e90-4df1-9d1b-3b9901a7d179 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:07:57.591438 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-3475c154-3e90-4df1-9d1b-3b9901a7d179 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:07:57.662119 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475c154-3e90-4df1-9d1b-3b9901a7d179 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:07:57.664513 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475c154-3e90-4df1-9d1b-3b9901a7d179 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:07:57.678809 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1381/2750] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:07:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:08:03.991585 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ede575-b5c9-41c3-bca1-611be1b09d6d None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:08:04.002562 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ede575-b5c9-41c3-bca1-611be1b09d6d None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:08:04.008024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e494e6-462b-404b-8721-0877d3f8e7a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:08:04.008752 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e494e6-462b-404b-8721-0877d3f8e7a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:08:04.009040 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e494e6-462b-404b-8721-0877d3f8e7a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:08:04.009398 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e494e6-462b-404b-8721-0877d3f8e7a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:08:04.012486 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-a4e494e6-462b-404b-8721-0877d3f8e7a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:08:04.079488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e494e6-462b-404b-8721-0877d3f8e7a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:08:04.081160 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e494e6-462b-404b-8721-0877d3f8e7a7 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:08:04.090913 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1370/2751] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:08:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:08:07.671997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=48 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:08:10.273947 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475c154-3e90-4df1-9d1b-3b9901a7d179 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:08:10.275506 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-3475c154-3e90-4df1-9d1b-3b9901a7d179 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:08:10.291431 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475c154-3e90-4df1-9d1b-3b9901a7d179 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:08:10.296095 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b836dc-5af8-4a7b-878a-aa2bddaffaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:08:10.296992 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b836dc-5af8-4a7b-878a-aa2bddaffaba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:08:10.297299 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b836dc-5af8-4a7b-878a-aa2bddaffaba admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:08:10.297575 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b836dc-5af8-4a7b-878a-aa2bddaffaba admin admin] PATH_INFO: `/v3/users/028af403ea68430f8457a9f36f6dd4da` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:08:10.298770 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b836dc-5af8-4a7b-878a-aa2bddaffaba admin admin] RBAC: Authorizing `identity:delete_user(user_id=028af403ea68430f8457a9f36f6dd4da)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:08:10.300907 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b836dc-5af8-4a7b-878a-aa2bddaffaba admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:08:10.350003 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f2b836dc-5af8-4a7b-878a-aa2bddaffaba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '028af403ea68430f8457a9f36f6dd4da'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:08:10.356906 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f2b836dc-5af8-4a7b-878a-aa2bddaffaba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '028af403ea68430f8457a9f36f6dd4da'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:08:10.366406 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f2b836dc-5af8-4a7b-878a-aa2bddaffaba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '028af403ea68430f8457a9f36f6dd4da'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:08:10.367460 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f2b836dc-5af8-4a7b-878a-aa2bddaffaba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '028af403ea68430f8457a9f36f6dd4da'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:08:10.383648 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f2b836dc-5af8-4a7b-878a-aa2bddaffaba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '028af403ea68430f8457a9f36f6dd4da'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:08:10.390141 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1382/2752] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:08:10 2022] DELETE /identity/v3/users/028af403ea68430f8457a9f36f6dd4da => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:08:10.576193 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e494e6-462b-404b-8721-0877d3f8e7a7 service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:08:10.587481 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e494e6-462b-404b-8721-0877d3f8e7a7 service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:08:10.658192 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311d437-ae65-4eb3-899d-00bf3a2f50c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:08:10.658982 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311d437-ae65-4eb3-899d-00bf3a2f50c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:08:10.658982 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311d437-ae65-4eb3-899d-00bf3a2f50c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:08:10.658982 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311d437-ae65-4eb3-899d-00bf3a2f50c8 admin admin] PATH_INFO: `/v3/projects/fc6f775f98bb44fa984b09910cb16d85` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:08:10.660347 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311d437-ae65-4eb3-899d-00bf3a2f50c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc6f775f98bb44fa984b09910cb16d85)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:08:10.662318 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311d437-ae65-4eb3-899d-00bf3a2f50c8 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:08:10.710962 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-3311d437-ae65-4eb3-899d-00bf3a2f50c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc6f775f98bb44fa984b09910cb16d85', 'request_id': 'req-3311d437-ae65-4eb3-899d-00bf3a2f50c8'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:08:10.720003 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-3311d437-ae65-4eb3-899d-00bf3a2f50c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc6f775f98bb44fa984b09910cb16d85', 'request_id': 'req-3311d437-ae65-4eb3-899d-00bf3a2f50c8'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:08:10.728380 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-3311d437-ae65-4eb3-899d-00bf3a2f50c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc6f775f98bb44fa984b09910cb16d85', 'request_id': 'req-3311d437-ae65-4eb3-899d-00bf3a2f50c8'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:08:10.742283 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-3311d437-ae65-4eb3-899d-00bf3a2f50c8 admin admin] The token cache is being invalidate because project fc6f775f98bb44fa984b09910cb16d85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:08:10.742657 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-3311d437-ae65-4eb3-899d-00bf3a2f50c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:08:10.743444 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-3311d437-ae65-4eb3-899d-00bf3a2f50c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:08:10.745162 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1371/2753] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:08:10 2022] DELETE /identity/v3/projects/fc6f775f98bb44fa984b09910cb16d85 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:08:10.749260 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b836dc-5af8-4a7b-878a-aa2bddaffaba admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:08:10.750662 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-f2b836dc-5af8-4a7b-878a-aa2bddaffaba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:08:10.765028 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b836dc-5af8-4a7b-878a-aa2bddaffaba admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:08:10.825951 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5e709-5f28-4a8c-8435-3f0a3037eb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:08:10.826840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5e709-5f28-4a8c-8435-3f0a3037eb5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:08:10.827122 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5e709-5f28-4a8c-8435-3f0a3037eb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:08:10.827432 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5e709-5f28-4a8c-8435-3f0a3037eb5e admin admin] PATH_INFO: `/v3/users/1f9477eeb4d1492192868792554a4260` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:08:10.828644 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5e709-5f28-4a8c-8435-3f0a3037eb5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f9477eeb4d1492192868792554a4260)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:08:10.830620 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5e709-5f28-4a8c-8435-3f0a3037eb5e admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:08:10.879751 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-63a5e709-5f28-4a8c-8435-3f0a3037eb5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f9477eeb4d1492192868792554a4260'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:08:10.886499 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-63a5e709-5f28-4a8c-8435-3f0a3037eb5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f9477eeb4d1492192868792554a4260'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:08:10.894353 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-63a5e709-5f28-4a8c-8435-3f0a3037eb5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f9477eeb4d1492192868792554a4260'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:08:10.895194 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-63a5e709-5f28-4a8c-8435-3f0a3037eb5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f9477eeb4d1492192868792554a4260'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:08:10.903627 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:08:10.909401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-63a5e709-5f28-4a8c-8435-3f0a3037eb5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f9477eeb4d1492192868792554a4260'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:08:10.916838 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1383/2754] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:08:10 2022] DELETE /identity/v3/users/1f9477eeb4d1492192868792554a4260 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 11:08:11.093405 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311d437-ae65-4eb3-899d-00bf3a2f50c8 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:08:11.094899 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-3311d437-ae65-4eb3-899d-00bf3a2f50c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:08:11.108241 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311d437-ae65-4eb3-899d-00bf3a2f50c8 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:08:11.141550 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:08:11.188958 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b21c3-c15f-45eb-bca9-96c3b260fdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:08:11.189761 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b21c3-c15f-45eb-bca9-96c3b260fdf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:08:11.190044 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b21c3-c15f-45eb-bca9-96c3b260fdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:08:11.190465 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b21c3-c15f-45eb-bca9-96c3b260fdf5 admin admin] PATH_INFO: `/v3/projects/b00a3a8dfdaa4ff68a7a4ef68481d010` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:08:11.193535 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b21c3-c15f-45eb-bca9-96c3b260fdf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b00a3a8dfdaa4ff68a7a4ef68481d010)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:08:11.193809 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b21c3-c15f-45eb-bca9-96c3b260fdf5 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:08:11.243400 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a02b21c3-c15f-45eb-bca9-96c3b260fdf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b00a3a8dfdaa4ff68a7a4ef68481d010', 'request_id': 'req-a02b21c3-c15f-45eb-bca9-96c3b260fdf5'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:08:11.251970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a02b21c3-c15f-45eb-bca9-96c3b260fdf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b00a3a8dfdaa4ff68a7a4ef68481d010', 'request_id': 'req-a02b21c3-c15f-45eb-bca9-96c3b260fdf5'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:08:11.258549 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a02b21c3-c15f-45eb-bca9-96c3b260fdf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b00a3a8dfdaa4ff68a7a4ef68481d010', 'request_id': 'req-a02b21c3-c15f-45eb-bca9-96c3b260fdf5'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:08:11.270945 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a02b21c3-c15f-45eb-bca9-96c3b260fdf5 admin admin] The token cache is being invalidate because project b00a3a8dfdaa4ff68a7a4ef68481d010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:08:11.271392 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a02b21c3-c15f-45eb-bca9-96c3b260fdf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:08:11.272067 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-a02b21c3-c15f-45eb-bca9-96c3b260fdf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:08:11.273752 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1372/2755] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:08:11 2022] DELETE /identity/v3/projects/b00a3a8dfdaa4ff68a7a4ef68481d010 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:08:15.122004 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5e709-5f28-4a8c-8435-3f0a3037eb5e admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:08:15.123544 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-63a5e709-5f28-4a8c-8435-3f0a3037eb5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:08:15.187186 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5e709-5f28-4a8c-8435-3f0a3037eb5e admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:08:15.240458 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddba7e-78c2-4d76-838e-ae6a2a27611d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:08:15.241364 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddba7e-78c2-4d76-838e-ae6a2a27611d service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:08:15.241743 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddba7e-78c2-4d76-838e-ae6a2a27611d service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:08:15.242109 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddba7e-78c2-4d76-838e-ae6a2a27611d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:08:15.245517 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b3ddba7e-78c2-4d76-838e-ae6a2a27611d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:08:15.350853 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ddba7e-78c2-4d76-838e-ae6a2a27611d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:08:15.352316 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ddba7e-78c2-4d76-838e-ae6a2a27611d service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:08:15.373858 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1384/2756] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:08:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:08:16.560612 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b21c3-c15f-45eb-bca9-96c3b260fdf5 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:08:16.562855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-a02b21c3-c15f-45eb-bca9-96c3b260fdf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:08:16.578029 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b21c3-c15f-45eb-bca9-96c3b260fdf5 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:08:16.583011 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cf6e4-4daa-4f15-be17-3b7c2f9eb4e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:08:16.583681 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cf6e4-4daa-4f15-be17-3b7c2f9eb4e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:08:16.583962 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cf6e4-4daa-4f15-be17-3b7c2f9eb4e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:08:16.584234 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cf6e4-4daa-4f15-be17-3b7c2f9eb4e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:08:16.586215 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-137cf6e4-4daa-4f15-be17-3b7c2f9eb4e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:08:16.600894 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137cf6e4-4daa-4f15-be17-3b7c2f9eb4e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:08:16.602515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137cf6e4-4daa-4f15-be17-3b7c2f9eb4e6 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:08:16.614941 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1373/2757] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:08:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:08:21.133778 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311bb39-b8f1-42ad-af83-94aee50f18d3 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:08:21.134357 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311bb39-b8f1-42ad-af83-94aee50f18d3 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:08:21.134458 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311bb39-b8f1-42ad-af83-94aee50f18d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:08:21.153190 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-d311bb39-b8f1-42ad-af83-94aee50f18d3 None None] MFA Rules not processed for user `0c6d8051a64a4633bb86c54d9030c8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:08:21.154404 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-d311bb39-b8f1-42ad-af83-94aee50f18d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:08:21.173287 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:08:21.221266 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1385/2758] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:08:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:08:26.609700 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=46,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:08:31.214254 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=15 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:09:33.808853 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cf6e4-4daa-4f15-be17-3b7c2f9eb4e6 service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:09:33.818601 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cf6e4-4daa-4f15-be17-3b7c2f9eb4e6 service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:09:33.824089 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfffe0a-8129-4905-b736-fc7aeb0e53f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:09:33.824908 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfffe0a-8129-4905-b736-fc7aeb0e53f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:09:33.825239 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfffe0a-8129-4905-b736-fc7aeb0e53f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:09:33.825594 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfffe0a-8129-4905-b736-fc7aeb0e53f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:09:33.828736 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-fdfffe0a-8129-4905-b736-fc7aeb0e53f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:09:33.845032 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfffe0a-8129-4905-b736-fc7aeb0e53f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:09:33.847132 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfffe0a-8129-4905-b736-fc7aeb0e53f3 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:09:33.857228 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1374/2759] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:09:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:09:38.920391 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311bb39-b8f1-42ad-af83-94aee50f18d3 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:09:38.922049 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-d311bb39-b8f1-42ad-af83-94aee50f18d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:09:38.939084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311bb39-b8f1-42ad-af83-94aee50f18d3 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:09:38.945496 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7098b-e5af-4da8-9e4a-ae3ab04a1f69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:09:38.946196 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7098b-e5af-4da8-9e4a-ae3ab04a1f69 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:09:38.946496 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7098b-e5af-4da8-9e4a-ae3ab04a1f69 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:09:38.946767 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7098b-e5af-4da8-9e4a-ae3ab04a1f69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:09:38.948743 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-4ce7098b-e5af-4da8-9e4a-ae3ab04a1f69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:09:38.959634 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7098b-e5af-4da8-9e4a-ae3ab04a1f69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:09:38.961432 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7098b-e5af-4da8-9e4a-ae3ab04a1f69 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:09:38.971629 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1386/2760] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:09:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:09:43.853261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=6 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:09:48.967606 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=6 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:09:52.352905 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfffe0a-8129-4905-b736-fc7aeb0e53f3 service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:09:52.374015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfffe0a-8129-4905-b736-fc7aeb0e53f3 service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:09:52.383372 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7457a7-313a-4ffc-8f9d-a43ed4d5a115 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:09:52.384065 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7457a7-313a-4ffc-8f9d-a43ed4d5a115 service nova] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:09:52.384352 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7457a7-313a-4ffc-8f9d-a43ed4d5a115 service nova] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:09:52.385066 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7457a7-313a-4ffc-8f9d-a43ed4d5a115 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:09:52.386655 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-0e7457a7-313a-4ffc-8f9d-a43ed4d5a115 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:09:52.401236 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7457a7-313a-4ffc-8f9d-a43ed4d5a115 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:09:52.402976 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7457a7-313a-4ffc-8f9d-a43ed4d5a115 service nova] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:09:52.420553 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1375/2761] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:09:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 11:09:55.290907 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e02896-1447-429c-9d8f-63a7fddc5ebc None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:09:55.291718 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e02896-1447-429c-9d8f-63a7fddc5ebc None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:09:55.291886 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e02896-1447-429c-9d8f-63a7fddc5ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:09:55.311329 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-a9e02896-1447-429c-9d8f-63a7fddc5ebc None None] MFA Rules not processed for user `0c6d8051a64a4633bb86c54d9030c8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:09:55.312576 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a9e02896-1447-429c-9d8f-63a7fddc5ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:09:55.320961 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1387/2762] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:09:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:10:02.412767 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=6 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:10:05.305863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:11:32.641741 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7457a7-313a-4ffc-8f9d-a43ed4d5a115 service nova] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:32.643337 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-0e7457a7-313a-4ffc-8f9d-a43ed4d5a115 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:11:32.656103 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7457a7-313a-4ffc-8f9d-a43ed4d5a115 service nova] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:32.660951 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116039d-f375-436d-9898-6a0355229a49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:32.661635 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116039d-f375-436d-9898-6a0355229a49 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:32.662015 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116039d-f375-436d-9898-6a0355229a49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:32.662304 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116039d-f375-436d-9898-6a0355229a49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:32.664326 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-b116039d-f375-436d-9898-6a0355229a49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:11:32.732065 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116039d-f375-436d-9898-6a0355229a49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:32.733515 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116039d-f375-436d-9898-6a0355229a49 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:32.743417 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1376/2763] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:11:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:11:34.484615 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e02896-1447-429c-9d8f-63a7fddc5ebc None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:34.486713 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a9e02896-1447-429c-9d8f-63a7fddc5ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:11:34.575919 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e02896-1447-429c-9d8f-63a7fddc5ebc None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:34.586449 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80d975-b7d2-48da-9dcb-084782566117 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b365d9dd635e4518a41181649c323062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:34.587160 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80d975-b7d2-48da-9dcb-084782566117 service placement] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:34.587463 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80d975-b7d2-48da-9dcb-084782566117 service placement] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:34.587731 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80d975-b7d2-48da-9dcb-084782566117 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:34.589576 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-2c80d975-b7d2-48da-9dcb-084782566117 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:11:34.603096 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c80d975-b7d2-48da-9dcb-084782566117 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:34.605437 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c80d975-b7d2-48da-9dcb-084782566117 service placement] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:34.615794 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1388/2764] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:11:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:11:35.922745 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116039d-f375-436d-9898-6a0355229a49 service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:35.924301 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-b116039d-f375-436d-9898-6a0355229a49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:11:35.939669 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116039d-f375-436d-9898-6a0355229a49 service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:35.945542 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9ed1e-a43b-4f80-b5d4-7ec6be0cba18 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b365d9dd635e4518a41181649c323062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:35.946199 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9ed1e-a43b-4f80-b5d4-7ec6be0cba18 service placement] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:35.946487 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9ed1e-a43b-4f80-b5d4-7ec6be0cba18 service placement] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:35.946754 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9ed1e-a43b-4f80-b5d4-7ec6be0cba18 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:35.948637 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-37c9ed1e-a43b-4f80-b5d4-7ec6be0cba18 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:11:35.965629 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9ed1e-a43b-4f80-b5d4-7ec6be0cba18 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:35.967441 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9ed1e-a43b-4f80-b5d4-7ec6be0cba18 service placement] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:35.979997 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80d975-b7d2-48da-9dcb-084782566117 service placement] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:35.981645 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-2c80d975-b7d2-48da-9dcb-084782566117 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:11:35.989099 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1377/2765] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:11:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:11:35.999643 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80d975-b7d2-48da-9dcb-084782566117 service placement] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:36.019458 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee58e4-fd31-4605-961a-4fe935644314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:36.020471 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee58e4-fd31-4605-961a-4fe935644314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:36.020757 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee58e4-fd31-4605-961a-4fe935644314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:36.021086 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee58e4-fd31-4605-961a-4fe935644314 admin admin] PATH_INFO: `/v3/users/0c6d8051a64a4633bb86c54d9030c8ac` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:36.022401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee58e4-fd31-4605-961a-4fe935644314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c6d8051a64a4633bb86c54d9030c8ac)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:36.024550 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee58e4-fd31-4605-961a-4fe935644314 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:36.077245 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-73ee58e4-fd31-4605-961a-4fe935644314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c6d8051a64a4633bb86c54d9030c8ac'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:36.084559 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-73ee58e4-fd31-4605-961a-4fe935644314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c6d8051a64a4633bb86c54d9030c8ac'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:36.093386 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-73ee58e4-fd31-4605-961a-4fe935644314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c6d8051a64a4633bb86c54d9030c8ac'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:36.094035 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-73ee58e4-fd31-4605-961a-4fe935644314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c6d8051a64a4633bb86c54d9030c8ac'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:36.107678 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-73ee58e4-fd31-4605-961a-4fe935644314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c6d8051a64a4633bb86c54d9030c8ac'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:36.113914 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1389/2766] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:11:35 2022] DELETE /identity/v3/users/0c6d8051a64a4633bb86c54d9030c8ac => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 11:11:36.290622 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9ed1e-a43b-4f80-b5d4-7ec6be0cba18 service placement] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:36.302361 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9ed1e-a43b-4f80-b5d4-7ec6be0cba18 service placement] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:36.367539 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dcb890-96e3-464e-8546-67aede85e73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:36.368430 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcb890-96e3-464e-8546-67aede85e73a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:36.368729 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcb890-96e3-464e-8546-67aede85e73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:36.368995 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcb890-96e3-464e-8546-67aede85e73a admin admin] PATH_INFO: `/v3/projects/fa621614a8cf401593c3b10dd5738127` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:36.370227 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dcb890-96e3-464e-8546-67aede85e73a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa621614a8cf401593c3b10dd5738127)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:36.372207 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dcb890-96e3-464e-8546-67aede85e73a admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:36.422833 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-52dcb890-96e3-464e-8546-67aede85e73a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa621614a8cf401593c3b10dd5738127', 'request_id': 'req-52dcb890-96e3-464e-8546-67aede85e73a'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:36.433877 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-52dcb890-96e3-464e-8546-67aede85e73a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa621614a8cf401593c3b10dd5738127', 'request_id': 'req-52dcb890-96e3-464e-8546-67aede85e73a'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:36.440561 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-52dcb890-96e3-464e-8546-67aede85e73a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa621614a8cf401593c3b10dd5738127', 'request_id': 'req-52dcb890-96e3-464e-8546-67aede85e73a'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:36.452997 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-52dcb890-96e3-464e-8546-67aede85e73a admin admin] The token cache is being invalidate because project fa621614a8cf401593c3b10dd5738127 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:11:36.453293 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-52dcb890-96e3-464e-8546-67aede85e73a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:36.454074 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-52dcb890-96e3-464e-8546-67aede85e73a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:36.455779 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1378/2767] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:11:36 2022] DELETE /identity/v3/projects/fa621614a8cf401593c3b10dd5738127 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:11:36.461560 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f57b63-6c8e-4866-90d4-2c49bf954b0a None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:36.461847 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f57b63-6c8e-4866-90d4-2c49bf954b0a None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:36.462124 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f57b63-6c8e-4866-90d4-2c49bf954b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:36.520403 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-49f57b63-6c8e-4866-90d4-2c49bf954b0a None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:11:36.522186 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-49f57b63-6c8e-4866-90d4-2c49bf954b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:11:36.549084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:11:36.583387 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1390/2768] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:11:36.591646 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c30ad-ea41-4c9f-8c79-f7876dabac35 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:36.591964 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c30ad-ea41-4c9f-8c79-f7876dabac35 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:36.592246 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c30ad-ea41-4c9f-8c79-f7876dabac35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:36.612679 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-f86c30ad-ea41-4c9f-8c79-f7876dabac35 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:11:36.613891 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-f86c30ad-ea41-4c9f-8c79-f7876dabac35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:11:36.623167 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1379/2769] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:11:36.627912 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f57b63-6c8e-4866-90d4-2c49bf954b0a None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:36.638604 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f57b63-6c8e-4866-90d4-2c49bf954b0a None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:36.644505 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07eaf28-323b-4d87-9878-15471469e782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:36.645173 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07eaf28-323b-4d87-9878-15471469e782 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:36.645468 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07eaf28-323b-4d87-9878-15471469e782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:36.645761 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07eaf28-323b-4d87-9878-15471469e782 admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:36.646507 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07eaf28-323b-4d87-9878-15471469e782 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 11:11:36.646815 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07eaf28-323b-4d87-9878-15471469e782 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:36.648500 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07eaf28-323b-4d87-9878-15471469e782 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:36.660915 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1391/2770] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 11:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 11:11:36.665998 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c30ad-ea41-4c9f-8c79-f7876dabac35 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:36.671808 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:11:36.675895 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c30ad-ea41-4c9f-8c79-f7876dabac35 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:36.681876 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72ee8f-d2b5-462b-99f7-d3d87489d362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:36.682804 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72ee8f-d2b5-462b-99f7-d3d87489d362 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:36.683375 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72ee8f-d2b5-462b-99f7-d3d87489d362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:36.683811 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72ee8f-d2b5-462b-99f7-d3d87489d362 admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:36.684704 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72ee8f-d2b5-462b-99f7-d3d87489d362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:36.686641 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72ee8f-d2b5-462b-99f7-d3d87489d362 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:36.726413 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1380/2771] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:11:36 2022] POST /identity/v3/projects => generated 403 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:11:36.730444 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07eaf28-323b-4d87-9878-15471469e782 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:36.741825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07eaf28-323b-4d87-9878-15471469e782 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:36.807889 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bbb3f7-6e35-49b3-8993-6544b8f5d8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:36.808579 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbb3f7-6e35-49b3-8993-6544b8f5d8a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:36.808862 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbb3f7-6e35-49b3-8993-6544b8f5d8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:36.809140 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbb3f7-6e35-49b3-8993-6544b8f5d8a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:36.809842 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bbb3f7-6e35-49b3-8993-6544b8f5d8a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:36.811824 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bbb3f7-6e35-49b3-8993-6544b8f5d8a9 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:36.834920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1392/2772] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:11:36 2022] POST /identity/v3/users => generated 302 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:11:36.839079 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72ee8f-d2b5-462b-99f7-d3d87489d362 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:36.849867 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72ee8f-d2b5-462b-99f7-d3d87489d362 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:36.855102 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1ce12-de83-49bb-a3fd-4ed6300231b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:36.855846 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1ce12-de83-49bb-a3fd-4ed6300231b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:36.856132 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1ce12-de83-49bb-a3fd-4ed6300231b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:36.856427 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1ce12-de83-49bb-a3fd-4ed6300231b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:36.857151 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1ce12-de83-49bb-a3fd-4ed6300231b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:36.858795 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1ce12-de83-49bb-a3fd-4ed6300231b8 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:36.869848 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1381/2773] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:11:36.873856 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bbb3f7-6e35-49b3-8993-6544b8f5d8a9 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:36.884076 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bbb3f7-6e35-49b3-8993-6544b8f5d8a9 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:36.889041 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe6ce5d-c8f7-40d7-9d32-8dc7b5eb1b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:36.889705 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6ce5d-c8f7-40d7-9d32-8dc7b5eb1b5f admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:36.890012 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6ce5d-c8f7-40d7-9d32-8dc7b5eb1b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:36.890276 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6ce5d-c8f7-40d7-9d32-8dc7b5eb1b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:36.891028 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe6ce5d-c8f7-40d7-9d32-8dc7b5eb1b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:36.892656 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe6ce5d-c8f7-40d7-9d32-8dc7b5eb1b5f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:36.903189 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1393/2774] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 11:11:36.907687 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1ce12-de83-49bb-a3fd-4ed6300231b8 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:36.919500 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1ce12-de83-49bb-a3fd-4ed6300231b8 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:36.925456 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e3119-aa0d-4378-b38e-f19070ab6521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:36.926351 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e3119-aa0d-4378-b38e-f19070ab6521 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:36.926636 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e3119-aa0d-4378-b38e-f19070ab6521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:36.926900 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e3119-aa0d-4378-b38e-f19070ab6521 admin admin] PATH_INFO: `/v3/projects/3729891e430d4ef587cdbe1e63c7e60b/users/89ea1e2f17384dc2bd7aa7b79896c038/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:36.942192 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e3119-aa0d-4378-b38e-f19070ab6521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3729891e430d4ef587cdbe1e63c7e60b, user_id=89ea1e2f17384dc2bd7aa7b79896c038, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:36.944952 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e3119-aa0d-4378-b38e-f19070ab6521 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:36.960000 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1382/2775] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:11:36 2022] PUT /identity/v3/projects/3729891e430d4ef587cdbe1e63c7e60b/users/89ea1e2f17384dc2bd7aa7b79896c038/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:11:36.966591 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e52f3e-01f5-442e-ba32-41af4334ade6 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:36.966888 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e52f3e-01f5-442e-ba32-41af4334ade6 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:36.967171 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e52f3e-01f5-442e-ba32-41af4334ade6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:36.986124 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-14e52f3e-01f5-442e-ba32-41af4334ade6 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:11:36.987375 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-14e52f3e-01f5-442e-ba32-41af4334ade6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:11:37.067326 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1394/2776] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:11:37.078730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e3119-aa0d-4378-b38e-f19070ab6521 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:37.081673 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-3f2e3119-aa0d-4378-b38e-f19070ab6521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:11:37.144511 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e3119-aa0d-4378-b38e-f19070ab6521 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:37.148583 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5cafc-8ef1-4cc9-8b44-2a8b78800e3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:37.149236 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5cafc-8ef1-4cc9-8b44-2a8b78800e3b service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:37.149516 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5cafc-8ef1-4cc9-8b44-2a8b78800e3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:37.149810 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5cafc-8ef1-4cc9-8b44-2a8b78800e3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:37.159847 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5cafc-8ef1-4cc9-8b44-2a8b78800e3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:37.161269 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5cafc-8ef1-4cc9-8b44-2a8b78800e3b service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:37.171655 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1383/2777] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:11:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:11:37.821003 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a69e8-613b-4ac5-a4eb-74636d021d5a None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:37.821297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a69e8-613b-4ac5-a4eb-74636d021d5a None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:37.821576 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a69e8-613b-4ac5-a4eb-74636d021d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:37.848625 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-231a69e8-613b-4ac5-a4eb-74636d021d5a None None] MFA Rules not processed for user `89ea1e2f17384dc2bd7aa7b79896c038`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:11:37.849837 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-231a69e8-613b-4ac5-a4eb-74636d021d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:11:37.876613 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:11:37.917852 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1395/2778] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:11:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:11:37.922386 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5cafc-8ef1-4cc9-8b44-2a8b78800e3b service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:37.932402 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5cafc-8ef1-4cc9-8b44-2a8b78800e3b service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:37.937227 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dca03c-12fe-43e4-8067-b22cc1bd330d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:37.938003 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dca03c-12fe-43e4-8067-b22cc1bd330d admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:37.938294 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dca03c-12fe-43e4-8067-b22cc1bd330d admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:37.938575 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dca03c-12fe-43e4-8067-b22cc1bd330d admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:37.939301 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dca03c-12fe-43e4-8067-b22cc1bd330d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:37.941206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dca03c-12fe-43e4-8067-b22cc1bd330d admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:37.976578 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1384/2779] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:11:37 2022] POST /identity/v3/projects => generated 405 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:11:37.978114 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a69e8-613b-4ac5-a4eb-74636d021d5a None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:37.989599 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a69e8-613b-4ac5-a4eb-74636d021d5a None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:38.047689 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff773e16-68d0-4d47-9583-3a1576c512bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:38.048360 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff773e16-68d0-4d47-9583-3a1576c512bd admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:38.048641 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff773e16-68d0-4d47-9583-3a1576c512bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:38.048940 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff773e16-68d0-4d47-9583-3a1576c512bd admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:38.049626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff773e16-68d0-4d47-9583-3a1576c512bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:38.051625 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff773e16-68d0-4d47-9583-3a1576c512bd admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:38.076428 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1396/2780] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:11:37 2022] POST /identity/v3/users => generated 309 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:11:38.080349 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dca03c-12fe-43e4-8067-b22cc1bd330d admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:38.092060 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dca03c-12fe-43e4-8067-b22cc1bd330d admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:38.098552 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566eba9-d799-4257-b132-4c03057df536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:38.099263 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566eba9-d799-4257-b132-4c03057df536 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:38.099556 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566eba9-d799-4257-b132-4c03057df536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:38.099828 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566eba9-d799-4257-b132-4c03057df536 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:38.100925 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566eba9-d799-4257-b132-4c03057df536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:38.102491 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566eba9-d799-4257-b132-4c03057df536 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:38.113748 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1385/2781] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 11:11:38.117938 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff773e16-68d0-4d47-9583-3a1576c512bd admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:38.128336 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff773e16-68d0-4d47-9583-3a1576c512bd admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:38.134163 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff640b-bb87-4d76-bc84-3a7d3fc5aadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:38.135053 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff640b-bb87-4d76-bc84-3a7d3fc5aadf admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:38.135367 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff640b-bb87-4d76-bc84-3a7d3fc5aadf admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:38.135643 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff640b-bb87-4d76-bc84-3a7d3fc5aadf admin admin] PATH_INFO: `/v3/projects/7ff16244c9724df6b721a0c99d2026e6/users/191b3338ec5c4064b3dbe636bcde49cc/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:38.151992 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff640b-bb87-4d76-bc84-3a7d3fc5aadf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff16244c9724df6b721a0c99d2026e6, user_id=191b3338ec5c4064b3dbe636bcde49cc, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:38.154638 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff640b-bb87-4d76-bc84-3a7d3fc5aadf admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:38.172248 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1397/2782] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:11:38 2022] PUT /identity/v3/projects/7ff16244c9724df6b721a0c99d2026e6/users/191b3338ec5c4064b3dbe636bcde49cc/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:11:38.176478 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566eba9-d799-4257-b132-4c03057df536 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:38.187052 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566eba9-d799-4257-b132-4c03057df536 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:38.249391 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcecb4-330f-4beb-9f58-d825355c4792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:38.250067 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcecb4-330f-4beb-9f58-d825355c4792 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:38.250351 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcecb4-330f-4beb-9f58-d825355c4792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:38.250631 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcecb4-330f-4beb-9f58-d825355c4792 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:38.251398 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcecb4-330f-4beb-9f58-d825355c4792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:38.253007 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcecb4-330f-4beb-9f58-d825355c4792 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:38.263086 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1386/2783] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:11:38.268322 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff640b-bb87-4d76-bc84-3a7d3fc5aadf admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:38.279735 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff640b-bb87-4d76-bc84-3a7d3fc5aadf admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:38.285786 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2a902-a8f5-4f9f-9506-8acfb1568e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:38.286700 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2a902-a8f5-4f9f-9506-8acfb1568e7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:38.286987 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2a902-a8f5-4f9f-9506-8acfb1568e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:38.287299 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2a902-a8f5-4f9f-9506-8acfb1568e7c admin admin] PATH_INFO: `/v3/projects/7ff16244c9724df6b721a0c99d2026e6/users/191b3338ec5c4064b3dbe636bcde49cc/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:38.289568 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2a902-a8f5-4f9f-9506-8acfb1568e7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff16244c9724df6b721a0c99d2026e6, user_id=191b3338ec5c4064b3dbe636bcde49cc, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:38.292267 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2a902-a8f5-4f9f-9506-8acfb1568e7c admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:38.303765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1398/2784] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:11:38 2022] PUT /identity/v3/projects/7ff16244c9724df6b721a0c99d2026e6/users/191b3338ec5c4064b3dbe636bcde49cc/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:11:38.927851 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e773fef-4d5b-49ba-aa01-b0a1eedfede3 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:38.928253 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e773fef-4d5b-49ba-aa01-b0a1eedfede3 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:38.928624 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e773fef-4d5b-49ba-aa01-b0a1eedfede3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:38.935912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:11:38.957619 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-0e773fef-4d5b-49ba-aa01-b0a1eedfede3 None None] MFA Rules not processed for user `191b3338ec5c4064b3dbe636bcde49cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:11:38.958798 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-0e773fef-4d5b-49ba-aa01-b0a1eedfede3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:11:39.033590 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1387/2785] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:11:38 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:11:39.499401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2a902-a8f5-4f9f-9506-8acfb1568e7c admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:39.501469 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b6f2a902-a8f5-4f9f-9506-8acfb1568e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:11:39.578569 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2a902-a8f5-4f9f-9506-8acfb1568e7c admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:39.583683 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2286010-e50e-4b0f-bb9c-cc104aeb6736 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b365d9dd635e4518a41181649c323062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:39.584365 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2286010-e50e-4b0f-bb9c-cc104aeb6736 service placement] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:39.584651 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2286010-e50e-4b0f-bb9c-cc104aeb6736 service placement] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:39.584976 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2286010-e50e-4b0f-bb9c-cc104aeb6736 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:39.586967 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e2286010-e50e-4b0f-bb9c-cc104aeb6736 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:11:39.598540 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2286010-e50e-4b0f-bb9c-cc104aeb6736 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:39.600166 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2286010-e50e-4b0f-bb9c-cc104aeb6736 service placement] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:39.611004 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1399/2786] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:11:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:11:40.095527 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e773fef-4d5b-49ba-aa01-b0a1eedfede3 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:40.161262 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e773fef-4d5b-49ba-aa01-b0a1eedfede3 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:40.166816 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed3748-8a79-4dce-8cce-bd0e10165e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:40.167733 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed3748-8a79-4dce-8cce-bd0e10165e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:40.168016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed3748-8a79-4dce-8cce-bd0e10165e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:40.168292 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed3748-8a79-4dce-8cce-bd0e10165e8b admin admin] PATH_INFO: `/v3/users/89ea1e2f17384dc2bd7aa7b79896c038` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:40.169660 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed3748-8a79-4dce-8cce-bd0e10165e8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=89ea1e2f17384dc2bd7aa7b79896c038)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:40.171800 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed3748-8a79-4dce-8cce-bd0e10165e8b admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:40.222175 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-daed3748-8a79-4dce-8cce-bd0e10165e8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89ea1e2f17384dc2bd7aa7b79896c038'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:40.229570 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-daed3748-8a79-4dce-8cce-bd0e10165e8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89ea1e2f17384dc2bd7aa7b79896c038'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:40.238766 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-daed3748-8a79-4dce-8cce-bd0e10165e8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89ea1e2f17384dc2bd7aa7b79896c038'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:40.239409 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-daed3748-8a79-4dce-8cce-bd0e10165e8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89ea1e2f17384dc2bd7aa7b79896c038'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:40.251732 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-daed3748-8a79-4dce-8cce-bd0e10165e8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89ea1e2f17384dc2bd7aa7b79896c038'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:40.257762 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1388/2787] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:11:40 2022] DELETE /identity/v3/users/89ea1e2f17384dc2bd7aa7b79896c038 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:11:40.440883 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2286010-e50e-4b0f-bb9c-cc104aeb6736 service placement] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:40.453948 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2286010-e50e-4b0f-bb9c-cc104aeb6736 service placement] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:40.459004 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:11:40.514742 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053325c-6067-4e54-8609-1e911b9cbdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:40.515571 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053325c-6067-4e54-8609-1e911b9cbdc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:40.515860 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053325c-6067-4e54-8609-1e911b9cbdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:40.516140 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053325c-6067-4e54-8609-1e911b9cbdc9 admin admin] PATH_INFO: `/v3/projects/3729891e430d4ef587cdbe1e63c7e60b` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:40.517331 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053325c-6067-4e54-8609-1e911b9cbdc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3729891e430d4ef587cdbe1e63c7e60b)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:40.519320 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053325c-6067-4e54-8609-1e911b9cbdc9 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:40.576620 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-1053325c-6067-4e54-8609-1e911b9cbdc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3729891e430d4ef587cdbe1e63c7e60b', 'request_id': 'req-1053325c-6067-4e54-8609-1e911b9cbdc9'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:40.585812 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-1053325c-6067-4e54-8609-1e911b9cbdc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3729891e430d4ef587cdbe1e63c7e60b', 'request_id': 'req-1053325c-6067-4e54-8609-1e911b9cbdc9'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:40.591630 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-1053325c-6067-4e54-8609-1e911b9cbdc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3729891e430d4ef587cdbe1e63c7e60b', 'request_id': 'req-1053325c-6067-4e54-8609-1e911b9cbdc9'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:40.602944 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-1053325c-6067-4e54-8609-1e911b9cbdc9 admin admin] The token cache is being invalidate because project 3729891e430d4ef587cdbe1e63c7e60b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:11:40.603335 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-1053325c-6067-4e54-8609-1e911b9cbdc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:40.604102 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-1053325c-6067-4e54-8609-1e911b9cbdc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:40.605728 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1400/2788] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:11:40 2022] DELETE /identity/v3/projects/3729891e430d4ef587cdbe1e63c7e60b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 11:11:40.610042 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed3748-8a79-4dce-8cce-bd0e10165e8b admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:40.611806 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-daed3748-8a79-4dce-8cce-bd0e10165e8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:11:40.625862 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed3748-8a79-4dce-8cce-bd0e10165e8b admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:40.630973 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:11:40.688597 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fcd8f-59a0-4db1-93ed-8e8c24432ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:40.689488 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fcd8f-59a0-4db1-93ed-8e8c24432ec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:40.689774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fcd8f-59a0-4db1-93ed-8e8c24432ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:40.690048 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fcd8f-59a0-4db1-93ed-8e8c24432ec0 admin admin] PATH_INFO: `/v3/users/191b3338ec5c4064b3dbe636bcde49cc` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:40.691322 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1fcd8f-59a0-4db1-93ed-8e8c24432ec0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=191b3338ec5c4064b3dbe636bcde49cc)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:40.693261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1fcd8f-59a0-4db1-93ed-8e8c24432ec0 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:40.748294 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-da1fcd8f-59a0-4db1-93ed-8e8c24432ec0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '191b3338ec5c4064b3dbe636bcde49cc'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:40.756207 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-da1fcd8f-59a0-4db1-93ed-8e8c24432ec0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '191b3338ec5c4064b3dbe636bcde49cc'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:40.765049 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-da1fcd8f-59a0-4db1-93ed-8e8c24432ec0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '191b3338ec5c4064b3dbe636bcde49cc'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:40.765785 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-da1fcd8f-59a0-4db1-93ed-8e8c24432ec0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '191b3338ec5c4064b3dbe636bcde49cc'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:40.778636 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-da1fcd8f-59a0-4db1-93ed-8e8c24432ec0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '191b3338ec5c4064b3dbe636bcde49cc'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:40.785600 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1389/2789] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:11:40 2022] DELETE /identity/v3/users/191b3338ec5c4064b3dbe636bcde49cc => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:11:40.987221 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053325c-6067-4e54-8609-1e911b9cbdc9 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:40.989224 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1053325c-6067-4e54-8609-1e911b9cbdc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:11:41.005811 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053325c-6067-4e54-8609-1e911b9cbdc9 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:41.067161 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aef1a5-bb7c-42a7-a7b8-294b1a17257b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:41.068053 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aef1a5-bb7c-42a7-a7b8-294b1a17257b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:41.068332 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aef1a5-bb7c-42a7-a7b8-294b1a17257b admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:41.068604 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aef1a5-bb7c-42a7-a7b8-294b1a17257b admin admin] PATH_INFO: `/v3/projects/7ff16244c9724df6b721a0c99d2026e6` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:41.070214 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aef1a5-bb7c-42a7-a7b8-294b1a17257b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ff16244c9724df6b721a0c99d2026e6)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:41.072153 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aef1a5-bb7c-42a7-a7b8-294b1a17257b admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:41.117578 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:11:41.126068 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-55aef1a5-bb7c-42a7-a7b8-294b1a17257b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff16244c9724df6b721a0c99d2026e6', 'request_id': 'req-55aef1a5-bb7c-42a7-a7b8-294b1a17257b'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:41.135433 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-55aef1a5-bb7c-42a7-a7b8-294b1a17257b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff16244c9724df6b721a0c99d2026e6', 'request_id': 'req-55aef1a5-bb7c-42a7-a7b8-294b1a17257b'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:41.143140 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-55aef1a5-bb7c-42a7-a7b8-294b1a17257b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff16244c9724df6b721a0c99d2026e6', 'request_id': 'req-55aef1a5-bb7c-42a7-a7b8-294b1a17257b'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:41.154776 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-55aef1a5-bb7c-42a7-a7b8-294b1a17257b admin admin] The token cache is being invalidate because project 7ff16244c9724df6b721a0c99d2026e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:11:41.155059 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-55aef1a5-bb7c-42a7-a7b8-294b1a17257b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:41.155794 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-55aef1a5-bb7c-42a7-a7b8-294b1a17257b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:41.157409 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1401/2790] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:11:40 2022] DELETE /identity/v3/projects/7ff16244c9724df6b721a0c99d2026e6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:11:41.163235 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ea850-3f0a-4e5e-8f8a-4b8f9a8be2d8 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:41.163847 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ea850-3f0a-4e5e-8f8a-4b8f9a8be2d8 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:41.163847 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ea850-3f0a-4e5e-8f8a-4b8f9a8be2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:41.183959 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-287ea850-3f0a-4e5e-8f8a-4b8f9a8be2d8 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:11:41.185160 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-287ea850-3f0a-4e5e-8f8a-4b8f9a8be2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:11:41.256334 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1390/2791] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:11:41.265927 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e34403-d809-415d-805f-ea1e4e7436af None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:41.266206 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e34403-d809-415d-805f-ea1e4e7436af None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:41.266418 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e34403-d809-415d-805f-ea1e4e7436af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:41.285398 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-65e34403-d809-415d-805f-ea1e4e7436af None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:11:41.286617 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-65e34403-d809-415d-805f-ea1e4e7436af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:11:41.295268 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1402/2792] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:11:41.300133 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ea850-3f0a-4e5e-8f8a-4b8f9a8be2d8 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:41.312005 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ea850-3f0a-4e5e-8f8a-4b8f9a8be2d8 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:41.318144 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5b414-f2f3-4185-abe9-96a196db9ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:41.318813 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5b414-f2f3-4185-abe9-96a196db9ecd admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:41.319223 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5b414-f2f3-4185-abe9-96a196db9ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:41.319508 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5b414-f2f3-4185-abe9-96a196db9ecd admin admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:41.320247 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5b414-f2f3-4185-abe9-96a196db9ecd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 11:11:41.320653 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5b414-f2f3-4185-abe9-96a196db9ecd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:41.322328 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5b414-f2f3-4185-abe9-96a196db9ecd admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:41.335115 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1391/2793] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 11:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 11:11:41.340557 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e34403-d809-415d-805f-ea1e4e7436af None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:41.353527 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e34403-d809-415d-805f-ea1e4e7436af None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:41.358708 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0a3b9-46b4-45ac-807a-04fc9065a3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:41.359393 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0a3b9-46b4-45ac-807a-04fc9065a3b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:41.359685 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0a3b9-46b4-45ac-807a-04fc9065a3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:41.359962 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0a3b9-46b4-45ac-807a-04fc9065a3b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:41.360674 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0a3b9-46b4-45ac-807a-04fc9065a3b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:41.362587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0a3b9-46b4-45ac-807a-04fc9065a3b0 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:41.391599 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1403/2794] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:11:41 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 11:11:41.398085 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5b414-f2f3-4185-abe9-96a196db9ecd admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:41.413598 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5b414-f2f3-4185-abe9-96a196db9ecd admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:41.425229 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:11:41.474306 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e90dac-2519-4089-a7a3-836c8ff51f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:41.475026 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e90dac-2519-4089-a7a3-836c8ff51f55 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:41.475429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e90dac-2519-4089-a7a3-836c8ff51f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:41.475738 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e90dac-2519-4089-a7a3-836c8ff51f55 admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:41.476471 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e90dac-2519-4089-a7a3-836c8ff51f55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:41.478458 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e90dac-2519-4089-a7a3-836c8ff51f55 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:41.500661 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1392/2795] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:11:41 2022] POST /identity/v3/users => generated 284 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:11:41.504868 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0a3b9-46b4-45ac-807a-04fc9065a3b0 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:41.516009 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0a3b9-46b4-45ac-807a-04fc9065a3b0 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:41.520842 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f46ab-f688-49e4-bbd3-33b7ca5d1e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:41.521518 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f46ab-f688-49e4-bbd3-33b7ca5d1e47 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:41.521801 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f46ab-f688-49e4-bbd3-33b7ca5d1e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:41.522079 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f46ab-f688-49e4-bbd3-33b7ca5d1e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:41.523012 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f46ab-f688-49e4-bbd3-33b7ca5d1e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:41.524668 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f46ab-f688-49e4-bbd3-33b7ca5d1e47 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:41.535741 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1404/2796] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:11:41.540006 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e90dac-2519-4089-a7a3-836c8ff51f55 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:41.550508 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e90dac-2519-4089-a7a3-836c8ff51f55 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:41.556156 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d6b57-659d-4ca4-b66a-020bce0a5461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:41.556826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d6b57-659d-4ca4-b66a-020bce0a5461 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:41.557094 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d6b57-659d-4ca4-b66a-020bce0a5461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:41.557369 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d6b57-659d-4ca4-b66a-020bce0a5461 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:41.558099 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d6b57-659d-4ca4-b66a-020bce0a5461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:41.559733 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d6b57-659d-4ca4-b66a-020bce0a5461 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:41.570339 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1393/2797] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:11:41.575058 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f46ab-f688-49e4-bbd3-33b7ca5d1e47 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:41.591061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f46ab-f688-49e4-bbd3-33b7ca5d1e47 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:41.599863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1a3ea-693b-4dc3-83df-d5e250dd4405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:41.601026 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1a3ea-693b-4dc3-83df-d5e250dd4405 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:41.601307 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1a3ea-693b-4dc3-83df-d5e250dd4405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:41.601587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1a3ea-693b-4dc3-83df-d5e250dd4405 admin admin] PATH_INFO: `/v3/projects/e633a26e00ca40b3994be74970462814/users/5dec902d41b04e1a86c6c1819fdc2ce9/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:41.617784 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1a3ea-693b-4dc3-83df-d5e250dd4405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e633a26e00ca40b3994be74970462814, user_id=5dec902d41b04e1a86c6c1819fdc2ce9, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:41.620518 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1a3ea-693b-4dc3-83df-d5e250dd4405 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:41.636234 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1405/2798] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:11:41 2022] PUT /identity/v3/projects/e633a26e00ca40b3994be74970462814/users/5dec902d41b04e1a86c6c1819fdc2ce9/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 11:11:41.646530 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ce501-31b3-4c38-a525-404889ff314f None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:41.646826 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ce501-31b3-4c38-a525-404889ff314f None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:41.647112 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ce501-31b3-4c38-a525-404889ff314f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:41.674508 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-2f3ce501-31b3-4c38-a525-404889ff314f None None] MFA Rules not processed for user `5dec902d41b04e1a86c6c1819fdc2ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:11:41.675756 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-2f3ce501-31b3-4c38-a525-404889ff314f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:11:41.743690 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1394/2799] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:11:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:11:41.750615 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1a3ea-693b-4dc3-83df-d5e250dd4405 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:41.831487 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1a3ea-693b-4dc3-83df-d5e250dd4405 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:41.838361 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee6e7a-56be-4260-bdc9-f56c332a235f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:41.839028 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee6e7a-56be-4260-bdc9-f56c332a235f admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:41.839357 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee6e7a-56be-4260-bdc9-f56c332a235f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:41.839638 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee6e7a-56be-4260-bdc9-f56c332a235f admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:41.840325 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee6e7a-56be-4260-bdc9-f56c332a235f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:41.842236 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee6e7a-56be-4260-bdc9-f56c332a235f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:41.871461 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1406/2800] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:11:41 2022] POST /identity/v3/projects => generated 367 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:11:41.875685 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ce501-31b3-4c38-a525-404889ff314f None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:41.886813 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ce501-31b3-4c38-a525-404889ff314f None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:41.944483 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3d491-2190-458f-8363-9a43bbab3976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:41.945208 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3d491-2190-458f-8363-9a43bbab3976 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:41.945496 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3d491-2190-458f-8363-9a43bbab3976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:41.945776 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3d491-2190-458f-8363-9a43bbab3976 admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:41.946828 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3d491-2190-458f-8363-9a43bbab3976 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:41.948471 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3d491-2190-458f-8363-9a43bbab3976 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:41.969393 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1395/2801] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:11:41 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:11:41.973624 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee6e7a-56be-4260-bdc9-f56c332a235f admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:41.985206 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee6e7a-56be-4260-bdc9-f56c332a235f admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:41.990829 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66921641-6985-48a0-839c-8f159e68d3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:41.991726 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66921641-6985-48a0-839c-8f159e68d3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:41.992018 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66921641-6985-48a0-839c-8f159e68d3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:41.992293 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66921641-6985-48a0-839c-8f159e68d3f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:41.993023 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66921641-6985-48a0-839c-8f159e68d3f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:41.994633 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66921641-6985-48a0-839c-8f159e68d3f6 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:42.005838 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1407/2802] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:11:42.010190 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3d491-2190-458f-8363-9a43bbab3976 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:42.021561 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3d491-2190-458f-8363-9a43bbab3976 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:42.027005 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a68a8-9b93-4882-a59f-311b17dcf467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:42.027917 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a68a8-9b93-4882-a59f-311b17dcf467 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:42.028200 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a68a8-9b93-4882-a59f-311b17dcf467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:42.028498 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a68a8-9b93-4882-a59f-311b17dcf467 admin admin] PATH_INFO: `/v3/projects/96f539bd12964cef9455a88fcda9a2f1/users/d8c71189576541a98b5060d547dd60a3/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:42.041243 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:11:42.046271 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a68a8-9b93-4882-a59f-311b17dcf467 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96f539bd12964cef9455a88fcda9a2f1, user_id=d8c71189576541a98b5060d547dd60a3, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:42.049405 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a68a8-9b93-4882-a59f-311b17dcf467 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:42.068278 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1396/2803] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:11:42 2022] PUT /identity/v3/projects/96f539bd12964cef9455a88fcda9a2f1/users/d8c71189576541a98b5060d547dd60a3/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:11:42.072690 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66921641-6985-48a0-839c-8f159e68d3f6 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:42.082824 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66921641-6985-48a0-839c-8f159e68d3f6 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:42.121792 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:11:42.142707 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c574a-ad69-4bbe-9387-c6743026ef3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:42.143415 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c574a-ad69-4bbe-9387-c6743026ef3e admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:42.143702 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c574a-ad69-4bbe-9387-c6743026ef3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:42.143978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c574a-ad69-4bbe-9387-c6743026ef3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:42.144703 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c574a-ad69-4bbe-9387-c6743026ef3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:42.146299 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c574a-ad69-4bbe-9387-c6743026ef3e admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:42.156417 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1408/2804] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:11:42.161265 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a68a8-9b93-4882-a59f-311b17dcf467 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:42.172778 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a68a8-9b93-4882-a59f-311b17dcf467 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:42.179066 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7ef07-1a74-433b-aa97-32c19a327bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:42.179740 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7ef07-1a74-433b-aa97-32c19a327bdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:42.180020 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7ef07-1a74-433b-aa97-32c19a327bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:42.180301 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7ef07-1a74-433b-aa97-32c19a327bdd admin admin] PATH_INFO: `/v3/projects/96f539bd12964cef9455a88fcda9a2f1/users/d8c71189576541a98b5060d547dd60a3/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:42.182497 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f7ef07-1a74-433b-aa97-32c19a327bdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=96f539bd12964cef9455a88fcda9a2f1, user_id=d8c71189576541a98b5060d547dd60a3, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:42.185166 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f7ef07-1a74-433b-aa97-32c19a327bdd admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:42.196625 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1397/2805] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:11:42 2022] PUT /identity/v3/projects/96f539bd12964cef9455a88fcda9a2f1/users/d8c71189576541a98b5060d547dd60a3/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:11:42.206882 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e33902-bc49-4018-ace9-1a2b3f38b070 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:42.207179 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e33902-bc49-4018-ace9-1a2b3f38b070 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:42.207479 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e33902-bc49-4018-ace9-1a2b3f38b070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:42.236087 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-b9e33902-bc49-4018-ace9-1a2b3f38b070 None None] MFA Rules not processed for user `d8c71189576541a98b5060d547dd60a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:11:42.237323 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b9e33902-bc49-4018-ace9-1a2b3f38b070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:11:42.311981 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1409/2806] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:11:42 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:11:42.324258 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7ef07-1a74-433b-aa97-32c19a327bdd admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:42.326164 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-15f7ef07-1a74-433b-aa97-32c19a327bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:11:42.414059 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7ef07-1a74-433b-aa97-32c19a327bdd admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:42.418111 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68c7e0-da90-44e9-ab33-32373d73c102 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:42.418756 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68c7e0-da90-44e9-ab33-32373d73c102 service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:42.419038 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68c7e0-da90-44e9-ab33-32373d73c102 service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:42.419347 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68c7e0-da90-44e9-ab33-32373d73c102 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:42.429326 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68c7e0-da90-44e9-ab33-32373d73c102 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:42.430754 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68c7e0-da90-44e9-ab33-32373d73c102 service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:42.440320 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1398/2807] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:11:42 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:11:42.526805 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e33902-bc49-4018-ace9-1a2b3f38b070 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:42.537502 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e33902-bc49-4018-ace9-1a2b3f38b070 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:42.542176 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa21fff-98ab-49f8-b840-ea0465452828 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:42.542826 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa21fff-98ab-49f8-b840-ea0465452828 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:42.543107 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa21fff-98ab-49f8-b840-ea0465452828 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:42.543430 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa21fff-98ab-49f8-b840-ea0465452828 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:42.601812 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa21fff-98ab-49f8-b840-ea0465452828 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:42.603279 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa21fff-98ab-49f8-b840-ea0465452828 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:42.612564 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1410/2808] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:11:42 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:11:47.524311 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68c7e0-da90-44e9-ab33-32373d73c102 service cinder] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:47.598254 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68c7e0-da90-44e9-ab33-32373d73c102 service cinder] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:47.603619 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca960ae5-e4d5-40df-b1dc-73955612d628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:47.604521 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca960ae5-e4d5-40df-b1dc-73955612d628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:47.604809 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca960ae5-e4d5-40df-b1dc-73955612d628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:47.605088 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca960ae5-e4d5-40df-b1dc-73955612d628 admin admin] PATH_INFO: `/v3/users/5dec902d41b04e1a86c6c1819fdc2ce9` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:47.606557 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca960ae5-e4d5-40df-b1dc-73955612d628 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dec902d41b04e1a86c6c1819fdc2ce9)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:47.608528 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca960ae5-e4d5-40df-b1dc-73955612d628 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:47.668111 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ca960ae5-e4d5-40df-b1dc-73955612d628 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dec902d41b04e1a86c6c1819fdc2ce9'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:47.675594 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ca960ae5-e4d5-40df-b1dc-73955612d628 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dec902d41b04e1a86c6c1819fdc2ce9'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:47.679681 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:11:47.688827 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ca960ae5-e4d5-40df-b1dc-73955612d628 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dec902d41b04e1a86c6c1819fdc2ce9'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:47.690046 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ca960ae5-e4d5-40df-b1dc-73955612d628 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dec902d41b04e1a86c6c1819fdc2ce9'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:47.709016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ca960ae5-e4d5-40df-b1dc-73955612d628 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dec902d41b04e1a86c6c1819fdc2ce9'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:47.717267 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1399/2809] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:11:47 2022] DELETE /identity/v3/users/5dec902d41b04e1a86c6c1819fdc2ce9 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:11:47.721916 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedc560-e544-4937-83be-b42657611dcd None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:47.722401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedc560-e544-4937-83be-b42657611dcd None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:47.722521 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedc560-e544-4937-83be-b42657611dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:47.740011 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-9fedc560-e544-4937-83be-b42657611dcd None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:11:47.741243 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9fedc560-e544-4937-83be-b42657611dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:11:47.795019 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:11:47.804720 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1411/2810] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:11:47.816129 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca960ae5-e4d5-40df-b1dc-73955612d628 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:47.817723 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-ca960ae5-e4d5-40df-b1dc-73955612d628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:11:47.880012 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca960ae5-e4d5-40df-b1dc-73955612d628 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:47.884312 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2262f2-6036-420b-857c-095d643c196b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:47.884977 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2262f2-6036-420b-857c-095d643c196b service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:47.885261 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2262f2-6036-420b-857c-095d643c196b service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:47.885535 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2262f2-6036-420b-857c-095d643c196b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:47.895330 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2262f2-6036-420b-857c-095d643c196b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:47.896775 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2262f2-6036-420b-857c-095d643c196b service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:47.909368 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1400/2811] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:11:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:11:48.188858 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedc560-e544-4937-83be-b42657611dcd None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:48.190642 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9fedc560-e544-4937-83be-b42657611dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:11:48.203297 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedc560-e544-4937-83be-b42657611dcd None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:48.208797 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3a311-415f-44df-8001-d32b89f28672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:48.209675 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3a311-415f-44df-8001-d32b89f28672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:48.209973 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3a311-415f-44df-8001-d32b89f28672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:48.210251 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3a311-415f-44df-8001-d32b89f28672 admin admin] PATH_INFO: `/v3/projects/e633a26e00ca40b3994be74970462814` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:48.211491 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3a311-415f-44df-8001-d32b89f28672 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e633a26e00ca40b3994be74970462814)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:48.213394 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3a311-415f-44df-8001-d32b89f28672 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:48.268623 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-cdd3a311-415f-44df-8001-d32b89f28672 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e633a26e00ca40b3994be74970462814', 'request_id': 'req-cdd3a311-415f-44df-8001-d32b89f28672'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:48.277913 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-cdd3a311-415f-44df-8001-d32b89f28672 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e633a26e00ca40b3994be74970462814', 'request_id': 'req-cdd3a311-415f-44df-8001-d32b89f28672'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:48.284374 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-cdd3a311-415f-44df-8001-d32b89f28672 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e633a26e00ca40b3994be74970462814', 'request_id': 'req-cdd3a311-415f-44df-8001-d32b89f28672'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:48.296102 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-cdd3a311-415f-44df-8001-d32b89f28672 admin admin] The token cache is being invalidate because project e633a26e00ca40b3994be74970462814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:11:48.296389 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-cdd3a311-415f-44df-8001-d32b89f28672 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:48.297083 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-cdd3a311-415f-44df-8001-d32b89f28672 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:48.298722 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1412/2812] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:11:48 2022] DELETE /identity/v3/projects/e633a26e00ca40b3994be74970462814 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:11:48.302990 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2262f2-6036-420b-857c-095d643c196b service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:48.313124 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2262f2-6036-420b-857c-095d643c196b service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:48.377633 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3716b-74db-48c8-9e78-1d5e28514eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:48.378518 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3716b-74db-48c8-9e78-1d5e28514eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:48.378802 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3716b-74db-48c8-9e78-1d5e28514eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:48.379079 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3716b-74db-48c8-9e78-1d5e28514eb8 admin admin] PATH_INFO: `/v3/users/d8c71189576541a98b5060d547dd60a3` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:48.380462 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3716b-74db-48c8-9e78-1d5e28514eb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8c71189576541a98b5060d547dd60a3)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:48.382444 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3716b-74db-48c8-9e78-1d5e28514eb8 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:48.435855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-05c3716b-74db-48c8-9e78-1d5e28514eb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8c71189576541a98b5060d547dd60a3'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:48.442763 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-05c3716b-74db-48c8-9e78-1d5e28514eb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8c71189576541a98b5060d547dd60a3'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:48.451428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-05c3716b-74db-48c8-9e78-1d5e28514eb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8c71189576541a98b5060d547dd60a3'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:48.452142 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-05c3716b-74db-48c8-9e78-1d5e28514eb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8c71189576541a98b5060d547dd60a3'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:48.464151 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-05c3716b-74db-48c8-9e78-1d5e28514eb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8c71189576541a98b5060d547dd60a3'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:48.466315 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:11:48.470900 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1401/2813] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:11:48 2022] DELETE /identity/v3/users/d8c71189576541a98b5060d547dd60a3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:11:48.764821 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3a311-415f-44df-8001-d32b89f28672 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:48.766693 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-cdd3a311-415f-44df-8001-d32b89f28672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:11:48.780175 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3a311-415f-44df-8001-d32b89f28672 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:48.846354 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43467a2c-160a-4987-8750-b8201d8cdf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:48.847304 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43467a2c-160a-4987-8750-b8201d8cdf95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:48.847588 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43467a2c-160a-4987-8750-b8201d8cdf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:48.847863 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43467a2c-160a-4987-8750-b8201d8cdf95 admin admin] PATH_INFO: `/v3/projects/96f539bd12964cef9455a88fcda9a2f1` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:48.849614 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43467a2c-160a-4987-8750-b8201d8cdf95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96f539bd12964cef9455a88fcda9a2f1)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:48.852261 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43467a2c-160a-4987-8750-b8201d8cdf95 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:48.910914 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-43467a2c-160a-4987-8750-b8201d8cdf95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96f539bd12964cef9455a88fcda9a2f1', 'request_id': 'req-43467a2c-160a-4987-8750-b8201d8cdf95'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:48.920006 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-43467a2c-160a-4987-8750-b8201d8cdf95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96f539bd12964cef9455a88fcda9a2f1', 'request_id': 'req-43467a2c-160a-4987-8750-b8201d8cdf95'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:48.926042 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-43467a2c-160a-4987-8750-b8201d8cdf95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96f539bd12964cef9455a88fcda9a2f1', 'request_id': 'req-43467a2c-160a-4987-8750-b8201d8cdf95'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:48.937726 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-43467a2c-160a-4987-8750-b8201d8cdf95 admin admin] The token cache is being invalidate because project 96f539bd12964cef9455a88fcda9a2f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:11:48.938016 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-43467a2c-160a-4987-8750-b8201d8cdf95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:48.938738 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-43467a2c-160a-4987-8750-b8201d8cdf95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:11:48.940382 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1413/2814] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:11:48 2022] DELETE /identity/v3/projects/96f539bd12964cef9455a88fcda9a2f1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:11:48.945524 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5900c69-f244-4730-940b-6613b26d042b None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:48.946030 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5900c69-f244-4730-940b-6613b26d042b None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:48.946133 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5900c69-f244-4730-940b-6613b26d042b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:48.965877 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-d5900c69-f244-4730-940b-6613b26d042b None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:11:48.967187 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-d5900c69-f244-4730-940b-6613b26d042b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:11:49.041927 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1402/2815] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:11:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:11:49.052600 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b476c-f286-4888-bf9a-edad1002c608 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:49.052898 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b476c-f286-4888-bf9a-edad1002c608 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:49.053330 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b476c-f286-4888-bf9a-edad1002c608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:49.076404 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-5e4b476c-f286-4888-bf9a-edad1002c608 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:11:49.077623 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5e4b476c-f286-4888-bf9a-edad1002c608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:11:49.087168 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1414/2816] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:11:49.092491 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5900c69-f244-4730-940b-6613b26d042b None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:49.108589 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5900c69-f244-4730-940b-6613b26d042b None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:49.116688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92404c7d-1daf-4f8d-9f8a-a2f6367681dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:49.117549 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92404c7d-1daf-4f8d-9f8a-a2f6367681dc admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:49.117831 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92404c7d-1daf-4f8d-9f8a-a2f6367681dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:49.118085 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92404c7d-1daf-4f8d-9f8a-a2f6367681dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:49.119026 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92404c7d-1daf-4f8d-9f8a-a2f6367681dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 11:11:49.119492 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92404c7d-1daf-4f8d-9f8a-a2f6367681dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:49.121754 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92404c7d-1daf-4f8d-9f8a-a2f6367681dc admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:49.135350 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1403/2817] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 11:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 11:11:49.141749 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b476c-f286-4888-bf9a-edad1002c608 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:49.155125 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b476c-f286-4888-bf9a-edad1002c608 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:49.161602 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d609f6-ea13-4201-88ee-cb79fca37da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:49.162205 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d609f6-ea13-4201-88ee-cb79fca37da5 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:49.162499 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d609f6-ea13-4201-88ee-cb79fca37da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:49.162764 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d609f6-ea13-4201-88ee-cb79fca37da5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:49.163503 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d609f6-ea13-4201-88ee-cb79fca37da5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:49.165452 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d609f6-ea13-4201-88ee-cb79fca37da5 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:49.169192 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:11:49.200266 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1415/2818] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:11:49 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:11:49.204527 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92404c7d-1daf-4f8d-9f8a-a2f6367681dc admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:49.215991 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92404c7d-1daf-4f8d-9f8a-a2f6367681dc admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:49.281739 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ac6b7-0057-4721-80c6-ee73a8ae9cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:49.282429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ac6b7-0057-4721-80c6-ee73a8ae9cec admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:49.282688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ac6b7-0057-4721-80c6-ee73a8ae9cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:49.283355 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ac6b7-0057-4721-80c6-ee73a8ae9cec admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:49.284085 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ac6b7-0057-4721-80c6-ee73a8ae9cec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:49.286179 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ac6b7-0057-4721-80c6-ee73a8ae9cec admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:49.311643 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1404/2819] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:11:49 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:11:49.316025 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d609f6-ea13-4201-88ee-cb79fca37da5 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:49.327310 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d609f6-ea13-4201-88ee-cb79fca37da5 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:49.332389 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268be3b-1f95-40c6-bb3c-470689f56049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:49.333060 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268be3b-1f95-40c6-bb3c-470689f56049 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:49.333338 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268be3b-1f95-40c6-bb3c-470689f56049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:49.333640 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268be3b-1f95-40c6-bb3c-470689f56049 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:49.334369 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6268be3b-1f95-40c6-bb3c-470689f56049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:49.335998 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6268be3b-1f95-40c6-bb3c-470689f56049 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:49.346482 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1416/2820] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:11:49.351044 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ac6b7-0057-4721-80c6-ee73a8ae9cec admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:49.364312 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ac6b7-0057-4721-80c6-ee73a8ae9cec admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:49.371295 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81082812-858c-4940-9010-a52d716913de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:49.372326 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81082812-858c-4940-9010-a52d716913de admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:49.372579 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81082812-858c-4940-9010-a52d716913de admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:49.372866 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81082812-858c-4940-9010-a52d716913de admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:49.373592 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81082812-858c-4940-9010-a52d716913de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:49.375250 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81082812-858c-4940-9010-a52d716913de admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:49.387090 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1405/2821] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:11:49.392227 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268be3b-1f95-40c6-bb3c-470689f56049 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:49.406386 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268be3b-1f95-40c6-bb3c-470689f56049 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:49.412587 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f440af4-69e8-4c46-85fd-22b9d1ec2e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:49.413435 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f440af4-69e8-4c46-85fd-22b9d1ec2e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:49.413719 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f440af4-69e8-4c46-85fd-22b9d1ec2e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:49.414066 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f440af4-69e8-4c46-85fd-22b9d1ec2e7d admin admin] PATH_INFO: `/v3/projects/4dbf3b89f4084333919ede15d93c5d7e/users/b11319af71eb4d3e893a1b437e6eb1f6/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:49.432585 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f440af4-69e8-4c46-85fd-22b9d1ec2e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dbf3b89f4084333919ede15d93c5d7e, user_id=b11319af71eb4d3e893a1b437e6eb1f6, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:49.435545 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f440af4-69e8-4c46-85fd-22b9d1ec2e7d admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:49.453526 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1417/2822] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:11:49 2022] PUT /identity/v3/projects/4dbf3b89f4084333919ede15d93c5d7e/users/b11319af71eb4d3e893a1b437e6eb1f6/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:11:49.464375 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee795dfd-67ff-425d-8264-d79b82d9c0c6 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:49.464724 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee795dfd-67ff-425d-8264-d79b82d9c0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:49.465013 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee795dfd-67ff-425d-8264-d79b82d9c0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:49.501759 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-ee795dfd-67ff-425d-8264-d79b82d9c0c6 None None] MFA Rules not processed for user `b11319af71eb4d3e893a1b437e6eb1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:11:49.503004 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-ee795dfd-67ff-425d-8264-d79b82d9c0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:11:49.567902 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:11:49.580677 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1406/2823] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:11:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:11:49.594461 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f440af4-69e8-4c46-85fd-22b9d1ec2e7d admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:11:49.596377 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1f440af4-69e8-4c46-85fd-22b9d1ec2e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:11:49.684223 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f440af4-69e8-4c46-85fd-22b9d1ec2e7d admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:11:49.688421 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0dee2e-b2ce-4b97-bbb7-4fd216904500 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcba737e66244fe2b5b6ec3dd17dabd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:11:49.689070 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dee2e-b2ce-4b97-bbb7-4fd216904500 service glance] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:11:49.689351 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dee2e-b2ce-4b97-bbb7-4fd216904500 service glance] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:11:49.689626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dee2e-b2ce-4b97-bbb7-4fd216904500 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:11:49.698459 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0dee2e-b2ce-4b97-bbb7-4fd216904500 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:11:49.700148 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0dee2e-b2ce-4b97-bbb7-4fd216904500 service glance] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:11:49.709039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1418/2824] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:11:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 11:11:59.581627 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=2 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:11:59.704993 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=56,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:12:11.682864 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee795dfd-67ff-425d-8264-d79b82d9c0c6 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:11.751349 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee795dfd-67ff-425d-8264-d79b82d9c0c6 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:11.760307 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c9124-3780-4742-8608-e217df8e2dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:11.761201 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c9124-3780-4742-8608-e217df8e2dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:11.761462 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c9124-3780-4742-8608-e217df8e2dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:11.761774 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c9124-3780-4742-8608-e217df8e2dc4 admin admin] PATH_INFO: `/v3/users/b11319af71eb4d3e893a1b437e6eb1f6` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:11.763266 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c9124-3780-4742-8608-e217df8e2dc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b11319af71eb4d3e893a1b437e6eb1f6)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:11.765213 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c9124-3780-4742-8608-e217df8e2dc4 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:11.825853 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-b88c9124-3780-4742-8608-e217df8e2dc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b11319af71eb4d3e893a1b437e6eb1f6'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:11.833659 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-b88c9124-3780-4742-8608-e217df8e2dc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b11319af71eb4d3e893a1b437e6eb1f6'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:11.843230 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-b88c9124-3780-4742-8608-e217df8e2dc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b11319af71eb4d3e893a1b437e6eb1f6'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:11.843886 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-b88c9124-3780-4742-8608-e217df8e2dc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b11319af71eb4d3e893a1b437e6eb1f6'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:11.856815 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-b88c9124-3780-4742-8608-e217df8e2dc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b11319af71eb4d3e893a1b437e6eb1f6'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:11.862922 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1407/2825] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:12:11 2022] DELETE /identity/v3/users/b11319af71eb4d3e893a1b437e6eb1f6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:12:11.867919 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc465b7-932a-4f76-bc32-efe2e2566d24 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:11.868438 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc465b7-932a-4f76-bc32-efe2e2566d24 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:11.868544 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc465b7-932a-4f76-bc32-efe2e2566d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:11.887262 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-2bc465b7-932a-4f76-bc32-efe2e2566d24 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:12:11.888488 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-2bc465b7-932a-4f76-bc32-efe2e2566d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:11.949722 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1419/2826] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:12:11.959574 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c9124-3780-4742-8608-e217df8e2dc4 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:11.961038 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-b88c9124-3780-4742-8608-e217df8e2dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:12.027330 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c9124-3780-4742-8608-e217df8e2dc4 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:12.030894 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aed9d2-b48d-46e8-8b22-ec3bcec90352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:12.031584 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aed9d2-b48d-46e8-8b22-ec3bcec90352 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:12.031881 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aed9d2-b48d-46e8-8b22-ec3bcec90352 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:12.032160 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aed9d2-b48d-46e8-8b22-ec3bcec90352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:12.041980 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aed9d2-b48d-46e8-8b22-ec3bcec90352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:12.043459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aed9d2-b48d-46e8-8b22-ec3bcec90352 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:12.053177 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1408/2827] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:12:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:12:12.345342 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc465b7-932a-4f76-bc32-efe2e2566d24 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:12.346886 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-2bc465b7-932a-4f76-bc32-efe2e2566d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:12.359474 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc465b7-932a-4f76-bc32-efe2e2566d24 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:12.364324 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8319733d-11e1-43a7-a98d-125d6de9bb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:12.365208 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319733d-11e1-43a7-a98d-125d6de9bb7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:12.365486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319733d-11e1-43a7-a98d-125d6de9bb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:12.365756 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319733d-11e1-43a7-a98d-125d6de9bb7b admin admin] PATH_INFO: `/v3/projects/4dbf3b89f4084333919ede15d93c5d7e` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:12.366944 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8319733d-11e1-43a7-a98d-125d6de9bb7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dbf3b89f4084333919ede15d93c5d7e)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:12.368937 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8319733d-11e1-43a7-a98d-125d6de9bb7b admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:12.422421 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-8319733d-11e1-43a7-a98d-125d6de9bb7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dbf3b89f4084333919ede15d93c5d7e', 'request_id': 'req-8319733d-11e1-43a7-a98d-125d6de9bb7b'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:12.432416 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-8319733d-11e1-43a7-a98d-125d6de9bb7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dbf3b89f4084333919ede15d93c5d7e', 'request_id': 'req-8319733d-11e1-43a7-a98d-125d6de9bb7b'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:12.437904 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-8319733d-11e1-43a7-a98d-125d6de9bb7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dbf3b89f4084333919ede15d93c5d7e', 'request_id': 'req-8319733d-11e1-43a7-a98d-125d6de9bb7b'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:12.449978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-8319733d-11e1-43a7-a98d-125d6de9bb7b admin admin] The token cache is being invalidate because project 4dbf3b89f4084333919ede15d93c5d7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:12:12.450265 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-8319733d-11e1-43a7-a98d-125d6de9bb7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:12.451406 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-8319733d-11e1-43a7-a98d-125d6de9bb7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:12.453626 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1420/2828] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:12:12 2022] DELETE /identity/v3/projects/4dbf3b89f4084333919ede15d93c5d7e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:12:12.458912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09926b-0637-4e4d-91c9-b294ec331a4f None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:12.459241 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09926b-0637-4e4d-91c9-b294ec331a4f None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:12.459525 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09926b-0637-4e4d-91c9-b294ec331a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:12.478181 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-da09926b-0637-4e4d-91c9-b294ec331a4f None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:12:12.479569 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-da09926b-0637-4e4d-91c9-b294ec331a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:12.497228 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:12:12.546336 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1409/2829] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:12:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:12:12.555489 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa08f5c-d210-48b9-979d-19dd61d0a89a None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:12.555779 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa08f5c-d210-48b9-979d-19dd61d0a89a None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:12.556054 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa08f5c-d210-48b9-979d-19dd61d0a89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:12.575048 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-4fa08f5c-d210-48b9-979d-19dd61d0a89a None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:12:12.576274 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-4fa08f5c-d210-48b9-979d-19dd61d0a89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:12.584719 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1421/2830] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:12:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:12:12.589130 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09926b-0637-4e4d-91c9-b294ec331a4f None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:12.599471 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09926b-0637-4e4d-91c9-b294ec331a4f None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:12.605245 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9252b-3a83-4310-873b-2eee88c727a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:12.605914 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9252b-3a83-4310-873b-2eee88c727a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:12.606207 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9252b-3a83-4310-873b-2eee88c727a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:12.606481 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9252b-3a83-4310-873b-2eee88c727a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:12.607248 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9252b-3a83-4310-873b-2eee88c727a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 11:12:12.607555 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9252b-3a83-4310-873b-2eee88c727a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:12.609181 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9252b-3a83-4310-873b-2eee88c727a6 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:12.621823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1410/2831] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 11:12:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 11:12:12.626238 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa08f5c-d210-48b9-979d-19dd61d0a89a None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:12.636255 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa08f5c-d210-48b9-979d-19dd61d0a89a None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:12.641570 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c46de-20fe-4baf-9fac-f4f72da67beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:12.642233 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c46de-20fe-4baf-9fac-f4f72da67beb admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:12.642549 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c46de-20fe-4baf-9fac-f4f72da67beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:12.642829 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c46de-20fe-4baf-9fac-f4f72da67beb admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:12.643570 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c46de-20fe-4baf-9fac-f4f72da67beb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:12.645474 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c46de-20fe-4baf-9fac-f4f72da67beb admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:12.674784 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1422/2832] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:12:12 2022] POST /identity/v3/projects => generated 361 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:12:12.679162 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9252b-3a83-4310-873b-2eee88c727a6 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:12.690017 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9252b-3a83-4310-873b-2eee88c727a6 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:12.752192 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d7494-382b-4a04-87b9-626bdbc039da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:12.752877 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d7494-382b-4a04-87b9-626bdbc039da admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:12.753189 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d7494-382b-4a04-87b9-626bdbc039da admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:12.753465 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d7494-382b-4a04-87b9-626bdbc039da admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:12.754156 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197d7494-382b-4a04-87b9-626bdbc039da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:12.756127 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197d7494-382b-4a04-87b9-626bdbc039da admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:12.777900 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1411/2833] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:12:12 2022] POST /identity/v3/users => generated 281 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:12:12.782176 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c46de-20fe-4baf-9fac-f4f72da67beb admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:12.796445 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c46de-20fe-4baf-9fac-f4f72da67beb admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:12.805009 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1c04d-bd3b-4711-8359-e3c48b3b16ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:12.805934 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1c04d-bd3b-4711-8359-e3c48b3b16ec admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:12.806300 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1c04d-bd3b-4711-8359-e3c48b3b16ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:12.806750 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1c04d-bd3b-4711-8359-e3c48b3b16ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:12.807755 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1c04d-bd3b-4711-8359-e3c48b3b16ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:12.809358 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1c04d-bd3b-4711-8359-e3c48b3b16ec admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:12.820219 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1423/2834] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 11:12:12.824504 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d7494-382b-4a04-87b9-626bdbc039da admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:12.834848 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d7494-382b-4a04-87b9-626bdbc039da admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:12.840425 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e2d3d-582b-486a-a437-178ba35f5ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:12.841024 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e2d3d-582b-486a-a437-178ba35f5ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:12.841312 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e2d3d-582b-486a-a437-178ba35f5ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:12.841588 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e2d3d-582b-486a-a437-178ba35f5ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:12.842346 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e2d3d-582b-486a-a437-178ba35f5ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:12.843981 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e2d3d-582b-486a-a437-178ba35f5ef1 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:12.854385 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1412/2835] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:12:12.858535 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1c04d-bd3b-4711-8359-e3c48b3b16ec admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:12.868838 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1c04d-bd3b-4711-8359-e3c48b3b16ec admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:12.874126 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4bb7bb-a1ae-45f0-946d-ccea5879f1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:12.875019 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bb7bb-a1ae-45f0-946d-ccea5879f1f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:12.875343 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bb7bb-a1ae-45f0-946d-ccea5879f1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:12.875622 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bb7bb-a1ae-45f0-946d-ccea5879f1f8 admin admin] PATH_INFO: `/v3/projects/0480718591bb4265b5d22779a252e43f/users/ae8a9d7bce864f8a9e8e193c826c190d/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:12.890871 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4bb7bb-a1ae-45f0-946d-ccea5879f1f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0480718591bb4265b5d22779a252e43f, user_id=ae8a9d7bce864f8a9e8e193c826c190d, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:12.893547 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4bb7bb-a1ae-45f0-946d-ccea5879f1f8 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:12.911075 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1424/2836] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:12:12 2022] PUT /identity/v3/projects/0480718591bb4265b5d22779a252e43f/users/ae8a9d7bce864f8a9e8e193c826c190d/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:12:12.921431 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d08d6-c145-4772-820c-1323586f6f40 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:12.921723 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d08d6-c145-4772-820c-1323586f6f40 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:12.922000 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d08d6-c145-4772-820c-1323586f6f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:12.948672 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-490d08d6-c145-4772-820c-1323586f6f40 None None] MFA Rules not processed for user `ae8a9d7bce864f8a9e8e193c826c190d`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:12:12.949864 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-490d08d6-c145-4772-820c-1323586f6f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:13.016455 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1413/2837] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:12:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:12:13.057695 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4bb7bb-a1ae-45f0-946d-ccea5879f1f8 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:13.059840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-2d4bb7bb-a1ae-45f0-946d-ccea5879f1f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:13.083619 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:12:13.122802 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4bb7bb-a1ae-45f0-946d-ccea5879f1f8 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:13.127505 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9aecd-1532-4279-ad15-845e074fd256 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:13.128166 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9aecd-1532-4279-ad15-845e074fd256 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:13.128452 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9aecd-1532-4279-ad15-845e074fd256 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:13.128733 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9aecd-1532-4279-ad15-845e074fd256 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:13.137857 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9aecd-1532-4279-ad15-845e074fd256 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:13.139331 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9aecd-1532-4279-ad15-845e074fd256 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:13.148360 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1425/2838] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:12:13 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:12:13.169823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d08d6-c145-4772-820c-1323586f6f40 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:13.190984 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:12:13.238120 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d08d6-c145-4772-820c-1323586f6f40 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:13.242955 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec101e6a-575c-4122-a51d-9f82d33a2447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:13.243873 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec101e6a-575c-4122-a51d-9f82d33a2447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:13.244157 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec101e6a-575c-4122-a51d-9f82d33a2447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:13.244438 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec101e6a-575c-4122-a51d-9f82d33a2447 admin admin] PATH_INFO: `/v3/users/ae8a9d7bce864f8a9e8e193c826c190d` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:13.245677 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec101e6a-575c-4122-a51d-9f82d33a2447 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae8a9d7bce864f8a9e8e193c826c190d)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:13.247665 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec101e6a-575c-4122-a51d-9f82d33a2447 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:13.298763 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ec101e6a-575c-4122-a51d-9f82d33a2447 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae8a9d7bce864f8a9e8e193c826c190d'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:13.306964 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ec101e6a-575c-4122-a51d-9f82d33a2447 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae8a9d7bce864f8a9e8e193c826c190d'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:13.316697 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ec101e6a-575c-4122-a51d-9f82d33a2447 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae8a9d7bce864f8a9e8e193c826c190d'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:13.317333 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ec101e6a-575c-4122-a51d-9f82d33a2447 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae8a9d7bce864f8a9e8e193c826c190d'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:13.329916 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-ec101e6a-575c-4122-a51d-9f82d33a2447 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae8a9d7bce864f8a9e8e193c826c190d'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:13.335849 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1414/2839] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:12:13 2022] DELETE /identity/v3/users/ae8a9d7bce864f8a9e8e193c826c190d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:12:13.341823 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af86ecf-d53d-41a9-a7e9-ecae4979adec None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:13.342333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af86ecf-d53d-41a9-a7e9-ecae4979adec None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:13.342833 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af86ecf-d53d-41a9-a7e9-ecae4979adec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:13.365044 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-1af86ecf-d53d-41a9-a7e9-ecae4979adec None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:12:13.366351 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1af86ecf-d53d-41a9-a7e9-ecae4979adec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:13.428804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1426/2840] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:12:13.439030 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec101e6a-575c-4122-a51d-9f82d33a2447 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:13.440579 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-ec101e6a-575c-4122-a51d-9f82d33a2447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:13.501211 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec101e6a-575c-4122-a51d-9f82d33a2447 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:13.505232 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9eaed-79c1-4074-92da-31bcb93eb7d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:13.505890 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9eaed-79c1-4074-92da-31bcb93eb7d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:13.506174 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9eaed-79c1-4074-92da-31bcb93eb7d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:13.506453 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9eaed-79c1-4074-92da-31bcb93eb7d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:13.516502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a9eaed-79c1-4074-92da-31bcb93eb7d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:13.517945 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a9eaed-79c1-4074-92da-31bcb93eb7d3 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:13.528429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1415/2841] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:12:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:12:13.810823 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af86ecf-d53d-41a9-a7e9-ecae4979adec None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:13.812637 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1af86ecf-d53d-41a9-a7e9-ecae4979adec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:13.827839 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af86ecf-d53d-41a9-a7e9-ecae4979adec None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:13.834820 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f8caa-dfad-4613-94a6-63c0f7eb8172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:13.835789 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f8caa-dfad-4613-94a6-63c0f7eb8172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:13.835982 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f8caa-dfad-4613-94a6-63c0f7eb8172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:13.836255 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f8caa-dfad-4613-94a6-63c0f7eb8172 admin admin] PATH_INFO: `/v3/projects/0480718591bb4265b5d22779a252e43f` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:13.837491 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f8caa-dfad-4613-94a6-63c0f7eb8172 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0480718591bb4265b5d22779a252e43f)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:13.839778 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f8caa-dfad-4613-94a6-63c0f7eb8172 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:13.887908 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6f0f8caa-dfad-4613-94a6-63c0f7eb8172 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0480718591bb4265b5d22779a252e43f', 'request_id': 'req-6f0f8caa-dfad-4613-94a6-63c0f7eb8172'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:13.896401 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6f0f8caa-dfad-4613-94a6-63c0f7eb8172 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0480718591bb4265b5d22779a252e43f', 'request_id': 'req-6f0f8caa-dfad-4613-94a6-63c0f7eb8172'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:13.902141 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6f0f8caa-dfad-4613-94a6-63c0f7eb8172 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0480718591bb4265b5d22779a252e43f', 'request_id': 'req-6f0f8caa-dfad-4613-94a6-63c0f7eb8172'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:13.913199 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6f0f8caa-dfad-4613-94a6-63c0f7eb8172 admin admin] The token cache is being invalidate because project 0480718591bb4265b5d22779a252e43f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:12:13.913482 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6f0f8caa-dfad-4613-94a6-63c0f7eb8172 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:13.914116 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6f0f8caa-dfad-4613-94a6-63c0f7eb8172 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:13.915677 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1427/2842] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:12:13 2022] DELETE /identity/v3/projects/0480718591bb4265b5d22779a252e43f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:12:13.920763 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a92ba-0cc6-4b0e-add7-bd0c5b5c882c None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:13.921248 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a92ba-0cc6-4b0e-add7-bd0c5b5c882c None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:13.921248 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a92ba-0cc6-4b0e-add7-bd0c5b5c882c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:13.938941 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-976a92ba-0cc6-4b0e-add7-bd0c5b5c882c None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:12:13.940153 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-976a92ba-0cc6-4b0e-add7-bd0c5b5c882c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:13.976164 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:12:14.004310 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1416/2843] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:12:14.012720 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad13cd-f348-447b-8e88-b79671d79717 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:14.012998 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad13cd-f348-447b-8e88-b79671d79717 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:14.013281 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad13cd-f348-447b-8e88-b79671d79717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:14.032664 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-efad13cd-f348-447b-8e88-b79671d79717 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:12:14.033879 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-efad13cd-f348-447b-8e88-b79671d79717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:14.042611 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1428/2844] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:12:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:12:14.047603 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a92ba-0cc6-4b0e-add7-bd0c5b5c882c None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:14.063201 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a92ba-0cc6-4b0e-add7-bd0c5b5c882c None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:14.071239 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17f263-6ad7-4387-a811-b83d3e6e79ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:14.072347 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17f263-6ad7-4387-a811-b83d3e6e79ec admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:14.073011 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17f263-6ad7-4387-a811-b83d3e6e79ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:14.073283 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17f263-6ad7-4387-a811-b83d3e6e79ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:14.074022 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17f263-6ad7-4387-a811-b83d3e6e79ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 11:12:14.074333 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17f263-6ad7-4387-a811-b83d3e6e79ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:14.075976 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17f263-6ad7-4387-a811-b83d3e6e79ec admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:14.093212 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1417/2845] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 11:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 11:12:14.098350 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad13cd-f348-447b-8e88-b79671d79717 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:14.110122 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad13cd-f348-447b-8e88-b79671d79717 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:14.116170 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1044479-4dc3-4a84-924c-bc6ee47f5d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:14.116828 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1044479-4dc3-4a84-924c-bc6ee47f5d7d admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:14.117118 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1044479-4dc3-4a84-924c-bc6ee47f5d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:14.117384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1044479-4dc3-4a84-924c-bc6ee47f5d7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:14.118079 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1044479-4dc3-4a84-924c-bc6ee47f5d7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:14.120263 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1044479-4dc3-4a84-924c-bc6ee47f5d7d admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:14.149688 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1429/2846] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:12:14 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:12:14.154109 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17f263-6ad7-4387-a811-b83d3e6e79ec admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:14.165260 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17f263-6ad7-4387-a811-b83d3e6e79ec admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:14.224857 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211f4c7-9d22-4142-901b-d3f8a290b99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:14.225457 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211f4c7-9d22-4142-901b-d3f8a290b99a admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:14.225743 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211f4c7-9d22-4142-901b-d3f8a290b99a admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:14.226020 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211f4c7-9d22-4142-901b-d3f8a290b99a admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:14.226709 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211f4c7-9d22-4142-901b-d3f8a290b99a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:14.228856 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211f4c7-9d22-4142-901b-d3f8a290b99a admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:14.253289 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1418/2847] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:12:14 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:12:14.258823 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1044479-4dc3-4a84-924c-bc6ee47f5d7d admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:14.269890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1044479-4dc3-4a84-924c-bc6ee47f5d7d admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:14.274410 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151c763-58e1-430b-99c1-a23d7803cbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:14.275078 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151c763-58e1-430b-99c1-a23d7803cbd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:14.275963 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151c763-58e1-430b-99c1-a23d7803cbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:14.276253 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151c763-58e1-430b-99c1-a23d7803cbd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:14.276989 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151c763-58e1-430b-99c1-a23d7803cbd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:14.278572 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151c763-58e1-430b-99c1-a23d7803cbd5 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:14.289921 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1430/2848] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:12:14.294242 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211f4c7-9d22-4142-901b-d3f8a290b99a admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:14.305022 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211f4c7-9d22-4142-901b-d3f8a290b99a admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:14.310886 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599616dd-95a4-4468-b4dd-f67fd3e97433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:14.311594 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599616dd-95a4-4468-b4dd-f67fd3e97433 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:14.311878 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599616dd-95a4-4468-b4dd-f67fd3e97433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:14.312185 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599616dd-95a4-4468-b4dd-f67fd3e97433 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:14.312922 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599616dd-95a4-4468-b4dd-f67fd3e97433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:14.314526 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599616dd-95a4-4468-b4dd-f67fd3e97433 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:14.325213 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1419/2849] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:12:14.329500 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151c763-58e1-430b-99c1-a23d7803cbd5 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:14.340924 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151c763-58e1-430b-99c1-a23d7803cbd5 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:14.345916 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487e98e-a975-4c53-a5df-79cfdf3a52ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:14.346796 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487e98e-a975-4c53-a5df-79cfdf3a52ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:14.347086 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487e98e-a975-4c53-a5df-79cfdf3a52ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:14.347395 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487e98e-a975-4c53-a5df-79cfdf3a52ae admin admin] PATH_INFO: `/v3/projects/c9d338cffd174be8806348c7dbff656f/users/0104b2c4615245feb75d5be26d191704/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:14.349785 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:12:14.366518 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487e98e-a975-4c53-a5df-79cfdf3a52ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d338cffd174be8806348c7dbff656f, user_id=0104b2c4615245feb75d5be26d191704, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:14.369274 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487e98e-a975-4c53-a5df-79cfdf3a52ae admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:14.384304 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1431/2850] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:12:14 2022] PUT /identity/v3/projects/c9d338cffd174be8806348c7dbff656f/users/0104b2c4615245feb75d5be26d191704/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 11:12:14.453941 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1dcbd-043f-46b0-a714-6e1da9f054a6 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:14.454323 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1dcbd-043f-46b0-a714-6e1da9f054a6 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:14.454695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1dcbd-043f-46b0-a714-6e1da9f054a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:14.486219 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-f7f1dcbd-043f-46b0-a714-6e1da9f054a6 None None] MFA Rules not processed for user `0104b2c4615245feb75d5be26d191704`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:12:14.487425 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-f7f1dcbd-043f-46b0-a714-6e1da9f054a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:14.554955 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1420/2851] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:12:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:12:14.560023 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487e98e-a975-4c53-a5df-79cfdf3a52ae admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:14.626470 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487e98e-a975-4c53-a5df-79cfdf3a52ae admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:14.632160 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77a226-9504-47be-8d78-ec9ec91e4c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:14.632841 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77a226-9504-47be-8d78-ec9ec91e4c86 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:14.633119 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77a226-9504-47be-8d78-ec9ec91e4c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:14.633399 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77a226-9504-47be-8d78-ec9ec91e4c86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:14.634099 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77a226-9504-47be-8d78-ec9ec91e4c86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:14.636099 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77a226-9504-47be-8d78-ec9ec91e4c86 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:14.665086 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1432/2852] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:12:14 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:12:14.669567 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1dcbd-043f-46b0-a714-6e1da9f054a6 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:14.680724 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1dcbd-043f-46b0-a714-6e1da9f054a6 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:14.717533 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:12:14.745995 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3e079-baed-422b-9e58-ef3d4b01508e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:14.746639 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3e079-baed-422b-9e58-ef3d4b01508e admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:14.746922 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3e079-baed-422b-9e58-ef3d4b01508e admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:14.747218 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3e079-baed-422b-9e58-ef3d4b01508e admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:14.747909 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3e079-baed-422b-9e58-ef3d4b01508e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:14.749904 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3e079-baed-422b-9e58-ef3d4b01508e admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:14.771814 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1421/2853] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:12:14 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:12:14.776835 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77a226-9504-47be-8d78-ec9ec91e4c86 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:14.792436 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77a226-9504-47be-8d78-ec9ec91e4c86 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:14.797652 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fd768-66ac-4149-b313-a92e881a9461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:14.798346 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fd768-66ac-4149-b313-a92e881a9461 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:14.798630 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fd768-66ac-4149-b313-a92e881a9461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:14.798905 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fd768-66ac-4149-b313-a92e881a9461 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:14.799674 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921fd768-66ac-4149-b313-a92e881a9461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:14.801276 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921fd768-66ac-4149-b313-a92e881a9461 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:14.811858 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1433/2854] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:12:14.815894 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3e079-baed-422b-9e58-ef3d4b01508e admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:14.825900 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3e079-baed-422b-9e58-ef3d4b01508e admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:14.831296 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab1c75-3281-462b-8785-4390b4a8b31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:14.831957 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab1c75-3281-462b-8785-4390b4a8b31f admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:14.832242 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab1c75-3281-462b-8785-4390b4a8b31f admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:14.832522 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab1c75-3281-462b-8785-4390b4a8b31f admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:14.833250 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab1c75-3281-462b-8785-4390b4a8b31f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:14.834841 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab1c75-3281-462b-8785-4390b4a8b31f admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:14.845062 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1422/2855] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:12:14.849697 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fd768-66ac-4149-b313-a92e881a9461 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:14.861614 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fd768-66ac-4149-b313-a92e881a9461 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:14.866576 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cf367-1b0d-449a-8369-c684f5600f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:14.867504 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cf367-1b0d-449a-8369-c684f5600f29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:14.867812 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cf367-1b0d-449a-8369-c684f5600f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:14.868085 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cf367-1b0d-449a-8369-c684f5600f29 admin admin] PATH_INFO: `/v3/projects/09cb28a9164d4d3597cce8a267f85190/users/c5619e7f3ac743349d6888280173e847/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:14.883776 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4cf367-1b0d-449a-8369-c684f5600f29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09cb28a9164d4d3597cce8a267f85190, user_id=c5619e7f3ac743349d6888280173e847, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:14.886515 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4cf367-1b0d-449a-8369-c684f5600f29 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:14.901040 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1434/2856] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:12:14 2022] PUT /identity/v3/projects/09cb28a9164d4d3597cce8a267f85190/users/c5619e7f3ac743349d6888280173e847/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:12:14.912636 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e2807-1e75-40d7-a760-3a8af863bb7b None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:14.913012 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e2807-1e75-40d7-a760-3a8af863bb7b None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:14.913405 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e2807-1e75-40d7-a760-3a8af863bb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:14.944721 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-708e2807-1e75-40d7-a760-3a8af863bb7b None None] MFA Rules not processed for user `c5619e7f3ac743349d6888280173e847`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:12:14.945970 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-708e2807-1e75-40d7-a760-3a8af863bb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:15.024705 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1423/2857] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:12:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:12:15.029379 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cf367-1b0d-449a-8369-c684f5600f29 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:15.101781 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cf367-1b0d-449a-8369-c684f5600f29 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:15.106944 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8f395-0243-46ad-850b-67f13b9b6de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:15.107647 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8f395-0243-46ad-850b-67f13b9b6de7 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:15.107933 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8f395-0243-46ad-850b-67f13b9b6de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:15.108237 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8f395-0243-46ad-850b-67f13b9b6de7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:15.108941 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8f395-0243-46ad-850b-67f13b9b6de7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:15.110825 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8f395-0243-46ad-850b-67f13b9b6de7 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:15.141740 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1435/2858] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:12:15 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:12:15.146343 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e2807-1e75-40d7-a760-3a8af863bb7b None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:15.158971 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e2807-1e75-40d7-a760-3a8af863bb7b None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:15.224192 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e347e7c-c59b-4a86-9498-cbcaf0580dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:15.224872 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e347e7c-c59b-4a86-9498-cbcaf0580dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:15.225154 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e347e7c-c59b-4a86-9498-cbcaf0580dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:15.225438 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e347e7c-c59b-4a86-9498-cbcaf0580dd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:15.226122 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e347e7c-c59b-4a86-9498-cbcaf0580dd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:15.228096 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e347e7c-c59b-4a86-9498-cbcaf0580dd5 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:15.248023 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1424/2859] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:12:15 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:12:15.252084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8f395-0243-46ad-850b-67f13b9b6de7 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:15.262978 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8f395-0243-46ad-850b-67f13b9b6de7 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:15.267827 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc0935-364e-40d8-a946-206abd1c9101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:15.268491 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc0935-364e-40d8-a946-206abd1c9101 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:15.268773 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc0935-364e-40d8-a946-206abd1c9101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:15.269048 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc0935-364e-40d8-a946-206abd1c9101 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:15.269787 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc0935-364e-40d8-a946-206abd1c9101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:15.271422 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc0935-364e-40d8-a946-206abd1c9101 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:15.282904 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1436/2860] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:12:15.287183 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e347e7c-c59b-4a86-9498-cbcaf0580dd5 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:15.297543 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e347e7c-c59b-4a86-9498-cbcaf0580dd5 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:15.302767 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43ff5e-ad59-442b-975b-1ed54f7e400e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:15.303692 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43ff5e-ad59-442b-975b-1ed54f7e400e admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:15.303975 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43ff5e-ad59-442b-975b-1ed54f7e400e admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:15.304243 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43ff5e-ad59-442b-975b-1ed54f7e400e admin admin] PATH_INFO: `/v3/projects/11c94c0d30dd4ec19977849310f17c3a/users/e7cec00b22cf4bf7a60d682feadad7c3/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:15.321077 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43ff5e-ad59-442b-975b-1ed54f7e400e admin admin] RBAC: Authorizing `identity:create_grant(project_id=11c94c0d30dd4ec19977849310f17c3a, user_id=e7cec00b22cf4bf7a60d682feadad7c3, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:15.324122 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43ff5e-ad59-442b-975b-1ed54f7e400e admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:15.342046 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1425/2861] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:12:15 2022] PUT /identity/v3/projects/11c94c0d30dd4ec19977849310f17c3a/users/e7cec00b22cf4bf7a60d682feadad7c3/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 11:12:15.346278 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc0935-364e-40d8-a946-206abd1c9101 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:15.356515 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc0935-364e-40d8-a946-206abd1c9101 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:15.360630 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:12:15.418870 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac224e05-40c1-4d18-9d81-b379ceac8cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:15.419599 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac224e05-40c1-4d18-9d81-b379ceac8cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:15.419887 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac224e05-40c1-4d18-9d81-b379ceac8cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:15.420168 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac224e05-40c1-4d18-9d81-b379ceac8cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:15.420906 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac224e05-40c1-4d18-9d81-b379ceac8cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:15.422511 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac224e05-40c1-4d18-9d81-b379ceac8cd8 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:15.433148 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1437/2862] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 11:12:15.438414 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43ff5e-ad59-442b-975b-1ed54f7e400e admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:15.449573 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43ff5e-ad59-442b-975b-1ed54f7e400e admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:15.455772 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dae1c-7188-4d87-861e-8fe30d0af0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:15.456814 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dae1c-7188-4d87-861e-8fe30d0af0a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:15.457124 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dae1c-7188-4d87-861e-8fe30d0af0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:15.457401 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dae1c-7188-4d87-861e-8fe30d0af0a2 admin admin] PATH_INFO: `/v3/projects/11c94c0d30dd4ec19977849310f17c3a/users/e7cec00b22cf4bf7a60d682feadad7c3/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:15.459686 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03dae1c-7188-4d87-861e-8fe30d0af0a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11c94c0d30dd4ec19977849310f17c3a, user_id=e7cec00b22cf4bf7a60d682feadad7c3, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:15.462350 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03dae1c-7188-4d87-861e-8fe30d0af0a2 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:15.466063 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:12:15.477429 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1426/2863] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:12:15 2022] PUT /identity/v3/projects/11c94c0d30dd4ec19977849310f17c3a/users/e7cec00b22cf4bf7a60d682feadad7c3/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:12:15.488064 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0db564-5291-4cc9-99f7-ac9afbe655be None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:15.488362 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0db564-5291-4cc9-99f7-ac9afbe655be None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:15.488646 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0db564-5291-4cc9-99f7-ac9afbe655be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:15.517523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-dd0db564-5291-4cc9-99f7-ac9afbe655be None None] MFA Rules not processed for user `e7cec00b22cf4bf7a60d682feadad7c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:12:15.518737 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-dd0db564-5291-4cc9-99f7-ac9afbe655be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:15.608854 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1438/2864] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:12:15 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:12:15.620293 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dae1c-7188-4d87-861e-8fe30d0af0a2 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:15.622311 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-c03dae1c-7188-4d87-861e-8fe30d0af0a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:15.680486 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dae1c-7188-4d87-861e-8fe30d0af0a2 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:15.684611 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111da158-a33b-47aa-972c-a46035f7c5fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:15.685269 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111da158-a33b-47aa-972c-a46035f7c5fb service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:15.685556 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111da158-a33b-47aa-972c-a46035f7c5fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:15.685839 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111da158-a33b-47aa-972c-a46035f7c5fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:15.743299 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111da158-a33b-47aa-972c-a46035f7c5fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:15.744798 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111da158-a33b-47aa-972c-a46035f7c5fb service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:15.753955 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1427/2865] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:12:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:12:17.284357 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0db564-5291-4cc9-99f7-ac9afbe655be None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:17.285892 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-dd0db564-5291-4cc9-99f7-ac9afbe655be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:17.298782 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0db564-5291-4cc9-99f7-ac9afbe655be None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:17.303051 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cd730-d102-4db0-b352-ac5826ca558b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:17.303733 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cd730-d102-4db0-b352-ac5826ca558b service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:17.304011 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cd730-d102-4db0-b352-ac5826ca558b service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:17.304290 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cd730-d102-4db0-b352-ac5826ca558b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:17.362680 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824cd730-d102-4db0-b352-ac5826ca558b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:17.364161 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824cd730-d102-4db0-b352-ac5826ca558b service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:17.373308 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1439/2866] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:12:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:12:17.921875 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111da158-a33b-47aa-972c-a46035f7c5fb service cinder] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:17.933196 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111da158-a33b-47aa-972c-a46035f7c5fb service cinder] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:17.937561 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57b1a1-a0b3-48d5-884c-922d75eedaca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f6668cb6244bba9e547ff95b2e6f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:17.938216 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57b1a1-a0b3-48d5-884c-922d75eedaca service cinder] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:17.938499 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57b1a1-a0b3-48d5-884c-922d75eedaca service cinder] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:17.938775 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57b1a1-a0b3-48d5-884c-922d75eedaca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:17.950984 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57b1a1-a0b3-48d5-884c-922d75eedaca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:17.953326 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57b1a1-a0b3-48d5-884c-922d75eedaca service cinder] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:17.967956 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1428/2867] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:12:17 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:12:21.893249 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cd730-d102-4db0-b352-ac5826ca558b service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:21.926035 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:12:21.959992 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cd730-d102-4db0-b352-ac5826ca558b service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:21.965088 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271129e-4979-4f03-b529-554cb2e594f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:21.965962 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271129e-4979-4f03-b529-554cb2e594f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:21.966256 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271129e-4979-4f03-b529-554cb2e594f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:21.966618 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271129e-4979-4f03-b529-554cb2e594f2 admin admin] PATH_INFO: `/v3/users/0104b2c4615245feb75d5be26d191704` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:21.967955 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271129e-4979-4f03-b529-554cb2e594f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0104b2c4615245feb75d5be26d191704)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:21.969927 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271129e-4979-4f03-b529-554cb2e594f2 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:22.022820 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9271129e-4979-4f03-b529-554cb2e594f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0104b2c4615245feb75d5be26d191704'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:22.029896 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9271129e-4979-4f03-b529-554cb2e594f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0104b2c4615245feb75d5be26d191704'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:22.037677 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9271129e-4979-4f03-b529-554cb2e594f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0104b2c4615245feb75d5be26d191704'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:22.038309 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9271129e-4979-4f03-b529-554cb2e594f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0104b2c4615245feb75d5be26d191704'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:22.050703 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9271129e-4979-4f03-b529-554cb2e594f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0104b2c4615245feb75d5be26d191704'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:22.056925 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1440/2868] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:12:21 2022] DELETE /identity/v3/users/0104b2c4615245feb75d5be26d191704 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:12:22.061792 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a76b37-7410-42bf-8264-cf0052ac806f None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:22.062332 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a76b37-7410-42bf-8264-cf0052ac806f None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:22.062332 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a76b37-7410-42bf-8264-cf0052ac806f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:22.080592 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-67a76b37-7410-42bf-8264-cf0052ac806f None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:12:22.081853 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-67a76b37-7410-42bf-8264-cf0052ac806f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:22.151929 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1429/2869] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:12:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:12:22.165848 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271129e-4979-4f03-b529-554cb2e594f2 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:22.168415 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9271129e-4979-4f03-b529-554cb2e594f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:22.232506 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271129e-4979-4f03-b529-554cb2e594f2 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:22.236573 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f32af-dc54-426b-8023-616d66458e53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:22.237268 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f32af-dc54-426b-8023-616d66458e53 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:22.237542 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f32af-dc54-426b-8023-616d66458e53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:22.237822 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f32af-dc54-426b-8023-616d66458e53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:22.247455 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f32af-dc54-426b-8023-616d66458e53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:22.248904 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f32af-dc54-426b-8023-616d66458e53 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:22.258752 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1441/2870] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:12:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:12:22.543936 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a76b37-7410-42bf-8264-cf0052ac806f None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:22.545650 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-67a76b37-7410-42bf-8264-cf0052ac806f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:22.561879 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a76b37-7410-42bf-8264-cf0052ac806f None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:22.567681 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3eeac-53c5-4477-b2eb-5aa4e328a1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:22.568566 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3eeac-53c5-4477-b2eb-5aa4e328a1e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:22.568846 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3eeac-53c5-4477-b2eb-5aa4e328a1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:22.569118 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3eeac-53c5-4477-b2eb-5aa4e328a1e3 admin admin] PATH_INFO: `/v3/projects/c9d338cffd174be8806348c7dbff656f` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:22.570382 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3eeac-53c5-4477-b2eb-5aa4e328a1e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9d338cffd174be8806348c7dbff656f)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:22.572349 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3eeac-53c5-4477-b2eb-5aa4e328a1e3 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:22.611026 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:12:22.625050 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-8cf3eeac-53c5-4477-b2eb-5aa4e328a1e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9d338cffd174be8806348c7dbff656f', 'request_id': 'req-8cf3eeac-53c5-4477-b2eb-5aa4e328a1e3'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:22.634772 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-8cf3eeac-53c5-4477-b2eb-5aa4e328a1e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9d338cffd174be8806348c7dbff656f', 'request_id': 'req-8cf3eeac-53c5-4477-b2eb-5aa4e328a1e3'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:22.641076 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-8cf3eeac-53c5-4477-b2eb-5aa4e328a1e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9d338cffd174be8806348c7dbff656f', 'request_id': 'req-8cf3eeac-53c5-4477-b2eb-5aa4e328a1e3'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:22.652789 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-8cf3eeac-53c5-4477-b2eb-5aa4e328a1e3 admin admin] The token cache is being invalidate because project c9d338cffd174be8806348c7dbff656f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:12:22.653070 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-8cf3eeac-53c5-4477-b2eb-5aa4e328a1e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:22.653842 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-8cf3eeac-53c5-4477-b2eb-5aa4e328a1e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:22.656419 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1430/2871] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:12:22 2022] DELETE /identity/v3/projects/c9d338cffd174be8806348c7dbff656f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:12:22.660688 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f32af-dc54-426b-8023-616d66458e53 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:22.670815 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f32af-dc54-426b-8023-616d66458e53 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:22.718883 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:12:22.732078 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bcaa4-4607-4579-abf3-b1c27cba3917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:22.733333 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bcaa4-4607-4579-abf3-b1c27cba3917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:22.733617 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bcaa4-4607-4579-abf3-b1c27cba3917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:22.733891 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bcaa4-4607-4579-abf3-b1c27cba3917 admin admin] PATH_INFO: `/v3/users/c5619e7f3ac743349d6888280173e847` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:22.735221 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bcaa4-4607-4579-abf3-b1c27cba3917 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5619e7f3ac743349d6888280173e847)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:22.737146 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bcaa4-4607-4579-abf3-b1c27cba3917 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:22.787138 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-230bcaa4-4607-4579-abf3-b1c27cba3917 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5619e7f3ac743349d6888280173e847'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:22.794169 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-230bcaa4-4607-4579-abf3-b1c27cba3917 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5619e7f3ac743349d6888280173e847'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:22.804118 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-230bcaa4-4607-4579-abf3-b1c27cba3917 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5619e7f3ac743349d6888280173e847'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:22.804744 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-230bcaa4-4607-4579-abf3-b1c27cba3917 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5619e7f3ac743349d6888280173e847'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:22.817868 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-230bcaa4-4607-4579-abf3-b1c27cba3917 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5619e7f3ac743349d6888280173e847'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:22.824116 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1442/2872] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:12:22 2022] DELETE /identity/v3/users/c5619e7f3ac743349d6888280173e847 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:12:23.100245 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3eeac-53c5-4477-b2eb-5aa4e328a1e3 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:23.102041 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-8cf3eeac-53c5-4477-b2eb-5aa4e328a1e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:23.117779 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3eeac-53c5-4477-b2eb-5aa4e328a1e3 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:23.182191 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366231b-3934-4b84-ac7b-f017993e889e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:23.183383 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366231b-3934-4b84-ac7b-f017993e889e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:23.183667 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366231b-3934-4b84-ac7b-f017993e889e admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:23.183944 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366231b-3934-4b84-ac7b-f017993e889e admin admin] PATH_INFO: `/v3/projects/09cb28a9164d4d3597cce8a267f85190` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:23.185842 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366231b-3934-4b84-ac7b-f017993e889e admin admin] RBAC: Authorizing `identity:delete_project(project_id=09cb28a9164d4d3597cce8a267f85190)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:23.187812 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366231b-3934-4b84-ac7b-f017993e889e admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:23.237958 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-0366231b-3934-4b84-ac7b-f017993e889e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09cb28a9164d4d3597cce8a267f85190', 'request_id': 'req-0366231b-3934-4b84-ac7b-f017993e889e'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:23.246972 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-0366231b-3934-4b84-ac7b-f017993e889e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09cb28a9164d4d3597cce8a267f85190', 'request_id': 'req-0366231b-3934-4b84-ac7b-f017993e889e'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:23.253270 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-0366231b-3934-4b84-ac7b-f017993e889e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09cb28a9164d4d3597cce8a267f85190', 'request_id': 'req-0366231b-3934-4b84-ac7b-f017993e889e'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:23.264497 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-0366231b-3934-4b84-ac7b-f017993e889e admin admin] The token cache is being invalidate because project 09cb28a9164d4d3597cce8a267f85190 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:12:23.264688 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-0366231b-3934-4b84-ac7b-f017993e889e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:23.265260 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-0366231b-3934-4b84-ac7b-f017993e889e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:23.266854 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1431/2873] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:12:23 2022] DELETE /identity/v3/projects/09cb28a9164d4d3597cce8a267f85190 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:12:23.271241 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bcaa4-4607-4579-abf3-b1c27cba3917 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:23.272721 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-230bcaa4-4607-4579-abf3-b1c27cba3917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:23.286193 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bcaa4-4607-4579-abf3-b1c27cba3917 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:23.346769 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0deed-8ed5-4fd5-89c2-e446aae9561d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:23.347723 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0deed-8ed5-4fd5-89c2-e446aae9561d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:23.348008 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0deed-8ed5-4fd5-89c2-e446aae9561d admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:23.348255 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0deed-8ed5-4fd5-89c2-e446aae9561d admin admin] PATH_INFO: `/v3/users/e7cec00b22cf4bf7a60d682feadad7c3` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:23.349521 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0deed-8ed5-4fd5-89c2-e446aae9561d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7cec00b22cf4bf7a60d682feadad7c3)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:23.351498 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0deed-8ed5-4fd5-89c2-e446aae9561d admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:23.413081 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-0be0deed-8ed5-4fd5-89c2-e446aae9561d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7cec00b22cf4bf7a60d682feadad7c3'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:23.420729 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-0be0deed-8ed5-4fd5-89c2-e446aae9561d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7cec00b22cf4bf7a60d682feadad7c3'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:23.433303 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-0be0deed-8ed5-4fd5-89c2-e446aae9561d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7cec00b22cf4bf7a60d682feadad7c3'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:23.434133 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-0be0deed-8ed5-4fd5-89c2-e446aae9561d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7cec00b22cf4bf7a60d682feadad7c3'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:23.439988 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:12:23.448656 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-0be0deed-8ed5-4fd5-89c2-e446aae9561d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7cec00b22cf4bf7a60d682feadad7c3'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:23.455294 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1443/2874] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:12:23 2022] DELETE /identity/v3/users/e7cec00b22cf4bf7a60d682feadad7c3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:12:23.749818 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366231b-3934-4b84-ac7b-f017993e889e admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:23.751532 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-0366231b-3934-4b84-ac7b-f017993e889e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:23.765329 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366231b-3934-4b84-ac7b-f017993e889e admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:23.818634 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:12:23.829876 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e68ace-3577-4162-b178-95917940216f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:23.830870 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e68ace-3577-4162-b178-95917940216f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:23.831169 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e68ace-3577-4162-b178-95917940216f admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:23.831471 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e68ace-3577-4162-b178-95917940216f admin admin] PATH_INFO: `/v3/projects/11c94c0d30dd4ec19977849310f17c3a` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:23.832656 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e68ace-3577-4162-b178-95917940216f admin admin] RBAC: Authorizing `identity:delete_project(project_id=11c94c0d30dd4ec19977849310f17c3a)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:23.834607 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e68ace-3577-4162-b178-95917940216f admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:23.883869 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-22e68ace-3577-4162-b178-95917940216f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11c94c0d30dd4ec19977849310f17c3a', 'request_id': 'req-22e68ace-3577-4162-b178-95917940216f'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:23.893270 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-22e68ace-3577-4162-b178-95917940216f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11c94c0d30dd4ec19977849310f17c3a', 'request_id': 'req-22e68ace-3577-4162-b178-95917940216f'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:23.899502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-22e68ace-3577-4162-b178-95917940216f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11c94c0d30dd4ec19977849310f17c3a', 'request_id': 'req-22e68ace-3577-4162-b178-95917940216f'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:23.914961 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-22e68ace-3577-4162-b178-95917940216f admin admin] The token cache is being invalidate because project 11c94c0d30dd4ec19977849310f17c3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:12:23.915421 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-22e68ace-3577-4162-b178-95917940216f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:23.916154 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-22e68ace-3577-4162-b178-95917940216f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:12:23.918590 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1432/2875] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:12:23 2022] DELETE /identity/v3/projects/11c94c0d30dd4ec19977849310f17c3a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:12:23.924087 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c112bc-1d9b-429a-9bfc-789ed86952a2 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:23.924382 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c112bc-1d9b-429a-9bfc-789ed86952a2 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:23.924664 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c112bc-1d9b-429a-9bfc-789ed86952a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:23.943167 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-96c112bc-1d9b-429a-9bfc-789ed86952a2 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:12:23.944422 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-96c112bc-1d9b-429a-9bfc-789ed86952a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:24.007335 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1444/2876] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:12:24.016448 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72437459-4f74-4ff8-a8bf-b3864ca393bd None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:24.016945 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72437459-4f74-4ff8-a8bf-b3864ca393bd None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:24.017316 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72437459-4f74-4ff8-a8bf-b3864ca393bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:24.040294 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-72437459-4f74-4ff8-a8bf-b3864ca393bd None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:12:24.041501 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-72437459-4f74-4ff8-a8bf-b3864ca393bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:24.050145 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1433/2877] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:12:24.054631 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c112bc-1d9b-429a-9bfc-789ed86952a2 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:24.064989 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c112bc-1d9b-429a-9bfc-789ed86952a2 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:24.070681 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d172068-7629-4af6-96bc-951dad6e8e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:24.071323 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d172068-7629-4af6-96bc-951dad6e8e0f admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:24.071605 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d172068-7629-4af6-96bc-951dad6e8e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:24.071884 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d172068-7629-4af6-96bc-951dad6e8e0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:24.072623 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d172068-7629-4af6-96bc-951dad6e8e0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 11:12:24.072934 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d172068-7629-4af6-96bc-951dad6e8e0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:24.074537 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d172068-7629-4af6-96bc-951dad6e8e0f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:24.086599 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1445/2878] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 11:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 11:12:24.090828 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72437459-4f74-4ff8-a8bf-b3864ca393bd None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:24.101100 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72437459-4f74-4ff8-a8bf-b3864ca393bd None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:24.106459 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10bc8f6-35b1-4f08-b696-e2d30f048f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:24.107141 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bc8f6-35b1-4f08-b696-e2d30f048f6b admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:24.107428 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bc8f6-35b1-4f08-b696-e2d30f048f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:24.107707 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bc8f6-35b1-4f08-b696-e2d30f048f6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:24.108436 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10bc8f6-35b1-4f08-b696-e2d30f048f6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:24.110330 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10bc8f6-35b1-4f08-b696-e2d30f048f6b admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:24.145316 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1434/2879] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:12:24 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 11:12:24.151956 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d172068-7629-4af6-96bc-951dad6e8e0f admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:24.163848 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d172068-7629-4af6-96bc-951dad6e8e0f admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:24.222466 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18201641-629d-4609-9b81-3c997e5d2ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:24.223139 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18201641-629d-4609-9b81-3c997e5d2ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:24.223450 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18201641-629d-4609-9b81-3c997e5d2ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:24.223729 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18201641-629d-4609-9b81-3c997e5d2ba2 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:24.224442 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18201641-629d-4609-9b81-3c997e5d2ba2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:24.226350 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18201641-629d-4609-9b81-3c997e5d2ba2 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:24.251039 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1446/2880] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:12:24 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:12:24.255299 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10bc8f6-35b1-4f08-b696-e2d30f048f6b admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:24.266905 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10bc8f6-35b1-4f08-b696-e2d30f048f6b admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:24.272836 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c51eb-f0d4-4192-9433-d682f0eda1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:24.273536 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c51eb-f0d4-4192-9433-d682f0eda1d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:24.273824 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c51eb-f0d4-4192-9433-d682f0eda1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:24.274102 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c51eb-f0d4-4192-9433-d682f0eda1d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:24.275013 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c51eb-f0d4-4192-9433-d682f0eda1d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:24.276655 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c51eb-f0d4-4192-9433-d682f0eda1d9 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:24.288973 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1435/2881] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:12:24.296062 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18201641-629d-4609-9b81-3c997e5d2ba2 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:24.306619 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18201641-629d-4609-9b81-3c997e5d2ba2 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:24.311261 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4256b-8df8-4e3c-8918-89ac3168a397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:24.311933 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4256b-8df8-4e3c-8918-89ac3168a397 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:24.312222 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4256b-8df8-4e3c-8918-89ac3168a397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:24.312506 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4256b-8df8-4e3c-8918-89ac3168a397 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:24.313243 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4256b-8df8-4e3c-8918-89ac3168a397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:24.314838 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4256b-8df8-4e3c-8918-89ac3168a397 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:24.325051 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1447/2882] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:12:24.329822 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c51eb-f0d4-4192-9433-d682f0eda1d9 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:24.340474 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c51eb-f0d4-4192-9433-d682f0eda1d9 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:24.346499 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4dba4f-44b7-45aa-bf2a-9244151339a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:24.347489 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4dba4f-44b7-45aa-bf2a-9244151339a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:24.347772 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4dba4f-44b7-45aa-bf2a-9244151339a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:24.348045 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4dba4f-44b7-45aa-bf2a-9244151339a3 admin admin] PATH_INFO: `/v3/projects/9853f983787a4c448389cd287c457e81/users/ddd02f5e81634084875c109cffce9667/roles/4827ddfe1a0e476294ecf7f1d122cc32` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:24.364026 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4dba4f-44b7-45aa-bf2a-9244151339a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9853f983787a4c448389cd287c457e81, user_id=ddd02f5e81634084875c109cffce9667, role_id=4827ddfe1a0e476294ecf7f1d122cc32)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:24.366682 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4dba4f-44b7-45aa-bf2a-9244151339a3 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:24.382047 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1436/2883] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:12:24 2022] PUT /identity/v3/projects/9853f983787a4c448389cd287c457e81/users/ddd02f5e81634084875c109cffce9667/roles/4827ddfe1a0e476294ecf7f1d122cc32 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:12:24.388152 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4066f-5438-4e64-8c70-87a6b9e54298 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:24.388565 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4066f-5438-4e64-8c70-87a6b9e54298 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:24.388935 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4066f-5438-4e64-8c70-87a6b9e54298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:24.408583 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-bda4066f-5438-4e64-8c70-87a6b9e54298 None None] MFA Rules not processed for user `ae7384e027454770bea6d011e8d5d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:12:24.409809 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-bda4066f-5438-4e64-8c70-87a6b9e54298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:24.460482 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:12:24.479515 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1448/2884] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 11:12:24.489661 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4dba4f-44b7-45aa-bf2a-9244151339a3 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:24.492196 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-1a4dba4f-44b7-45aa-bf2a-9244151339a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:24.563350 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4dba4f-44b7-45aa-bf2a-9244151339a3 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:24.567674 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574d160-1c6c-4975-b3cb-d543a92f874d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:24.568334 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574d160-1c6c-4975-b3cb-d543a92f874d service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:24.568616 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574d160-1c6c-4975-b3cb-d543a92f874d service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:24.568879 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574d160-1c6c-4975-b3cb-d543a92f874d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:24.578773 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574d160-1c6c-4975-b3cb-d543a92f874d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:24.580172 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574d160-1c6c-4975-b3cb-d543a92f874d service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:24.589811 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1437/2885] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:12:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:12:28.581625 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49d1cb-e077-4c1b-96d6-81ad4d990841 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:28.582145 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49d1cb-e077-4c1b-96d6-81ad4d990841 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:28.582358 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49d1cb-e077-4c1b-96d6-81ad4d990841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:28.613355 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-fc49d1cb-e077-4c1b-96d6-81ad4d990841 None None] MFA Rules not processed for user `ddd02f5e81634084875c109cffce9667`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:12:28.614584 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-fc49d1cb-e077-4c1b-96d6-81ad4d990841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:28.687783 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1449/2886] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:12:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:12:28.692330 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574d160-1c6c-4975-b3cb-d543a92f874d service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:28.702502 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574d160-1c6c-4975-b3cb-d543a92f874d service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:28.707687 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f066913-5d0a-4768-bda2-e39293de0585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:28.708354 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f066913-5d0a-4768-bda2-e39293de0585 admin admin] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:28.708638 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f066913-5d0a-4768-bda2-e39293de0585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:28.708912 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f066913-5d0a-4768-bda2-e39293de0585 admin admin] PATH_INFO: `/v3/projects` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:28.709626 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f066913-5d0a-4768-bda2-e39293de0585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:28.711565 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f066913-5d0a-4768-bda2-e39293de0585 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:28.732755 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:12:28.742335 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1438/2887] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 11:12:28 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 11:12:28.746221 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49d1cb-e077-4c1b-96d6-81ad4d990841 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:28.757809 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49d1cb-e077-4c1b-96d6-81ad4d990841 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:28.815972 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b245d-2d7f-41c0-85ef-39afa0bc16e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:28.816714 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b245d-2d7f-41c0-85ef-39afa0bc16e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:28.816880 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b245d-2d7f-41c0-85ef-39afa0bc16e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:28.817181 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b245d-2d7f-41c0-85ef-39afa0bc16e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:28.817877 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b245d-2d7f-41c0-85ef-39afa0bc16e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:28.819837 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b245d-2d7f-41c0-85ef-39afa0bc16e4 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:28.840942 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1450/2888] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 11:12:28 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 11:12:28.845206 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f066913-5d0a-4768-bda2-e39293de0585 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:28.856347 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f066913-5d0a-4768-bda2-e39293de0585 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:28.862957 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b44b1-4561-45fa-8573-7957e9639f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:28.863667 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b44b1-4561-45fa-8573-7957e9639f0e admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:28.863953 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b44b1-4561-45fa-8573-7957e9639f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:28.864227 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b44b1-4561-45fa-8573-7957e9639f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:28.864960 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b44b1-4561-45fa-8573-7957e9639f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:28.866568 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b44b1-4561-45fa-8573-7957e9639f0e admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:28.878937 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1439/2889] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:12:28.884240 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b245d-2d7f-41c0-85ef-39afa0bc16e4 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:28.897147 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b245d-2d7f-41c0-85ef-39afa0bc16e4 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:28.902355 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e8df9-7d6a-4d1c-9258-401ee245db44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:28.903288 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e8df9-7d6a-4d1c-9258-401ee245db44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:28.903575 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e8df9-7d6a-4d1c-9258-401ee245db44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:28.903857 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e8df9-7d6a-4d1c-9258-401ee245db44 admin admin] PATH_INFO: `/v3/projects/7278363e08eb4652851edb8df05ce19f/users/d5b812ca7dc041888401b3734faab409/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:28.920475 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e8df9-7d6a-4d1c-9258-401ee245db44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7278363e08eb4652851edb8df05ce19f, user_id=d5b812ca7dc041888401b3734faab409, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:28.923749 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e8df9-7d6a-4d1c-9258-401ee245db44 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:28.939066 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1451/2890] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:12:28 2022] PUT /identity/v3/projects/7278363e08eb4652851edb8df05ce19f/users/d5b812ca7dc041888401b3734faab409/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:12:28.943668 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b44b1-4561-45fa-8573-7957e9639f0e admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:28.954331 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b44b1-4561-45fa-8573-7957e9639f0e admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:29.018623 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1701a-52a9-4936-a4d2-b1981599bd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:29.019339 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1701a-52a9-4936-a4d2-b1981599bd69 admin admin] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:29.019626 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1701a-52a9-4936-a4d2-b1981599bd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:29.019895 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1701a-52a9-4936-a4d2-b1981599bd69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:29.020623 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e1701a-52a9-4936-a4d2-b1981599bd69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:29.022223 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e1701a-52a9-4936-a4d2-b1981599bd69 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:29.034251 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1440/2891] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 11:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 11:12:29.038739 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e8df9-7d6a-4d1c-9258-401ee245db44 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:29.049752 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e8df9-7d6a-4d1c-9258-401ee245db44 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:29.054963 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc66e3-d660-4b95-a567-a3491cee40b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:29.055922 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc66e3-d660-4b95-a567-a3491cee40b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:29.056207 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc66e3-d660-4b95-a567-a3491cee40b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:29.056486 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc66e3-d660-4b95-a567-a3491cee40b0 admin admin] PATH_INFO: `/v3/projects/7278363e08eb4652851edb8df05ce19f/users/d5b812ca7dc041888401b3734faab409/roles/4867b69c45554ce18e23167c05a02175` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:29.058558 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc66e3-d660-4b95-a567-a3491cee40b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7278363e08eb4652851edb8df05ce19f, user_id=d5b812ca7dc041888401b3734faab409, role_id=4867b69c45554ce18e23167c05a02175)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:29.061259 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc66e3-d660-4b95-a567-a3491cee40b0 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:29.072868 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1452/2892] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 11:12:29 2022] PUT /identity/v3/projects/7278363e08eb4652851edb8df05ce19f/users/d5b812ca7dc041888401b3734faab409/roles/4867b69c45554ce18e23167c05a02175 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:12:33.638789 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a2fba-328f-44ee-910b-d7190508dec5 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:33.639438 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a2fba-328f-44ee-910b-d7190508dec5 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:33.639438 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a2fba-328f-44ee-910b-d7190508dec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:33.683949 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-929a2fba-328f-44ee-910b-d7190508dec5 None None] MFA Rules not processed for user `d5b812ca7dc041888401b3734faab409`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:12:33.685543 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-929a2fba-328f-44ee-910b-d7190508dec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:33.762936 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1441/2893] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:12:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:12:33.774523 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc66e3-d660-4b95-a567-a3491cee40b0 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:33.776842 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e5dc66e3-d660-4b95-a567-a3491cee40b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:33.821931 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:12:33.844348 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc66e3-d660-4b95-a567-a3491cee40b0 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:33.848128 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274dbea6-84ec-4d90-9765-a5e62a42044f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcba737e66244fe2b5b6ec3dd17dabd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:33.848803 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dbea6-84ec-4d90-9765-a5e62a42044f service glance] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:33.849080 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dbea6-84ec-4d90-9765-a5e62a42044f service glance] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:33.849360 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dbea6-84ec-4d90-9765-a5e62a42044f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:33.918474 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274dbea6-84ec-4d90-9765-a5e62a42044f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:33.919969 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274dbea6-84ec-4d90-9765-a5e62a42044f service glance] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:33.929851 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1453/2894] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:12:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:12:34.064919 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff5161-8453-485d-961c-c698cc19b6cf None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:34.065545 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff5161-8453-485d-961c-c698cc19b6cf None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:34.065698 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff5161-8453-485d-961c-c698cc19b6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:34.133646 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-cfff5161-8453-485d-961c-c698cc19b6cf None None] MFA Rules not processed for user `4dfddd72dfa84ce39fe62112224b425d`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:12:34.135044 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-cfff5161-8453-485d-961c-c698cc19b6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:34.167695 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=100 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:12:34.202985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1442/2895] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jun 24 11:12:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:12:34.251376 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274dbea6-84ec-4d90-9765-a5e62a42044f service glance] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:34.253037 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-274dbea6-84ec-4d90-9765-a5e62a42044f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:34.352564 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274dbea6-84ec-4d90-9765-a5e62a42044f service glance] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:34.357644 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33e7f7-f62a-4a02-b2d9-afadacde53a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff592d9ebd4241019625828ddd41aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:34.358302 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33e7f7-f62a-4a02-b2d9-afadacde53a2 service swift] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:34.358586 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33e7f7-f62a-4a02-b2d9-afadacde53a2 service swift] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:34.358890 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33e7f7-f62a-4a02-b2d9-afadacde53a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:34.367105 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33e7f7-f62a-4a02-b2d9-afadacde53a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:34.368719 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33e7f7-f62a-4a02-b2d9-afadacde53a2 service swift] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:34.377384 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1454/2896] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jun 24 11:12:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 11:12:42.924341 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7cae3-a31c-4575-9a27-cd7f38dba719 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:42.924902 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7cae3-a31c-4575-9a27-cd7f38dba719 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:42.924902 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7cae3-a31c-4575-9a27-cd7f38dba719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:42.948703 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-cfe7cae3-a31c-4575-9a27-cd7f38dba719 None None] MFA Rules not processed for user `ddd02f5e81634084875c109cffce9667`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:12:42.949913 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-cfe7cae3-a31c-4575-9a27-cd7f38dba719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:42.958019 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1443/2897] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 11:12:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 11:12:43.242828 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33e7f7-f62a-4a02-b2d9-afadacde53a2 service swift] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:43.244444 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-df33e7f7-f62a-4a02-b2d9-afadacde53a2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:43.305928 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33e7f7-f62a-4a02-b2d9-afadacde53a2 service swift] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:43.310164 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8887eb-a16a-4772-b782-5463c01934eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:43.310850 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8887eb-a16a-4772-b782-5463c01934eb service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:43.311135 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8887eb-a16a-4772-b782-5463c01934eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:43.311427 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8887eb-a16a-4772-b782-5463c01934eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:43.313569 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-0f8887eb-a16a-4772-b782-5463c01934eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:43.324685 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8887eb-a16a-4772-b782-5463c01934eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:43.326112 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8887eb-a16a-4772-b782-5463c01934eb service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:43.334920 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1455/2898] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:12:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:12:44.669207 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7cae3-a31c-4575-9a27-cd7f38dba719 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:44.670823 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-cfe7cae3-a31c-4575-9a27-cd7f38dba719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:44.745437 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7cae3-a31c-4575-9a27-cd7f38dba719 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:44.751048 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef16c07-0f1b-4bad-adfc-4a8dab34b983 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b365d9dd635e4518a41181649c323062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:44.751744 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef16c07-0f1b-4bad-adfc-4a8dab34b983 service placement] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:44.752075 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef16c07-0f1b-4bad-adfc-4a8dab34b983 service placement] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:44.752707 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef16c07-0f1b-4bad-adfc-4a8dab34b983 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:44.754277 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-bef16c07-0f1b-4bad-adfc-4a8dab34b983 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:44.766567 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef16c07-0f1b-4bad-adfc-4a8dab34b983 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:44.768363 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef16c07-0f1b-4bad-adfc-4a8dab34b983 service placement] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:44.778706 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1444/2899] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:12:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:12:49.028548 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00286f24-2759-4f92-92b2-afff6556b764 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:49.029119 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00286f24-2759-4f92-92b2-afff6556b764 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:49.029119 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00286f24-2759-4f92-92b2-afff6556b764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:49.035802 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:12:49.050559 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-00286f24-2759-4f92-92b2-afff6556b764 None None] MFA Rules not processed for user `4dfddd72dfa84ce39fe62112224b425d`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:12:49.052214 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-00286f24-2759-4f92-92b2-afff6556b764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:12:49.059364 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1456/2900] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jun 24 11:12:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 11:12:49.072923 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef16c07-0f1b-4bad-adfc-4a8dab34b983 service placement] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:12:49.088016 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef16c07-0f1b-4bad-adfc-4a8dab34b983 service placement] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:12:49.093974 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda0b17-0530-4d6a-8cdb-dc8c10eaa1dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff592d9ebd4241019625828ddd41aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:12:49.094652 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda0b17-0530-4d6a-8cdb-dc8c10eaa1dc service swift] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:12:49.094936 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda0b17-0530-4d6a-8cdb-dc8c10eaa1dc service swift] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:12:49.095242 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda0b17-0530-4d6a-8cdb-dc8c10eaa1dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:12:49.106298 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda0b17-0530-4d6a-8cdb-dc8c10eaa1dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:12:49.108225 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda0b17-0530-4d6a-8cdb-dc8c10eaa1dc service swift] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:12:49.117730 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1445/2901] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jun 24 11:12:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 11:12:59.044061 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:12:59.114332 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=54 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:13:07.382596 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00286f24-2759-4f92-92b2-afff6556b764 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:13:07.384279 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-00286f24-2759-4f92-92b2-afff6556b764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:13:07.464283 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00286f24-2759-4f92-92b2-afff6556b764 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:13:07.470801 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fcb12-e7c9-496a-a019-170999e8e8e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:13:07.471509 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fcb12-e7c9-496a-a019-170999e8e8e2 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:13:07.471835 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fcb12-e7c9-496a-a019-170999e8e8e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:13:07.472113 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fcb12-e7c9-496a-a019-170999e8e8e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:13:07.474240 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-8f2fcb12-e7c9-496a-a019-170999e8e8e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:13:07.487094 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2fcb12-e7c9-496a-a019-170999e8e8e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:13:07.488716 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2fcb12-e7c9-496a-a019-170999e8e8e2 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:13:07.499810 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1457/2902] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:13:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:13:17.495259 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=34 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:13:19.645195 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda0b17-0530-4d6a-8cdb-dc8c10eaa1dc service swift] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:13:19.656705 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda0b17-0530-4d6a-8cdb-dc8c10eaa1dc service swift] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:13:19.663304 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a94d9-a5ec-498e-8411-66d2600ecf80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:13:19.664301 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a94d9-a5ec-498e-8411-66d2600ecf80 service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:13:19.664709 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a94d9-a5ec-498e-8411-66d2600ecf80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:13:19.665095 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a94d9-a5ec-498e-8411-66d2600ecf80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:13:19.668595 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-487a94d9-a5ec-498e-8411-66d2600ecf80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:13:19.685760 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a94d9-a5ec-498e-8411-66d2600ecf80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:13:19.687133 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a94d9-a5ec-498e-8411-66d2600ecf80 service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:13:19.698926 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1446/2903] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:13:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:13:19.833545 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fcb12-e7c9-496a-a019-170999e8e8e2 service nova] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:13:19.843954 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fcb12-e7c9-496a-a019-170999e8e8e2 service nova] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:13:19.848879 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b372ba-391b-4939-861d-c8202c201a3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:13:19.849514 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b372ba-391b-4939-861d-c8202c201a3b service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:13:19.849794 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b372ba-391b-4939-861d-c8202c201a3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:13:19.850101 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b372ba-391b-4939-861d-c8202c201a3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:13:19.859814 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b372ba-391b-4939-861d-c8202c201a3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:13:19.861231 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b372ba-391b-4939-861d-c8202c201a3b service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:13:19.870927 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1458/2904] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:13:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:13:21.515332 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a94d9-a5ec-498e-8411-66d2600ecf80 service neutron] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:13:21.529355 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a94d9-a5ec-498e-8411-66d2600ecf80 service neutron] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:13:21.537175 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06605136-b224-43ba-983b-f7a7263ca65c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:13:21.537855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06605136-b224-43ba-983b-f7a7263ca65c service nova] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:13:21.538147 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06605136-b224-43ba-983b-f7a7263ca65c service nova] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:13:21.538588 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06605136-b224-43ba-983b-f7a7263ca65c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:13:21.540881 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-06605136-b224-43ba-983b-f7a7263ca65c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:13:21.554855 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06605136-b224-43ba-983b-f7a7263ca65c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:13:21.556494 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06605136-b224-43ba-983b-f7a7263ca65c service nova] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:13:21.569059 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1447/2905] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:13:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:13:29.866769 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=6 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:13:31.563666 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=12 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:14:23.586147 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b372ba-391b-4939-861d-c8202c201a3b service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:14:23.599508 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b372ba-391b-4939-861d-c8202c201a3b service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:14:23.604160 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b760a2-b523-4f41-a381-07f2018ce3c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:14:23.604804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b760a2-b523-4f41-a381-07f2018ce3c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:14:23.605084 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b760a2-b523-4f41-a381-07f2018ce3c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:14:23.605352 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b760a2-b523-4f41-a381-07f2018ce3c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:14:23.607550 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-04b760a2-b523-4f41-a381-07f2018ce3c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:14:23.622305 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b760a2-b523-4f41-a381-07f2018ce3c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:14:23.623765 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b760a2-b523-4f41-a381-07f2018ce3c8 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:14:23.635772 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1459/2906] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:14:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:14:33.630275 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=6 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:14:39.233322 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06605136-b224-43ba-983b-f7a7263ca65c service nova] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:14:39.244220 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06605136-b224-43ba-983b-f7a7263ca65c service nova] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:14:39.249187 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06854d-3786-4321-b060-eda3f699c6cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c20321abda7406c843b4ee691da2106', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:14:39.249848 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06854d-3786-4321-b060-eda3f699c6cc service neutron] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:14:39.250138 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06854d-3786-4321-b060-eda3f699c6cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:14:39.250413 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06854d-3786-4321-b060-eda3f699c6cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:14:39.252639 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-3f06854d-3786-4321-b060-eda3f699c6cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:14:39.262936 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06854d-3786-4321-b060-eda3f699c6cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:14:39.264398 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06854d-3786-4321-b060-eda3f699c6cc service neutron] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:14:39.272663 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1448/2907] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:14:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:14:49.269166 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=6 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:15:24.016186 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b760a2-b523-4f41-a381-07f2018ce3c8 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:15:24.018875 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-04b760a2-b523-4f41-a381-07f2018ce3c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:15:24.046261 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b760a2-b523-4f41-a381-07f2018ce3c8 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:15:24.054109 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bee927-0696-4dfb-a382-8282d84d944a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8034bad51144002a7386c975e412992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:15:24.055795 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bee927-0696-4dfb-a382-8282d84d944a service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:15:24.055795 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bee927-0696-4dfb-a382-8282d84d944a service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:15:24.056077 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bee927-0696-4dfb-a382-8282d84d944a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:15:24.058159 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b9bee927-0696-4dfb-a382-8282d84d944a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:15:24.072421 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bee927-0696-4dfb-a382-8282d84d944a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:15:24.074785 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bee927-0696-4dfb-a382-8282d84d944a service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:15:24.087736 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1460/2908] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:15:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:15:31.580343 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e2999-efc4-4d22-99e2-6cd0192118c0 None None] REQUEST_METHOD: `POST` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:15:31.580878 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e2999-efc4-4d22-99e2-6cd0192118c0 None None] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:15:31.580878 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e2999-efc4-4d22-99e2-6cd0192118c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:15:31.599853 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.auth.core [None req-7f2e2999-efc4-4d22-99e2-6cd0192118c0 None None] MFA Rules not processed for user `4dfddd72dfa84ce39fe62112224b425d`. Rule list: `[]` (Enabled: `True`). {{(pid=80173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 11:15:31.601069 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-7f2e2999-efc4-4d22-99e2-6cd0192118c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:15:31.609005 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1449/2909] 10.222.0.16 () {58 vars in 967 bytes} [Fri Jun 24 11:15:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 11:15:31.653804 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bee927-0696-4dfb-a382-8282d84d944a service nova] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:15:31.665840 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bee927-0696-4dfb-a382-8282d84d944a service nova] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:15:31.671274 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234900e-3394-4391-9cef-b58c25133f46 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff592d9ebd4241019625828ddd41aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:15:31.671931 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234900e-3394-4391-9cef-b58c25133f46 service swift] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:15:31.672218 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234900e-3394-4391-9cef-b58c25133f46 service swift] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:15:31.672498 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234900e-3394-4391-9cef-b58c25133f46 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:15:31.680960 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234900e-3394-4391-9cef-b58c25133f46 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:15:31.682549 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234900e-3394-4391-9cef-b58c25133f46 service swift] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:15:31.690582 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1461/2910] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jun 24 11:15:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 11:15:38.177629 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e2999-efc4-4d22-99e2-6cd0192118c0 None None] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:15:38.255821 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e2999-efc4-4d22-99e2-6cd0192118c0 None None] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:15:38.260985 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91568f8b-760b-4e4d-b4b2-3eac70b35d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:15:38.261909 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91568f8b-760b-4e4d-b4b2-3eac70b35d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:15:38.262194 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91568f8b-760b-4e4d-b4b2-3eac70b35d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:15:38.262477 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91568f8b-760b-4e4d-b4b2-3eac70b35d0b admin admin] PATH_INFO: `/v3/users/ddd02f5e81634084875c109cffce9667` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:15:38.263799 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91568f8b-760b-4e4d-b4b2-3eac70b35d0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddd02f5e81634084875c109cffce9667)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:15:38.265854 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91568f8b-760b-4e4d-b4b2-3eac70b35d0b admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:15:38.334171 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-91568f8b-760b-4e4d-b4b2-3eac70b35d0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddd02f5e81634084875c109cffce9667'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:15:38.342097 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-91568f8b-760b-4e4d-b4b2-3eac70b35d0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddd02f5e81634084875c109cffce9667'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:15:38.351051 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-91568f8b-760b-4e4d-b4b2-3eac70b35d0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddd02f5e81634084875c109cffce9667'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:15:38.351700 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-91568f8b-760b-4e4d-b4b2-3eac70b35d0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddd02f5e81634084875c109cffce9667'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:15:38.365806 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-91568f8b-760b-4e4d-b4b2-3eac70b35d0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddd02f5e81634084875c109cffce9667'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:15:38.373606 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1450/2911] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:15:38 2022] DELETE /identity/v3/users/ddd02f5e81634084875c109cffce9667 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:15:38.571506 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234900e-3394-4391-9cef-b58c25133f46 service swift] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:15:38.583663 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234900e-3394-4391-9cef-b58c25133f46 service swift] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:15:38.646015 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353b86c-f9d1-4b82-89d2-490a16579ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:15:38.646813 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353b86c-f9d1-4b82-89d2-490a16579ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:15:38.647108 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353b86c-f9d1-4b82-89d2-490a16579ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:15:38.647426 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353b86c-f9d1-4b82-89d2-490a16579ccd admin admin] PATH_INFO: `/v3/projects/9853f983787a4c448389cd287c457e81` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:15:38.648644 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3353b86c-f9d1-4b82-89d2-490a16579ccd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9853f983787a4c448389cd287c457e81)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:15:38.650575 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3353b86c-f9d1-4b82-89d2-490a16579ccd admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:15:38.700141 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3353b86c-f9d1-4b82-89d2-490a16579ccd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9853f983787a4c448389cd287c457e81', 'request_id': 'req-3353b86c-f9d1-4b82-89d2-490a16579ccd'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:15:38.708319 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3353b86c-f9d1-4b82-89d2-490a16579ccd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9853f983787a4c448389cd287c457e81', 'request_id': 'req-3353b86c-f9d1-4b82-89d2-490a16579ccd'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:15:38.714125 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3353b86c-f9d1-4b82-89d2-490a16579ccd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9853f983787a4c448389cd287c457e81', 'request_id': 'req-3353b86c-f9d1-4b82-89d2-490a16579ccd'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:15:38.725359 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3353b86c-f9d1-4b82-89d2-490a16579ccd admin admin] The token cache is being invalidate because project 9853f983787a4c448389cd287c457e81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:15:38.725651 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3353b86c-f9d1-4b82-89d2-490a16579ccd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:15:38.726315 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3353b86c-f9d1-4b82-89d2-490a16579ccd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:15:38.727992 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1462/2912] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:15:38 2022] DELETE /identity/v3/projects/9853f983787a4c448389cd287c457e81 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 11:15:38.732173 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91568f8b-760b-4e4d-b4b2-3eac70b35d0b admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:15:38.733805 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-91568f8b-760b-4e4d-b4b2-3eac70b35d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:15:38.748862 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91568f8b-760b-4e4d-b4b2-3eac70b35d0b admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:15:38.809528 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6488b-b1ff-4566-ae30-6ca366cd37b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:15:38.810430 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6488b-b1ff-4566-ae30-6ca366cd37b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:15:38.810715 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6488b-b1ff-4566-ae30-6ca366cd37b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:15:38.810991 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6488b-b1ff-4566-ae30-6ca366cd37b9 admin admin] PATH_INFO: `/v3/users/d5b812ca7dc041888401b3734faab409` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:15:38.812290 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6488b-b1ff-4566-ae30-6ca366cd37b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5b812ca7dc041888401b3734faab409)` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:15:38.814228 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6488b-b1ff-4566-ae30-6ca366cd37b9 admin admin] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:15:38.834819 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:15:38.869519 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-4cf6488b-b1ff-4566-ae30-6ca366cd37b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5b812ca7dc041888401b3734faab409'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:15:38.876288 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-4cf6488b-b1ff-4566-ae30-6ca366cd37b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5b812ca7dc041888401b3734faab409'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:15:38.885166 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-4cf6488b-b1ff-4566-ae30-6ca366cd37b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5b812ca7dc041888401b3734faab409'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:15:38.885960 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-4cf6488b-b1ff-4566-ae30-6ca366cd37b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5b812ca7dc041888401b3734faab409'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:15:38.898032 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.notifications [None req-4cf6488b-b1ff-4566-ae30-6ca366cd37b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5b812ca7dc041888401b3734faab409'} {{(pid=80173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:15:38.905007 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1451/2913] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 11:15:38 2022] DELETE /identity/v3/users/d5b812ca7dc041888401b3734faab409 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:15:39.091931 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353b86c-f9d1-4b82-89d2-490a16579ccd admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:15:39.093482 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-3353b86c-f9d1-4b82-89d2-490a16579ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:15:39.107708 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353b86c-f9d1-4b82-89d2-490a16579ccd admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:15:39.167767 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6937478-3cb3-4973-aa57-a2b5d629c990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7384e027454770bea6d011e8d5d6c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0f99060cebb41e8ac55ca6f1eeb4b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:15:39.168566 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6937478-3cb3-4973-aa57-a2b5d629c990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:15:39.168849 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6937478-3cb3-4973-aa57-a2b5d629c990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:15:39.169123 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6937478-3cb3-4973-aa57-a2b5d629c990 admin admin] PATH_INFO: `/v3/projects/7278363e08eb4652851edb8df05ce19f` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:15:39.170354 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6937478-3cb3-4973-aa57-a2b5d629c990 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7278363e08eb4652851edb8df05ce19f)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:15:39.172305 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6937478-3cb3-4973-aa57-a2b5d629c990 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:15:39.178660 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:15:39.224361 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f6937478-3cb3-4973-aa57-a2b5d629c990 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7278363e08eb4652851edb8df05ce19f', 'request_id': 'req-f6937478-3cb3-4973-aa57-a2b5d629c990'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:15:39.232559 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f6937478-3cb3-4973-aa57-a2b5d629c990 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7278363e08eb4652851edb8df05ce19f', 'request_id': 'req-f6937478-3cb3-4973-aa57-a2b5d629c990'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:15:39.243985 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f6937478-3cb3-4973-aa57-a2b5d629c990 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7278363e08eb4652851edb8df05ce19f', 'request_id': 'req-f6937478-3cb3-4973-aa57-a2b5d629c990'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:15:39.255588 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f6937478-3cb3-4973-aa57-a2b5d629c990 admin admin] The token cache is being invalidate because project 7278363e08eb4652851edb8df05ce19f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 11:15:39.255877 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f6937478-3cb3-4973-aa57-a2b5d629c990 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:15:39.256521 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f6937478-3cb3-4973-aa57-a2b5d629c990 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 11:15:39.258125 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1463/2914] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 11:15:39 2022] DELETE /identity/v3/projects/7278363e08eb4652851edb8df05ce19f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 11:15:48.900752 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=21,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:15:49.252641 dv-cinder-836996-38-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 11:16:39.476521 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6488b-b1ff-4566-ae30-6ca366cd37b9 admin admin] Authenticating user token {{(pid=80173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 11:16:39.478182 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-4cf6488b-b1ff-4566-ae30-6ca366cd37b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:16:39.623064 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6488b-b1ff-4566-ae30-6ca366cd37b9 admin admin] Validating token access rules against request {{(pid=80173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 11:16:39.686549 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269672d8-4e52-433b-928b-d32645e02d52 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b365d9dd635e4518a41181649c323062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61b2f5f9674c4fd3a1ec5db2f3b4b26e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 11:16:39.687254 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269672d8-4e52-433b-928b-d32645e02d52 service placement] REQUEST_METHOD: `GET` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 11:16:39.687540 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269672d8-4e52-433b-928b-d32645e02d52 service placement] SCRIPT_NAME: `/identity` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 11:16:39.687819 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269672d8-4e52-433b-928b-d32645e02d52 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 11:16:39.689731 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.fernet_utils [None req-269672d8-4e52-433b-928b-d32645e02d52 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 11:16:39.701479 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269672d8-4e52-433b-928b-d32645e02d52 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 11:16:39.703055 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269672d8-4e52-433b-928b-d32645e02d52 service placement] RBAC: Authorization granted {{(pid=80173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 11:16:39.713676 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: [pid: 80173|app: 0|req: 1452/2915] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 11:16:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 11:16:49.709039 dv-cinder-836996-38-iscsi devstack@keystone.service[80173]: DEBUG dbcounter [-] [80173] Writing DB stats keystone:SELECT=89 {{(pid=80173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}